[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:11:43.073402  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:39811
I20260709 12:11:43.074980  7716 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:11:43.076104  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:43.093794  7723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:43.093998  7725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:43.095111  7716 server_base.cc:1061] running on GCE node
W20260709 12:11:43.094556  7722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:44.306249  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:44.306497  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:44.306761  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599104306734 us; error 0 us; skew 500 ppm
I20260709 12:11:44.307663  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:44.314330  7716 webserver.cc:533] Webserver started at http://127.7.137.62:38039/ using document root <none> and password file <none>
I20260709 12:11:44.315316  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:44.315557  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:44.316011  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:44.321854  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "2813e3930fa846c6a71701f49e5c602a"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.329970  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:11:44.335253  7731 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:44.336380  7716 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:11:44.336958  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "2813e3930fa846c6a71701f49e5c602a"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.337385  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:44.403976  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:44.405560  7716 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:11:44.406049  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:44.477322  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:39811
I20260709 12:11:44.477413  7782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:39811 every 8 connection(s)
I20260709 12:11:44.485183  7783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:44.506232  7783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: Bootstrap starting.
I20260709 12:11:44.512285  7783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:44.514135  7783 log.cc:826] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: Log is configured to *not* fsync() on all Append() calls
I20260709 12:11:44.519280  7783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: No bootstrap required, opened a new log
I20260709 12:11:44.540762  7783 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER }
I20260709 12:11:44.541302  7783 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:44.541498  7783 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2813e3930fa846c6a71701f49e5c602a, State: Initialized, Role: FOLLOWER
I20260709 12:11:44.542303  7783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER }
I20260709 12:11:44.542758  7783 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:11:44.542999  7783 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:11:44.543290  7783 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:44.547380  7783 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER }
I20260709 12:11:44.548081  7783 leader_election.cc:304] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2813e3930fa846c6a71701f49e5c602a; no voters: 
I20260709 12:11:44.550056  7783 leader_election.cc:290] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:11:44.550393  7786 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:44.552765  7786 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 1 LEADER]: Becoming Leader. State: Replica: 2813e3930fa846c6a71701f49e5c602a, State: Running, Role: LEADER
I20260709 12:11:44.553741  7786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER }
I20260709 12:11:44.554801  7783 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:11:44.565608  7787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2813e3930fa846c6a71701f49e5c602a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER } }
I20260709 12:11:44.566203  7787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:44.565843  7788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2813e3930fa846c6a71701f49e5c602a. Latest consensus state: current_term: 1 leader_uuid: "2813e3930fa846c6a71701f49e5c602a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2813e3930fa846c6a71701f49e5c602a" member_type: VOTER } }
I20260709 12:11:44.566574  7788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:44.569375  7795 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:11:44.580976  7795 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:11:44.583386  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:11:44.597014  7795 catalog_manager.cc:1383] Generated new cluster ID: c8c7d46f485446d39dad165990651f9a
I20260709 12:11:44.597309  7795 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:11:44.617378  7795 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:11:44.619549  7795 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:11:44.648114  7795 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: Generated new TSK 0
I20260709 12:11:44.649319  7795 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:11:44.714373  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:44.723038  7805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:44.724881  7806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:44.727727  7808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:44.729048  7716 server_base.cc:1061] running on GCE node
I20260709 12:11:44.729844  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:44.730064  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:44.730245  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599104730226 us; error 0 us; skew 500 ppm
I20260709 12:11:44.730894  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:44.735368  7716 webserver.cc:533] Webserver started at http://127.7.137.1:41297/ using document root <none> and password file <none>
I20260709 12:11:44.735930  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:44.736148  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:44.736433  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:44.737527  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "2151f6dae26d4c8b9530752a0f0ea240"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.743404  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:11:44.747898  7813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:44.748816  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:11:44.749128  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "2151f6dae26d4c8b9530752a0f0ea240"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.749428  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:44.789968  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:44.791455  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:44.794226  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:44.799445  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:44.799676  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:44.800007  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:44.800179  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:44.919965  7875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:36681 every 8 connection(s)
I20260709 12:11:44.920295  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:36681
I20260709 12:11:44.932039  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:44.957046  7880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:44.959946  7881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:44.964095  7883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:44.965210  7716 server_base.cc:1061] running on GCE node
I20260709 12:11:44.966204  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:44.966456  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:44.966686  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599104966667 us; error 0 us; skew 500 ppm
I20260709 12:11:44.967435  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:44.971963  7876 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39811
I20260709 12:11:44.972450  7876 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:44.972587  7716 webserver.cc:533] Webserver started at http://127.7.137.2:42105/ using document root <none> and password file <none>
I20260709 12:11:44.973129  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:44.973376  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:44.973628  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:44.973594  7876 heartbeater.cc:507] Master 127.7.137.62:39811 requested a full tablet report, sending...
I20260709 12:11:44.974931  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "20fcc74f713440ffb44f50f98091a66b"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.977496  7748 ts_manager.cc:194] Registered new tserver with Master: 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681)
I20260709 12:11:44.980545  7748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53190
I20260709 12:11:44.981011  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:11:44.986274  7888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:44.987280  7716 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:11:44.987566  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "20fcc74f713440ffb44f50f98091a66b"
format_stamp: "Formatted at 2026-07-09 12:11:44 on dist-test-slave-9kw9"
I20260709 12:11:44.987824  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.011461  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.012892  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.015136  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:45.018603  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:45.018808  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.019124  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:45.019367  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:11:45.120297  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:43191
I20260709 12:11:45.120417  7950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:43191 every 8 connection(s)
I20260709 12:11:45.127619  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:45.139338  7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.140481  7955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.144408  7951 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39811
I20260709 12:11:45.144871  7951 heartbeater.cc:461] Registering TS with master...
W20260709 12:11:45.145691  7957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.146116  7716 server_base.cc:1061] running on GCE node
I20260709 12:11:45.146118  7951 heartbeater.cc:507] Master 127.7.137.62:39811 requested a full tablet report, sending...
I20260709 12:11:45.147545  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:45.147832  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:45.148095  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599105148074 us; error 0 us; skew 500 ppm
I20260709 12:11:45.148933  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:45.149096  7748 ts_manager.cc:194] Registered new tserver with Master: 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:45.151055  7748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53192
I20260709 12:11:45.152114  7716 webserver.cc:533] Webserver started at http://127.7.137.3:43015/ using document root <none> and password file <none>
I20260709 12:11:45.152797  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:45.153081  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:45.153431  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:45.154711  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "263859ee31254c4c9dd2af92ad89ee99"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-9kw9"
I20260709 12:11:45.159637  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:11:45.163319  7962 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.164248  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:11:45.164593  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "263859ee31254c4c9dd2af92ad89ee99"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-9kw9"
I20260709 12:11:45.164976  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.188560  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.190186  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.192162  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:45.195190  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:45.195482  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.195761  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:45.195976  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.301672  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:34877
I20260709 12:11:45.301822  8024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:34877 every 8 connection(s)
I20260709 12:11:45.322518  8025 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39811
I20260709 12:11:45.322950  8025 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:45.323840  8025 heartbeater.cc:507] Master 127.7.137.62:39811 requested a full tablet report, sending...
I20260709 12:11:45.325827  7748 ts_manager.cc:194] Registered new tserver with Master: 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:45.326640  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014766328s
I20260709 12:11:45.327440  7748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53208
I20260709 12:11:45.377566  7748 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53224:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:11:45.381242  7748 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:11:45.497800  7990 tablet_service.cc:1511] Processing CreateTablet for tablet ac14c41b2ee24c289addb2e7191c098a (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:45.497486  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 11cce25054234f7bb649a599cf7aff17 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:45.501536  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac14c41b2ee24c289addb2e7191c098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.503762  7987 tablet_service.cc:1511] Processing CreateTablet for tablet db616a85eb3841058f14f8272256533c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:45.510861  7982 tablet_service.cc:1511] Processing CreateTablet for tablet 48754908a30042e5afa08b0e962cb69c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:45.510470  7986 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6cc139729442819e4d27d8997dd777 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:45.510347  7985 tablet_service.cc:1511] Processing CreateTablet for tablet 863633c660be404c90f700340cc15658 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:45.515801  7984 tablet_service.cc:1511] Processing CreateTablet for tablet 6477735f973a499b9ffbd60072aec747 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:45.516649  7983 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb4659804d4eca8989ab2670d2e821 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:45.516315  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db616a85eb3841058f14f8272256533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.517256  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2f9e19164a466b9d8aa9e2015ac314 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:45.522650  7916 tablet_service.cc:1511] Processing CreateTablet for tablet ac14c41b2ee24c289addb2e7191c098a (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:45.525732  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 11cce25054234f7bb649a599cf7aff17 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:45.528088  7982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48754908a30042e5afa08b0e962cb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.529275  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac14c41b2ee24c289addb2e7191c098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.531097  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2f9e19164a466b9d8aa9e2015ac314 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:45.536896  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2f9e19164a466b9d8aa9e2015ac314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.540352  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cce25054234f7bb649a599cf7aff17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.540354  7913 tablet_service.cc:1511] Processing CreateTablet for tablet db616a85eb3841058f14f8272256533c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:45.544575  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db616a85eb3841058f14f8272256533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.545954  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6cc139729442819e4d27d8997dd777 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:45.538739  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 863633c660be404c90f700340cc15658 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:45.540518  7910 tablet_service.cc:1511] Processing CreateTablet for tablet 6477735f973a499b9ffbd60072aec747 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:45.546074  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863633c660be404c90f700340cc15658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.556675  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6cc139729442819e4d27d8997dd777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.559046  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb4659804d4eca8989ab2670d2e821 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:45.562521  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6477735f973a499b9ffbd60072aec747. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:45.578234  7796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:45.581849  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863633c660be404c90f700340cc15658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.586977  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb4659804d4eca8989ab2670d2e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.587222  7908 tablet_service.cc:1511] Processing CreateTablet for tablet 48754908a30042e5afa08b0e962cb69c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:45.588032  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cce25054234f7bb649a599cf7aff17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.588740  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48754908a30042e5afa08b0e962cb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.591512  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6cc139729442819e4d27d8997dd777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.592374  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2f9e19164a466b9d8aa9e2015ac314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.593791  7984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6477735f973a499b9ffbd60072aec747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.595125  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb4659804d4eca8989ab2670d2e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.617868  7841 tablet_service.cc:1511] Processing CreateTablet for tablet ac14c41b2ee24c289addb2e7191c098a (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:45.620512  7839 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2f9e19164a466b9d8aa9e2015ac314 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:45.621831  7838 tablet_service.cc:1511] Processing CreateTablet for tablet db616a85eb3841058f14f8272256533c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:45.624199  7836 tablet_service.cc:1511] Processing CreateTablet for tablet 863633c660be404c90f700340cc15658 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:45.624598  7834 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb4659804d4eca8989ab2670d2e821 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:45.635108  7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac14c41b2ee24c289addb2e7191c098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.636729  7833 tablet_service.cc:1511] Processing CreateTablet for tablet 48754908a30042e5afa08b0e962cb69c (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:45.638293  7837 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6cc139729442819e4d27d8997dd777 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:45.636224  7835 tablet_service.cc:1511] Processing CreateTablet for tablet 6477735f973a499b9ffbd60072aec747 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:45.654444  7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db616a85eb3841058f14f8272256533c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.656642  7833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48754908a30042e5afa08b0e962cb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.638303  7840 tablet_service.cc:1511] Processing CreateTablet for tablet 11cce25054234f7bb649a599cf7aff17 (DEFAULT_TABLE table=test-workload [id=71036e31fd82494ba9b0f88f6191a253]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:45.659632  7835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6477735f973a499b9ffbd60072aec747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.665994  7837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6cc139729442819e4d27d8997dd777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.667299  7839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2f9e19164a466b9d8aa9e2015ac314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.674592  7834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb4659804d4eca8989ab2670d2e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.702256  8043 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:45.732141  7840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cce25054234f7bb649a599cf7aff17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.760735  8043 tablet_bootstrap.cc:654] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.757604  7836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863633c660be404c90f700340cc15658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.795723  8044 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:45.829576  8043 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:45.830749  8043 ts_tablet_manager.cc:1403] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.007s
I20260709 12:11:45.840433  8043 raft_consensus.cc:359] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.841240  8043 raft_consensus.cc:385] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.841542  8043 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.842348  8043 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.850879  8046 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:45.851063  8044 tablet_bootstrap.cc:654] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.861194  8025 heartbeater.cc:499] Master 127.7.137.62:39811 was elected leader, sending a full tablet report...
I20260709 12:11:45.862457  8046 tablet_bootstrap.cc:654] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.859097  8043 ts_tablet_manager.cc:1434] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.007s
I20260709 12:11:45.866293  8043 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:45.876871  8043 tablet_bootstrap.cc:654] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.879112  8046 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:45.879114  8044 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:45.879702  8046 ts_tablet_manager.cc:1403] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 12:11:45.879793  8044 ts_tablet_manager.cc:1403] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.016s
I20260709 12:11:45.882925  8044 raft_consensus.cc:359] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.883700  8044 raft_consensus.cc:385] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.883456  8046 raft_consensus.cc:359] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.884064  8044 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.884466  8046 raft_consensus.cc:385] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.884914  8046 raft_consensus.cc:740] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.884984  8044 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.886499  8046 consensus_queue.cc:260] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.895040  8044 ts_tablet_manager.cc:1434] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 12:11:45.895352  7951 heartbeater.cc:499] Master 127.7.137.62:39811 was elected leader, sending a full tablet report...
I20260709 12:11:45.898250  8043 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:45.898795  8043 ts_tablet_manager.cc:1403] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.013s
I20260709 12:11:45.902062  8043 raft_consensus.cc:359] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.902748  8043 raft_consensus.cc:385] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.903021  8043 raft_consensus.cc:740] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.898824  8044 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:45.911839  8046 ts_tablet_manager.cc:1434] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.032s	user 0.015s	sys 0.006s
I20260709 12:11:45.912691  7876 heartbeater.cc:499] Master 127.7.137.62:39811 was elected leader, sending a full tablet report...
I20260709 12:11:45.912487  8043 consensus_queue.cc:260] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.914819  8043 ts_tablet_manager.cc:1434] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 12:11:45.915789  8043 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:45.915866  8046 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:45.923547  8052 raft_consensus.cc:493] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.924145  8052 raft_consensus.cc:515] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.925872  8043 tablet_bootstrap.cc:654] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.927731  8052 leader_election.cc:290] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:45.911973  8044 tablet_bootstrap.cc:654] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.933251  8047 raft_consensus.cc:493] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.933760  8047 raft_consensus.cc:515] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.937470  8046 tablet_bootstrap.cc:654] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.938308  8047 leader_election.cc:290] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
W20260709 12:11:45.938443  7877 tablet.cc:2406] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:11:45.971274  8046 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:45.971853  8046 ts_tablet_manager.cc:1403] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.009s
I20260709 12:11:45.974835  8046 raft_consensus.cc:359] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.975569  8046 raft_consensus.cc:385] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.975896  8046 raft_consensus.cc:740] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.976615  8046 consensus_queue.cc:260] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.979097  8046 ts_tablet_manager.cc:1434] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:11:45.980026  8046 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:45.980963  8043 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:45.981406  8043 ts_tablet_manager.cc:1403] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.001s
I20260709 12:11:45.986515  8046 tablet_bootstrap.cc:654] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.992475  8044 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:45.992954  8044 ts_tablet_manager.cc:1403] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.010s
I20260709 12:11:45.995791  8044 raft_consensus.cc:359] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.996511  8044 raft_consensus.cc:385] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.996847  8044 raft_consensus.cc:740] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.997741  8044 consensus_queue.cc:260] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:45.998122  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.000159  8044 ts_tablet_manager.cc:1434] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 12:11:46.000105  7814 leader_election.cc:343] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.001118  8044 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.003293  8043 raft_consensus.cc:359] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.004050  8043 raft_consensus.cc:385] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.004362  8043 raft_consensus.cc:740] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.007215  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.007696  8044 tablet_bootstrap.cc:654] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.010288  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.012418  8046 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.012758  8046 ts_tablet_manager.cc:1403] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.004s
W20260709 12:11:46.014590  7816 leader_election.cc:343] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.015035  7816 leader_election.cc:304] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240; no voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.015000  8046 raft_consensus.cc:359] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.015949  8052 raft_consensus.cc:2749] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.016696  8046 raft_consensus.cc:385] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:11:46.016780  7963 leader_election.cc:343] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.017097  8046 raft_consensus.cc:740] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.018317  8046 consensus_queue.cc:260] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.020027  8051 raft_consensus.cc:493] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.020498  8051 raft_consensus.cc:515] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.020645  8043 consensus_queue.cc:260] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.023115  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.025569  8051 leader_election.cc:290] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
W20260709 12:11:46.025683  7963 leader_election.cc:343] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.026439  7963 leader_election.cc:304] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 263859ee31254c4c9dd2af92ad89ee99; no voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:46.027616  8047 raft_consensus.cc:2749] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.028424  8046 ts_tablet_manager.cc:1434] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.007s
I20260709 12:11:46.031857  8043 ts_tablet_manager.cc:1434] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:11:46.033483  8043 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.040418  8046 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.044641  8043 tablet_bootstrap.cc:654] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.046808  8044 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.047214  8044 ts_tablet_manager.cc:1403] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:11:46.050275  8044 raft_consensus.cc:359] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.050951  8044 raft_consensus.cc:385] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.051260  8044 raft_consensus.cc:740] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.052018  8044 consensus_queue.cc:260] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.053558  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.054178  8044 ts_tablet_manager.cc:1434] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:11:46.054225  7851 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.054610  8046 tablet_bootstrap.cc:654] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.055261  8044 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.055891  7889 leader_election.cc:304] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:46.056690  8051 raft_consensus.cc:2804] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.057070  8051 raft_consensus.cc:493] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.057425  8051 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.063409  8043 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.063851  8044 tablet_bootstrap.cc:654] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.063907  8043 ts_tablet_manager.cc:1403] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 12:11:46.067978  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
W20260709 12:11:46.069629  7891 leader_election.cc:343] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.067128  8043 raft_consensus.cc:359] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.070837  8043 raft_consensus.cc:385] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.071281  8043 raft_consensus.cc:740] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.072079  8043 consensus_queue.cc:260] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.074576  8043 ts_tablet_manager.cc:1434] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:11:46.075613  8043 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.082183  8043 tablet_bootstrap.cc:654] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.089737  8051 raft_consensus.cc:515] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.085178  8044 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.091674  8044 ts_tablet_manager.cc:1403] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.017s
I20260709 12:11:46.092608  8051 leader_election.cc:290] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.093101  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.093678  7851 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.093645  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
W20260709 12:11:46.095131  7891 leader_election.cc:343] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.097398  8046 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.098017  8046 ts_tablet_manager.cc:1403] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.004s
I20260709 12:11:46.098693  8044 raft_consensus.cc:359] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.099458  8044 raft_consensus.cc:385] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.099767  8044 raft_consensus.cc:740] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.100489  8044 consensus_queue.cc:260] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.101169  7851 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.102766  8044 ts_tablet_manager.cc:1434] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 12:11:46.102556  7889 leader_election.cc:304] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.103401  8051 raft_consensus.cc:2804] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.103727  8044 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.103157  8043 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.105387  8043 ts_tablet_manager.cc:1403] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.007s
I20260709 12:11:46.108359  8043 raft_consensus.cc:359] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.109051  8043 raft_consensus.cc:385] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.109354  8043 raft_consensus.cc:740] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.110101  8043 consensus_queue.cc:260] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.112443  8044 tablet_bootstrap.cc:654] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.118364  8043 ts_tablet_manager.cc:1434] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:11:46.121222  8043 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.124207  8070 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.125298  8070 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.101217  8046 raft_consensus.cc:359] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.127328  8051 raft_consensus.cc:697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:46.127465  8046 raft_consensus.cc:385] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.127816  8046 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.128274  8051 consensus_queue.cc:237] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.128743  8046 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.130004  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
W20260709 12:11:46.132030  7889 leader_election.cc:343] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.134135  8047 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.134603  8047 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.136550  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.136703  8047 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.137121  8070 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.137172  8000 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.138444  8046 ts_tablet_manager.cc:1434] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.004s
I20260709 12:11:46.138998  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.140121  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.140694  7926 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.141351  8043 tablet_bootstrap.cc:654] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.142037  7891 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:46.143872  7963 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.144428  8046 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.144611  8047 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:11:46.144791  7963 leader_election.cc:343] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.144994  8047 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.145378  8047 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.146178  8070 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.146584  8070 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.147042  8070 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.160858  8044 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.161464  8044 ts_tablet_manager.cc:1403] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.016s
I20260709 12:11:46.162681  7748 catalog_manager.cc:5697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 1 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.164546  8044 raft_consensus.cc:359] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.165346  8044 raft_consensus.cc:385] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.165699  8044 raft_consensus.cc:740] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.166496  8044 consensus_queue.cc:260] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.166695  8047 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.169019  8044 ts_tablet_manager.cc:1434] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:11:46.169629  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.170051  8046 tablet_bootstrap.cc:654] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
W20260709 12:11:46.171200  7963 leader_election.cc:343] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.172580  8044 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.172740  8070 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.174923  8047 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.176102  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:46.177006  7926 raft_consensus.cc:2393] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 263859ee31254c4c9dd2af92ad89ee99 in current term 1: Already voted for candidate 20fcc74f713440ffb44f50f98091a66b in this term.
I20260709 12:11:46.179832  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.180541  8043 tablet_bootstrap.cc:492] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.180946  8043 ts_tablet_manager.cc:1403] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 12:11:46.180784  7963 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 263859ee31254c4c9dd2af92ad89ee99; no voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240
W20260709 12:11:46.181172  7889 leader_election.cc:343] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.181764  8047 raft_consensus.cc:2749] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.183142  8070 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.183481  8043 raft_consensus.cc:359] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.184222  8043 raft_consensus.cc:385] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.184260  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:46.184546  8043 raft_consensus.cc:740] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.185109  8000 raft_consensus.cc:2393] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20fcc74f713440ffb44f50f98091a66b in current term 1: Already voted for candidate 263859ee31254c4c9dd2af92ad89ee99 in this term.
I20260709 12:11:46.185346  8047 raft_consensus.cc:493] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.185305  8043 consensus_queue.cc:260] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.185870  8047 raft_consensus.cc:515] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.186137  7891 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b; no voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.188465  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.189611  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
W20260709 12:11:46.189740  7963 leader_election.cc:343] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.190204  7926 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.191397  7963 leader_election.cc:304] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:46.187891  8047 leader_election.cc:290] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.191589  8070 raft_consensus.cc:2749] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.192780  8047 raft_consensus.cc:2804] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.193122  8047 raft_consensus.cc:493] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.193507  8044 tablet_bootstrap.cc:654] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.193497  8047 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.198338  8046 tablet_bootstrap.cc:492] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.198854  8046 ts_tablet_manager.cc:1403] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.002s
I20260709 12:11:46.199587  8043 ts_tablet_manager.cc:1434] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 12:11:46.200580  8043 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.201733  8044 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.202225  8044 ts_tablet_manager.cc:1403] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:11:46.201815  8046 raft_consensus.cc:359] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.202605  8046 raft_consensus.cc:385] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.202930  8046 raft_consensus.cc:740] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.206040  8043 tablet_bootstrap.cc:654] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.205569  8044 raft_consensus.cc:359] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.206498  8044 raft_consensus.cc:385] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.206854  8044 raft_consensus.cc:740] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.207683  8044 consensus_queue.cc:260] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.208065  8046 consensus_queue.cc:260] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.210127  8044 ts_tablet_manager.cc:1434] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:11:46.210935  8046 ts_tablet_manager.cc:1434] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:11:46.211073  8044 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.211885  8046 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.215425  8047 raft_consensus.cc:515] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.218099  8044 tablet_bootstrap.cc:654] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.218528  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.219015  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:46.265641  7851 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.265726  7926 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.217599  8047 leader_election.cc:290] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.226908  8043 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.271750  8043 ts_tablet_manager.cc:1403] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.020s
I20260709 12:11:46.276894  7851 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.277140  7926 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.277798  8043 raft_consensus.cc:359] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.280352  8043 raft_consensus.cc:385] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.280867  8043 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.280627  7963 leader_election.cc:304] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.281823  8043 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.282765  8047 raft_consensus.cc:2804] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.283277  8047 raft_consensus.cc:697] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:46.284317  8043 ts_tablet_manager.cc:1434] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:11:46.284083  8047 consensus_queue.cc:237] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.285660  8043 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.287360  8052 raft_consensus.cc:493] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.287806  8052 raft_consensus.cc:515] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.289877  8052 leader_election.cc:290] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.291503  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.291957  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.278638  8046 tablet_bootstrap.cc:654] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
W20260709 12:11:46.292927  7814 leader_election.cc:343] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:11:46.293565  7816 leader_election.cc:343] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.294028  7816 leader_election.cc:304] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240; no voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.294732  8052 raft_consensus.cc:2749] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.295647  8043 tablet_bootstrap.cc:654] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.300768  8046 tablet_bootstrap.cc:492] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.301242  8046 ts_tablet_manager.cc:1403] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:11:46.304194  8046 raft_consensus.cc:359] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.305042  8046 raft_consensus.cc:385] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.304265  7745 catalog_manager.cc:5697] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.305346  8044 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.305366  8046 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.306110  8044 ts_tablet_manager.cc:1403] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.095s	user 0.033s	sys 0.029s
I20260709 12:11:46.306401  8046 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.309002  8046 ts_tablet_manager.cc:1434] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:11:46.309962  8046 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.309996  8044 raft_consensus.cc:359] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.311026  8044 raft_consensus.cc:385] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.311414  8044 raft_consensus.cc:740] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.312364  8044 consensus_queue.cc:260] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.314601  8044 ts_tablet_manager.cc:1434] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:11:46.321460  8046 tablet_bootstrap.cc:654] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.324100  8044 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.324105  8043 tablet_bootstrap.cc:492] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.324833  8043 ts_tablet_manager.cc:1403] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.008s
I20260709 12:11:46.327423  8043 raft_consensus.cc:359] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.328116  8043 raft_consensus.cc:385] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.328560  8043 raft_consensus.cc:740] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.329547  8043 consensus_queue.cc:260] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.332123  8043 ts_tablet_manager.cc:1434] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:11:46.332597  8044 tablet_bootstrap.cc:654] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.333395  8043 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: Bootstrap starting.
I20260709 12:11:46.340180  8043 tablet_bootstrap.cc:654] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.343652  8070 raft_consensus.cc:493] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.344411  8046 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.344143  8070 raft_consensus.cc:515] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.345091  8046 ts_tablet_manager.cc:1403] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.035s	user 0.001s	sys 0.017s
I20260709 12:11:46.346387  8070 leader_election.cc:290] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.348855  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.349007  8046 raft_consensus.cc:359] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.349974  8046 raft_consensus.cc:385] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.350430  8046 raft_consensus.cc:740] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
W20260709 12:11:46.350885  7889 leader_election.cc:343] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.350050  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.351351  8046 consensus_queue.cc:260] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.352103  8000 raft_consensus.cc:2468] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.353478  7891 leader_election.cc:304] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:46.354529  8046 ts_tablet_manager.cc:1434] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:11:46.354588  8070 raft_consensus.cc:2804] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.355166  8070 raft_consensus.cc:493] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.355639  8046 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.355612  8070 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.359697  8044 tablet_bootstrap.cc:492] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.362049  8070 raft_consensus.cc:515] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.363325  8043 tablet_bootstrap.cc:492] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: No bootstrap required, opened a new log
I20260709 12:11:46.363801  8043 ts_tablet_manager.cc:1403] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.007s
I20260709 12:11:46.364892  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
W20260709 12:11:46.366291  7889 leader_election.cc:343] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.366915  8044 ts_tablet_manager.cc:1403] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.013s
I20260709 12:11:46.366662  8043 raft_consensus.cc:359] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.367342  8043 raft_consensus.cc:385] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.367623  8043 raft_consensus.cc:740] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.368301  8043 consensus_queue.cc:260] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.369716  8044 raft_consensus.cc:359] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.370426  8044 raft_consensus.cc:385] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.370534  8043 ts_tablet_manager.cc:1434] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:11:46.370857  8044 raft_consensus.cc:740] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.371634  8044 consensus_queue.cc:260] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.373911  8044 ts_tablet_manager.cc:1434] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:11:46.373711  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:46.374508  8000 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.375439  8044 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: Bootstrap starting.
I20260709 12:11:46.382004  8044 tablet_bootstrap.cc:654] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.382066  8000 raft_consensus.cc:2468] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.383481  7891 leader_election.cc:304] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:46.384328  8051 raft_consensus.cc:2804] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.384546  8070 leader_election.cc:290] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.384845  8051 raft_consensus.cc:697] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:46.385771  8051 consensus_queue.cc:237] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.387673  8046 tablet_bootstrap.cc:654] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.394398  8044 tablet_bootstrap.cc:492] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: No bootstrap required, opened a new log
I20260709 12:11:46.394997  8044 ts_tablet_manager.cc:1403] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.007s
I20260709 12:11:46.397547  8046 tablet_bootstrap.cc:492] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.397600  8047 raft_consensus.cc:493] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.398074  8046 ts_tablet_manager.cc:1403] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.003s
I20260709 12:11:46.397909  8044 raft_consensus.cc:359] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.398177  8047 raft_consensus.cc:515] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.398572  8044 raft_consensus.cc:385] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.398972  8044 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.399701  8044 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.400499  8047 leader_election.cc:290] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681)
I20260709 12:11:46.401566  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.401856  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.402204  7851 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.402393  7926 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.403527  7963 leader_election.cc:304] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.404253  8047 raft_consensus.cc:2804] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.404621  8047 raft_consensus.cc:493] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.404453  8046 raft_consensus.cc:359] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.404996  8047 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.405169  8046 raft_consensus.cc:385] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.405508  8046 raft_consensus.cc:740] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.405881  8044 ts_tablet_manager.cc:1434] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260709 12:11:46.406183  8046 consensus_queue.cc:260] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.408171  8046 ts_tablet_manager.cc:1434] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:11:46.409034  8046 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: Bootstrap starting.
I20260709 12:11:46.411662  8047 raft_consensus.cc:515] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.414105  8047 leader_election.cc:290] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681)
I20260709 12:11:46.414937  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:46.415599  7926 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.415457  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.420514  7851 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.422282  7926 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.422425  7748 catalog_manager.cc:5697] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 1 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.423354  7963 leader_election.cc:304] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.427206  7851 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.428619  8046 tablet_bootstrap.cc:654] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.431105  8047 raft_consensus.cc:2804] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.431818  8047 raft_consensus.cc:697] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:46.432713  8047 consensus_queue.cc:237] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:46.443871  8046 tablet_bootstrap.cc:492] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: No bootstrap required, opened a new log
I20260709 12:11:46.444871  8046 ts_tablet_manager.cc:1403] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.009s
I20260709 12:11:46.446698  8047 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.447167  8051 raft_consensus.cc:493] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.446704  7748 catalog_manager.cc:5697] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.447633  8046 raft_consensus.cc:359] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.447672  8051 raft_consensus.cc:515] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.448366  8046 raft_consensus.cc:385] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.448632  8046 raft_consensus.cc:740] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.449397  8046 consensus_queue.cc:260] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.449828  8051 leader_election.cc:290] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.451843  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.452450  7851 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.453935  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.454573  8000 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.455955  7889 leader_election.cc:304] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:46.457865  8051 raft_consensus.cc:2804] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.458328  8051 raft_consensus.cc:493] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.447649  8047 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.458726  8046 ts_tablet_manager.cc:1434] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:11:46.458793  8051 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.460444  8047 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.461552  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.462172  7926 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.463495  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.464071  7851 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 0.
I20260709 12:11:46.465299  7963 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.467519  8047 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.467358  8051 raft_consensus.cc:515] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.467875  8047 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.468235  8047 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.469477  8051 leader_election.cc:290] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.470314  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.470845  7851 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.473187  8047 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.475193  8047 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:46.476217  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.476853  7850 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.476780  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:46.477370  7926 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.478112  7851 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.479900  7889 leader_election.cc:304] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:46.480702  8051 raft_consensus.cc:2804] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.481210  8051 raft_consensus.cc:697] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:46.481464  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:46.482026  8000 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.482061  8051 consensus_queue.cc:237] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.489652  8000 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.491438  7748 catalog_manager.cc:5697] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 1 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.483722  7850 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.497615  7926 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 1.
I20260709 12:11:46.497970  7963 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.498751  8047 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.499205  8047 raft_consensus.cc:697] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:46.499975  8047 consensus_queue.cc:237] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.506775  7748 catalog_manager.cc:5697] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.530833  8051 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.535562  8052 raft_consensus.cc:493] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.536127  8052 raft_consensus.cc:515] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.538113  8052 leader_election.cc:290] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.539137  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.539809  8000 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 0.
I20260709 12:11:46.540385  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.541014  7926 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 0.
I20260709 12:11:46.540999  7816 leader_election.cc:304] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.542474  8052 raft_consensus.cc:2804] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.542824  8052 raft_consensus.cc:493] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.546051  8000 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.543154  8052 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.555483  8052 raft_consensus.cc:515] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.558231  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:46.558794  7926 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.564095  8051 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:46.566723  8052 leader_election.cc:290] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.570902  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:46.571673  7999 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:11:46.583425  7796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:46.578845  7999 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 1.
I20260709 12:11:46.585371  7816 leader_election.cc:304] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.585613  7926 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 1.
I20260709 12:11:46.586598  8052 raft_consensus.cc:2804] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.594051  8100 raft_consensus.cc:493] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.594551  8100 raft_consensus.cc:515] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.595789  8052 raft_consensus.cc:697] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:46.599556  8052 consensus_queue.cc:237] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.604187  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.604115  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.605098  7999 raft_consensus.cc:2393] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2151f6dae26d4c8b9530752a0f0ea240 in current term 1: Already voted for candidate 20fcc74f713440ffb44f50f98091a66b in this term.
I20260709 12:11:46.606398  8100 leader_election.cc:290] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.606552  7814 leader_election.cc:304] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240; no voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.607673  8100 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.615584  8100 raft_consensus.cc:2749] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.621821  7748 catalog_manager.cc:5697] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.680855  8051 raft_consensus.cc:493] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.681425  8051 raft_consensus.cc:515] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.683614  8051 leader_election.cc:290] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.684512  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:46.684648  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.685199  8000 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.685176  7850 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 0.
I20260709 12:11:46.686355  7891 leader_election.cc:304] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:46.687119  8051 raft_consensus.cc:2804] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.687477  8051 raft_consensus.cc:493] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.687759  8051 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.692288  8051 raft_consensus.cc:515] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.694164  8051 leader_election.cc:290] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.695367  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:46.695784  7850 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.698841  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:46.699443  8000 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.700721  7850 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.701735  7889 leader_election.cc:304] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:46.702390  8051 raft_consensus.cc:2804] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.702824  8051 raft_consensus.cc:697] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:46.703696  8051 consensus_queue.cc:237] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.705991  8000 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:46.712715  7748 catalog_manager.cc:5697] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 1 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.725922  8100 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.726608  8100 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:46.728556  8100 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:46.729298  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fcc74f713440ffb44f50f98091a66b" is_pre_election: true
I20260709 12:11:46.729698  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:46.729990  7926 raft_consensus.cc:2393] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2151f6dae26d4c8b9530752a0f0ea240 in current term 1: Already voted for candidate 20fcc74f713440ffb44f50f98091a66b in this term.
I20260709 12:11:46.730448  8000 raft_consensus.cc:2393] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2151f6dae26d4c8b9530752a0f0ea240 in current term 1: Already voted for candidate 263859ee31254c4c9dd2af92ad89ee99 in this term.
I20260709 12:11:46.731426  7816 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240; no voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:46.732347  8100 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.737205  8100 raft_consensus.cc:2749] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.794642  8051 consensus_queue.cc:1048] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.808104  8107 consensus_queue.cc:1048] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:46.828986  8047 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.841321  8047 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.852319  8110 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:46.864946  8078 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:46.894599  8078 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.908818  8078 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.962591  8107 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:46.974500  8070 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.013358  8100 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.025279  8102 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.284257  8070 consensus_queue.cc:1048] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.293836  8070 consensus_queue.cc:1048] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:11:47.587513  7796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:47.730363  8069 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.730820  8069 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:47.732825  8069 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:47.733500  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240" is_pre_election: true
I20260709 12:11:47.733697  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99" is_pre_election: true
I20260709 12:11:47.734007  7851 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:47.734239  8000 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 1.
I20260709 12:11:47.735181  7889 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:47.735909  8069 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:11:47.736230  8069 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.736498  8069 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.740897  8069 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:47.742390  8069 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:47.743208  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:47.743382  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:47.743808  7851 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.743938  8000 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.748278  7851 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:47.748418  8000 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:47.749399  7889 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:47.750095  8069 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:47.750543  8069 raft_consensus.cc:697] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:47.751159  8069 consensus_queue.cc:237] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:47.758353  7748 catalog_manager.cc:5697] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 0 to 2, leader changed from <none> to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 2 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.177170  8000 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:11:48.178735  8069 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.188397  7851 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:11:48.190112  8107 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:48.267678  8000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:11:48.268428  8000 raft_consensus.cc:606] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:48.274634  8000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:11:48.275206  8000 raft_consensus.cc:606] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:48.276120  8124 raft_consensus.cc:993] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.277128  8113 raft_consensus.cc:1081] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.279135  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:11:48.279733  7850 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.280093  7850 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.280308  8140 raft_consensus.cc:993] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.280767  8140 raft_consensus.cc:1081] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.282302  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:11:48.282783  7851 raft_consensus.cc:493] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.283135  7851 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.287762  7851 raft_consensus.cc:515] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:48.288693  7850 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.289951  7851 leader_election.cc:290] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Requested vote from peers 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:48.290692  7850 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:48.291805  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:48.292380  7926 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.292824  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:48.293418  7925 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.294474  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.295469  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.295058  7999 raft_consensus.cc:3055] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.296053  8000 raft_consensus.cc:3055] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.296087  7999 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:48.296510  8000 raft_consensus.cc:740] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:48.297127  7999 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.297320  8000 consensus_queue.cc:260] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:48.298975  7999 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.299163  7926 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.300453  7814 leader_election.cc:304] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:48.301085  8000 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.301282  8127 raft_consensus.cc:2804] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.302330  8127 raft_consensus.cc:697] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:48.303377  7925 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.303192  8127 consensus_queue.cc:237] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:11:48.304636  7814 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:48.305640  8142 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.310290  7999 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.310453  8000 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.311441  8142 raft_consensus.cc:697] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:48.314226  8142 consensus_queue.cc:237] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.315253  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:38958
I20260709 12:11:48.315867  7925 raft_consensus.cc:606] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:48.317550  7745 catalog_manager.cc:5697] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 1 to 2, leader changed from 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.323830  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:38958
I20260709 12:11:48.324488  7925 raft_consensus.cc:606] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:11:48.330245  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:11:48.330766  7999 raft_consensus.cc:606] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:11:48.337208  7745 catalog_manager.cc:5697] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 1 to 2, leader changed from 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.348266  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6477735f973a499b9ffbd60072aec747"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:45778
I20260709 12:11:48.348803  7850 raft_consensus.cc:606] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:11:48.356436  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:38958
I20260709 12:11:48.356945  7925 raft_consensus.cc:606] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Received request to transfer leadership to TS 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:48.565798  8113 raft_consensus.cc:993] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:11:48.566299  8140 raft_consensus.cc:1081] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:11:48.567817  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38956
I20260709 12:11:48.568305  7925 raft_consensus.cc:493] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.568593  7925 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.573112  7925 raft_consensus.cc:515] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.574819  7925 leader_election.cc:290] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:48.575968  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.576162  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:48.576575  7999 raft_consensus.cc:3055] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.576664  7850 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.576984  7999 raft_consensus.cc:740] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:48.577795  7999 consensus_queue.cc:260] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.578985  7999 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.583403  7850 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:48.584673  7889 leader_election.cc:304] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:11:48.585156  7999 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:48.585493  8070 raft_consensus.cc:2804] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.586000  8070 raft_consensus.cc:697] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:48.586895  8070 consensus_queue.cc:237] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.594838  7745 catalog_manager.cc:5697] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 1 to 2, leader changed from 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 2 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.623319  8127 raft_consensus.cc:993] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:11:48.623751  8142 raft_consensus.cc:1081] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:11:48.625185  7925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6477735f973a499b9ffbd60072aec747"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38954
I20260709 12:11:48.625639  7925 raft_consensus.cc:493] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.625912  7925 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.630465  7925 raft_consensus.cc:515] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.632196  7925 leader_election.cc:290] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:48.633108  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:48.633265  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.633682  7850 raft_consensus.cc:3055] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.633793  7999 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.633994  7850 raft_consensus.cc:740] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:48.634717  7850 consensus_queue.cc:260] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.635638  7850 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.638540  7999 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:48.639575  7891 leader_election.cc:304] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:48.640339  8070 raft_consensus.cc:2804] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.640345  7850 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 2.
I20260709 12:11:48.640904  8070 raft_consensus.cc:697] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:48.641759  8070 consensus_queue.cc:237] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.649235  7745 catalog_manager.cc:5697] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 1 to 2, leader changed from 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 2 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.650624  8107 raft_consensus.cc:993] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.651089  8070 raft_consensus.cc:1081] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.652642  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45766
I20260709 12:11:48.653100  7850 raft_consensus.cc:493] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.653421  7850 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.659200  7850 raft_consensus.cc:515] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.660789  7850 leader_election.cc:290] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:48.661688  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:48.661948  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.662231  7925 raft_consensus.cc:3055] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.662565  7925 raft_consensus.cc:740] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:48.662642  7999 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.663354  7925 consensus_queue.cc:260] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.664306  7925 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.668088  8069 raft_consensus.cc:993] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.668506  8069 raft_consensus.cc:1081] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:11:48.671098  7851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45766
I20260709 12:11:48.671756  7851 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.672180  7851 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:48.672017  7999 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.673730  7816 leader_election.cc:304] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:48.674556  8142 raft_consensus.cc:2804] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.675484  7925 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 2.
I20260709 12:11:48.675069  8142 raft_consensus.cc:697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:48.676720  8142 consensus_queue.cc:237] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.679143  7851 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.682598  7851 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 3 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:11:48.682821  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:11:48.683568  7999 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:48.684404  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:48.684983  7925 raft_consensus.cc:3055] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:48.685309  7925 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:48.686113  7925 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.686110  7745 catalog_manager.cc:5697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 1 to 2, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.687577  7925 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:48.690019  7999 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 3.
I20260709 12:11:48.691643  7816 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:48.692543  8142 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:48.693075  8142 raft_consensus.cc:697] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:48.693894  8142 consensus_queue.cc:237] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.694453  7925 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 3.
I20260709 12:11:48.701749  7745 catalog_manager.cc:5697] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 2 to 3, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.771405  7925 raft_consensus.cc:1275] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.772629  8142 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.782482  7999 raft_consensus.cc:1275] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.783905  8127 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.835891  7925 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.837009  8144 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.847009  7999 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.848809  8142 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:11:48.925709  8070 raft_consensus.cc:993] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:48.926131  8107 raft_consensus.cc:1081] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Signalling peer 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:48.927634  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:40144
I20260709 12:11:48.928136  7999 raft_consensus.cc:493] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.928436  7999 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.933619  7999 raft_consensus.cc:515] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.935360  7999 leader_election.cc:290] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:48.936286  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:48.936483  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48754908a30042e5afa08b0e962cb69c" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:48.936904  7851 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.936968  7925 raft_consensus.cc:3055] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.937351  7925 raft_consensus.cc:740] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:48.938176  7925 consensus_queue.cc:260] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.939394  7925 raft_consensus.cc:3060] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.943794  7851 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:11:48.945050  7963 leader_election.cc:304] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:48.945708  7925 raft_consensus.cc:2468] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:11:48.945760  8140 raft_consensus.cc:2804] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.946404  8140 raft_consensus.cc:697] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:48.947165  8140 consensus_queue.cc:237] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:48.953814  7748 catalog_manager.cc:5697] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 1 to 2, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.074093  7925 raft_consensus.cc:1275] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.075546  8142 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.083741  7999 raft_consensus.cc:1275] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.085341  8127 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.141528  7851 raft_consensus.cc:1275] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.142755  8107 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.151448  7999 raft_consensus.cc:1275] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.153800  8069 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.178056  7851 raft_consensus.cc:1275] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.179306  8069 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.187672  7999 raft_consensus.cc:1275] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.189101  8107 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:49.282612  7999 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:11:49.283810  8127 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.291904  7925 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:11:49.293407  8142 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.370592  7851 raft_consensus.cc:1275] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.371825  8140 consensus_queue.cc:1048] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:49.380451  7925 raft_consensus.cc:1275] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:49.381798  8170 consensus_queue.cc:1048] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:51.385914  7716 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:11:51.386678  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.405287  7851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
mode: GRACEFUL
new_leader_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:38512
I20260709 12:11:51.405825  7851 raft_consensus.cc:606] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Received request to transfer leadership to TS 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:51.416688  7925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:11:51.417212  7925 raft_consensus.cc:606] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Received request to transfer leadership to TS 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:11:51.418277  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:51.418689  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:51.723791  8127 raft_consensus.cc:993] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: : Instructing follower 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:51.724253  8127 raft_consensus.cc:1081] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Signalling peer 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:51.725698  8000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:40138
I20260709 12:11:51.726169  8000 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.726491  8000 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.727846  8178 raft_consensus.cc:993] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:51.728350  8107 raft_consensus.cc:1081] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Signalling peer 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:11:51.729753  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:40144
I20260709 12:11:51.730211  7999 raft_consensus.cc:493] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.730502  7999 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:51.731835  8000 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.733467  8000 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 3 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:51.734391  7851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:51.734788  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:51.735010  7851 raft_consensus.cc:3055] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:51.735386  7925 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.735368  7851 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:11:51.735670  7999 raft_consensus.cc:515] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.736553  7851 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.737483  7999 leader_election.cc:290] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:11:51.737663  7851 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.738617  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:11:51.739189  7926 raft_consensus.cc:3055] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:51.739528  7926 raft_consensus.cc:740] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:11:51.740243  7926 consensus_queue.cc:260] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.741163  7926 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:51.742202  7925 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 3.
I20260709 12:11:51.744076  7851 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 3.
I20260709 12:11:51.744637  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:11:51.745102  7850 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:51.746182  7963 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:51.747004  8174 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:51.748409  8174 raft_consensus.cc:697] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:51.748621  7926 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:11:51.749291  8174 consensus_queue.cc:237] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.749796  7963 leader_election.cc:304] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:11:51.750563  8183 raft_consensus.cc:2804] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:51.751818  7850 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:11:51.753580  8183 raft_consensus.cc:697] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:11:51.754858  8183 consensus_queue.cc:237] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:11:51.757941  7745 catalog_manager.cc:5697] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 2 to 3, leader changed from 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1) to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:51.772794  7745 catalog_manager.cc:5697] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 1 to 2, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.204022  7850 raft_consensus.cc:1275] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:52.205305  8183 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:52.214872  7926 raft_consensus.cc:1275] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:52.216423  8174 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:52.228467  7850 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.229691  8174 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.238116  7926 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:52.239619  8174 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.419691  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.424893  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:52.425310  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:53.426405  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.432228  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:53.432579  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:54.433537  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.438277  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:54.438683  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:55.439558  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.444696  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:55.445050  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.446018  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.450721  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:56.451143  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:57.452096  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.457398  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:57.457775  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.458571  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.463423  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:58.463783  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.464546  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.469472  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:59.469813  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.470611  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.476212  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:00.476637  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:01.505244  7716 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:01.509723  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:45778
I20260709 12:12:01.510373  7850 raft_consensus.cc:606] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:12:01.515425  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:12:01.515846  7999 raft_consensus.cc:606] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:12:01.521109  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:45778
I20260709 12:12:01.521620  7850 raft_consensus.cc:606] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:12:01.526235  7850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:45778
I20260709 12:12:01.526700  7850 raft_consensus.cc:606] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:12:01.538501  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
mode: GRACEFUL
new_leader_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:12:01.539036  7999 raft_consensus.cc:606] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Received request to transfer leadership to TS 20fcc74f713440ffb44f50f98091a66b
I20260709 12:12:01.558969  8127 raft_consensus.cc:993] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.559545  8204 raft_consensus.cc:1081] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.561339  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38954
I20260709 12:12:01.561825  7926 raft_consensus.cc:493] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.562198  7926 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.567865  7926 raft_consensus.cc:515] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:12:01.570055  7926 leader_election.cc:290] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Requested vote from peers 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877), 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681)
I20260709 12:12:01.571015  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:01.571343  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac14c41b2ee24c289addb2e7191c098a" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:01.571801  7999 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.571898  7850 raft_consensus.cc:3055] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.572211  7850 raft_consensus.cc:740] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:01.573061  7850 consensus_queue.cc:260] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:12:01.579571  7999 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.580464  8000 raft_consensus.cc:1240] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Rejecting Update request from peer 2151f6dae26d4c8b9530752a0f0ea240 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:01.580932  7891 leader_election.cc:304] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:01.581984  8178 raft_consensus.cc:2804] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.583048  8178 raft_consensus.cc:697] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:01.583359  7850 raft_consensus.cc:3060] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.584617  8178 consensus_queue.cc:237] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } }
I20260709 12:12:01.590752  7850 raft_consensus.cc:2468] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.593667  7745 catalog_manager.cc:5697] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 2 to 3, leader changed from 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 3 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.664870  8203 raft_consensus.cc:993] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.665441  8211 raft_consensus.cc:1081] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.666812  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38956
I20260709 12:12:01.667279  7926 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.667511  7926 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.671775  7926 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.673234  7926 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 4 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:01.674003  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:01.674181  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:01.674520  7850 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.674804  7999 raft_consensus.cc:3055] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:01.675102  7999 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:12:01.675781  7999 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.676637  7999 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.678767  7850 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 4.
I20260709 12:12:01.679894  7889 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:12:01.680583  8178 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:01.680939  8178 raft_consensus.cc:697] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:01.681042  7999 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 4.
I20260709 12:12:01.681586  8178 consensus_queue.cc:237] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.687942  7745 catalog_manager.cc:5697] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 3 to 4, leader changed from 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 4 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.692549  8127 raft_consensus.cc:993] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.692966  8204 raft_consensus.cc:1081] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.694304  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38954
I20260709 12:12:01.694734  7926 raft_consensus.cc:493] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.695106  7926 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.699159  7926 raft_consensus.cc:515] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.700546  7926 leader_election.cc:290] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:01.701373  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:01.701503  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2f9e19164a466b9d8aa9e2015ac314" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:01.701851  7850 raft_consensus.cc:3055] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.702003  7999 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.702142  7850 raft_consensus.cc:740] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:01.702872  7850 consensus_queue.cc:260] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.703835  7850 raft_consensus.cc:3060] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.707101  7999 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.708041  7891 leader_election.cc:304] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:01.708726  8178 raft_consensus.cc:2804] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.709177  8178 raft_consensus.cc:697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:01.709121  7850 raft_consensus.cc:2468] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.710045  8178 consensus_queue.cc:237] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.716406  7745 catalog_manager.cc:5697] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 2 to 3, leader changed from 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 3 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.923105  8127 raft_consensus.cc:993] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.923563  8204 raft_consensus.cc:1081] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.925060  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38954
I20260709 12:12:01.925482  7926 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.925719  7926 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.929663  7926 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.930977  7926 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 4 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:01.931838  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:01.932005  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:01.932423  7850 raft_consensus.cc:3055] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:01.932552  7999 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.932735  7850 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:01.933502  7850 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.934422  7850 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.937104  7999 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 4.
I20260709 12:12:01.938036  7891 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:01.938642  7850 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 4.
I20260709 12:12:01.938750  8178 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:01.939198  8178 raft_consensus.cc:697] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:01.939922  8178 consensus_queue.cc:237] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.946306  7745 catalog_manager.cc:5697] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 3 to 4, leader changed from 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 4 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.982172  8203 raft_consensus.cc:993] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: : Instructing follower 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.982645  8211 raft_consensus.cc:1081] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Signalling peer 20fcc74f713440ffb44f50f98091a66b to start an election
I20260709 12:12:01.983958  7926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
 from {username='slave'} at 127.0.0.1:38956
I20260709 12:12:01.984380  7926 raft_consensus.cc:493] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.984653  7926 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.988608  7926 raft_consensus.cc:515] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.990069  7926 leader_election.cc:290] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:01.990828  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:01.990929  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb4659804d4eca8989ab2670d2e821" candidate_uuid: "20fcc74f713440ffb44f50f98091a66b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:01.991387  7850 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.991425  7999 raft_consensus.cc:3055] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.991786  7999 raft_consensus.cc:740] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:12:01.992341  7999 consensus_queue.cc:260] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:01.993170  7999 raft_consensus.cc:3060] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.995604  7850 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.996546  7889 leader_election.cc:304] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20fcc74f713440ffb44f50f98091a66b, 2151f6dae26d4c8b9530752a0f0ea240; no voters: 
I20260709 12:12:01.997215  8178 raft_consensus.cc:2804] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.997638  8178 raft_consensus.cc:697] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Becoming Leader. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:01.997887  7999 raft_consensus.cc:2468] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20fcc74f713440ffb44f50f98091a66b in term 3.
I20260709 12:12:01.998369  8178 consensus_queue.cc:237] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:02.005682  7745 catalog_manager.cc:5697] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b reported cstate change: term changed from 2 to 3, leader changed from 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3) to 20fcc74f713440ffb44f50f98091a66b (127.7.137.2). New cstate: current_term: 3 leader_uuid: "20fcc74f713440ffb44f50f98091a66b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.006794  7850 raft_consensus.cc:1275] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.007972  8178 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.020030  7999 raft_consensus.cc:1275] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.022240  8219 consensus_queue.cc:1048] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:02.156633  7850 raft_consensus.cc:1275] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.157835  8219 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.167853  8000 raft_consensus.cc:1275] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.169480  8178 consensus_queue.cc:1048] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.184020  8000 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.185320  8205 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:02.194690  7850 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:02.196449  8223 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:02.463784  8000 raft_consensus.cc:1275] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.465044  8223 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.474584  7850 raft_consensus.cc:1275] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.476442  8205 consensus_queue.cc:1048] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.512231  8000 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:02.513502  8205 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.522161  7850 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Refusing update from remote peer 20fcc74f713440ffb44f50f98091a66b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:02.523969  8219 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:04.572008  7716 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:04.572932  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.580816  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:12:04.581507  7926 raft_consensus.cc:606] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:12:04.584069  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6477735f973a499b9ffbd60072aec747"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:12:04.584507  7926 raft_consensus.cc:606] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:12:04.586426  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863633c660be404c90f700340cc15658"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:12:04.586829  7926 raft_consensus.cc:606] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Received request to transfer leadership to TS 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:12:04.588846  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:12:04.589246  7926 raft_consensus.cc:606] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Received request to transfer leadership to TS 263859ee31254c4c9dd2af92ad89ee99
I20260709 12:12:04.591382  7926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
mode: GRACEFUL
new_leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:55132
I20260709 12:12:04.591763  7926 raft_consensus.cc:606] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Received request to transfer leadership to TS 2151f6dae26d4c8b9530752a0f0ea240
I20260709 12:12:04.592518  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:04.592908  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:04.727752  8232 raft_consensus.cc:993] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.728307  8219 raft_consensus.cc:1081] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.729822  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6477735f973a499b9ffbd60072aec747"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45766
I20260709 12:12:04.730291  7850 raft_consensus.cc:493] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.730609  7850 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.735517  7850 raft_consensus.cc:515] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.737802  7850 leader_election.cc:290] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 3 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:04.739151  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:04.739480  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6477735f973a499b9ffbd60072aec747" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:12:04.739902  8000 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.739955  7926 raft_consensus.cc:3055] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:04.740371  7926 raft_consensus.cc:740] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:04.741045  7926 consensus_queue.cc:260] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.741961  7926 raft_consensus.cc:3060] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.744517  8000 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 3.
I20260709 12:12:04.745770  7816 leader_election.cc:304] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:04.746660  7926 raft_consensus.cc:2468] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 3.
I20260709 12:12:04.747390  8233 raft_consensus.cc:2804] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:04.748340  8233 raft_consensus.cc:697] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:04.749365  8233 consensus_queue.cc:237] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.757330  7745 catalog_manager.cc:5697] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 2 to 3, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.874168  8232 raft_consensus.cc:993] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.874687  8219 raft_consensus.cc:1081] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.876333  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db616a85eb3841058f14f8272256533c"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45766
I20260709 12:12:04.877027  7850 raft_consensus.cc:493] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.877429  7850 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.883386  8232 raft_consensus.cc:993] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:12:04.883078  7850 raft_consensus.cc:515] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.883895  8219 raft_consensus.cc:1081] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Signalling peer 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:12:04.885036  7850 leader_election.cc:290] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 5 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:04.885406  8000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:40144
I20260709 12:12:04.885753  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:12:04.886029  8000 raft_consensus.cc:493] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.886410  8000 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.886343  7926 raft_consensus.cc:3055] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:04.886663  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db616a85eb3841058f14f8272256533c" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:04.886817  7926 raft_consensus.cc:740] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:04.887326  7999 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.887686  7926 consensus_queue.cc:260] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.888900  7926 raft_consensus.cc:3060] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.892813  7999 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 5.
I20260709 12:12:04.892625  8000 raft_consensus.cc:515] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.893879  7816 leader_election.cc:304] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:04.894586  8233 raft_consensus.cc:2804] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:04.895042  7926 raft_consensus.cc:2468] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 5.
I20260709 12:12:04.896273  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:04.895180  8000 leader_election.cc:290] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 3 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:12:04.895015  8233 raft_consensus.cc:697] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:04.896847  7850 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.897234  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6cc139729442819e4d27d8997dd777" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:12:04.897797  7925 raft_consensus.cc:3055] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:04.898141  7925 raft_consensus.cc:740] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:04.897763  8233 consensus_queue.cc:237] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.898751  7925 consensus_queue.cc:260] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.899794  7925 raft_consensus.cc:3060] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:04.904163  7850 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 3.
I20260709 12:12:04.905436  7963 leader_election.cc:304] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:04.905615  7925 raft_consensus.cc:2468] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 3.
I20260709 12:12:04.906328  8211 raft_consensus.cc:2804] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:04.907649  8211 raft_consensus.cc:697] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:12:04.908537  8211 consensus_queue.cc:237] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.908082  7745 catalog_manager.cc:5697] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 4 to 5, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 5 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.919181  7748 catalog_manager.cc:5697] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 2 to 3, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.971777  8219 raft_consensus.cc:993] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.972282  8232 raft_consensus.cc:1081] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Signalling peer 2151f6dae26d4c8b9530752a0f0ea240 to start an election
I20260709 12:12:04.973861  7850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17"
dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
 from {username='slave'} at 127.0.0.1:45766
I20260709 12:12:04.974299  7850 raft_consensus.cc:493] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.974532  7850 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.978885  7850 raft_consensus.cc:515] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.980407  7850 leader_election.cc:290] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 5 election: Requested vote from peers 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191), 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3:34877)
I20260709 12:12:04.981216  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:12:04.981453  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cce25054234f7bb649a599cf7aff17" candidate_uuid: "2151f6dae26d4c8b9530752a0f0ea240" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
I20260709 12:12:04.981801  7925 raft_consensus.cc:3055] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:04.981966  8000 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.982160  7925 raft_consensus.cc:740] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:04.982995  7925 consensus_queue.cc:260] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.983989  7925 raft_consensus.cc:3060] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.986233  8000 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 5.
I20260709 12:12:04.987160  7816 leader_election.cc:304] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:04.987923  8233 raft_consensus.cc:2804] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:04.988327  8233 raft_consensus.cc:697] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 LEADER]: Becoming Leader. State: Replica: 2151f6dae26d4c8b9530752a0f0ea240, State: Running, Role: LEADER
I20260709 12:12:04.988854  7925 raft_consensus.cc:2468] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2151f6dae26d4c8b9530752a0f0ea240 in term 5.
I20260709 12:12:04.989066  8233 consensus_queue.cc:237] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:04.995571  7748 catalog_manager.cc:5697] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 reported cstate change: term changed from 4 to 5, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1). New cstate: current_term: 5 leader_uuid: "2151f6dae26d4c8b9530752a0f0ea240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.005906  8219 raft_consensus.cc:993] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: : Instructing follower 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:12:05.006359  8232 raft_consensus.cc:1081] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Signalling peer 263859ee31254c4c9dd2af92ad89ee99 to start an election
I20260709 12:12:05.007884  8000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863633c660be404c90f700340cc15658"
dest_uuid: "263859ee31254c4c9dd2af92ad89ee99"
 from {username='slave'} at 127.0.0.1:40144
I20260709 12:12:05.008358  8000 raft_consensus.cc:493] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.008711  8000 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:05.012837  8000 raft_consensus.cc:515] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:05.014225  8000 leader_election.cc:290] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Requested vote from peers 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681), 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191)
I20260709 12:12:05.015293  7850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2151f6dae26d4c8b9530752a0f0ea240"
I20260709 12:12:05.015344  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863633c660be404c90f700340cc15658" candidate_uuid: "263859ee31254c4c9dd2af92ad89ee99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20fcc74f713440ffb44f50f98091a66b"
I20260709 12:12:05.015844  7850 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:05.015913  7925 raft_consensus.cc:3055] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:05.016291  7925 raft_consensus.cc:740] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20fcc74f713440ffb44f50f98091a66b, State: Running, Role: LEADER
I20260709 12:12:05.016965  7925 consensus_queue.cc:260] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:05.017830  7925 raft_consensus.cc:3060] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:05.020113  7850 raft_consensus.cc:2468] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:12:05.021030  7963 leader_election.cc:304] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2151f6dae26d4c8b9530752a0f0ea240, 263859ee31254c4c9dd2af92ad89ee99; no voters: 
I20260709 12:12:05.021680  8211 raft_consensus.cc:2804] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:05.022145  8211 raft_consensus.cc:697] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Becoming Leader. State: Replica: 263859ee31254c4c9dd2af92ad89ee99, State: Running, Role: LEADER
I20260709 12:12:05.023140  7925 raft_consensus.cc:2468] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 263859ee31254c4c9dd2af92ad89ee99 in term 2.
I20260709 12:12:05.023100  8211 consensus_queue.cc:237] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } }
I20260709 12:12:05.031579  7748 catalog_manager.cc:5697] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 reported cstate change: term changed from 1 to 2, leader changed from 20fcc74f713440ffb44f50f98091a66b (127.7.137.2) to 263859ee31254c4c9dd2af92ad89ee99 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "263859ee31254c4c9dd2af92ad89ee99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.139755  7925 raft_consensus.cc:1275] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.141088  8233 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.150935  8000 raft_consensus.cc:1275] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.152519  8234 consensus_queue.cc:1048] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:05.290220  7925 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:05.291317  8234 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:05.300124  8000 raft_consensus.cc:1275] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:05.302032  8251 consensus_queue.cc:1048] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:05.303647  7925 raft_consensus.cc:1275] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.307266  8211 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.319777  7850 raft_consensus.cc:1275] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:05.321396  8211 consensus_queue.cc:1048] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:05.542435  7925 raft_consensus.cc:1275] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:05.543583  8211 consensus_queue.cc:1048] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:05.553385  7850 raft_consensus.cc:1275] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Refusing update from remote peer 263859ee31254c4c9dd2af92ad89ee99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:05.554593  8254 consensus_queue.cc:1048] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2151f6dae26d4c8b9530752a0f0ea240" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:05.567504  8000 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.568738  8234 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "263859ee31254c4c9dd2af92ad89ee99" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:05.577642  7925 raft_consensus.cc:1275] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Refusing update from remote peer 2151f6dae26d4c8b9530752a0f0ea240: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:05.579131  8251 consensus_queue.cc:1048] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fcc74f713440ffb44f50f98091a66b" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 43191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:05.593894  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.598692  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:05.599130  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:06.600098  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.607018  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:06.607492  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.608901  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.614598  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:07.614953  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.616014  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:08.620939  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:08.621400  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:09.622460  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.627465  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:09.627859  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.628850  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.634418  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.634862  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:11.635986  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.640815  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:11.641222  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.642235  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.647116  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:12.647630  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:13.648941  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.654745  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:13.655103  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:14.682638  7716 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:14.683194  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
I20260709 12:12:14.708654  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:14.709537  7716 tablet_replica.cc:333] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.710246  7716 raft_consensus.cc:2243] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.710930  7716 raft_consensus.cc:2272] T 863633c660be404c90f700340cc15658 P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:14.713171  7963 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:14.714203  7716 tablet_replica.cc:333] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.714959  7716 raft_consensus.cc:2243] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.716078  7716 raft_consensus.cc:2272] T db616a85eb3841058f14f8272256533c P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:14.717186  7963 consensus_peers.cc:597] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 -> Peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Couldn't send request to peer 2151f6dae26d4c8b9530752a0f0ea240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.718377  7716 tablet_replica.cc:333] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
W20260709 12:12:14.718448  7963 consensus_peers.cc:597] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 -> Peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Couldn't send request to peer 2151f6dae26d4c8b9530752a0f0ea240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.719305  7716 raft_consensus.cc:2243] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.719769  7716 raft_consensus.cc:2272] T 9f6cc139729442819e4d27d8997dd777 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.721323  7716 tablet_replica.cc:333] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.721760  7716 raft_consensus.cc:2243] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.722409  7716 raft_consensus.cc:2272] T 11cce25054234f7bb649a599cf7aff17 P 2151f6dae26d4c8b9530752a0f0ea240 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.723973  7716 tablet_replica.cc:333] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.724395  7716 raft_consensus.cc:2243] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.724772  7716 raft_consensus.cc:2272] T ac14c41b2ee24c289addb2e7191c098a P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.726425  7716 tablet_replica.cc:333] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.726861  7716 raft_consensus.cc:2243] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.727703  7716 raft_consensus.cc:2272] T 6477735f973a499b9ffbd60072aec747 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.729282  7716 tablet_replica.cc:333] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.729713  7716 raft_consensus.cc:2243] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.730062  7716 raft_consensus.cc:2272] T 1c2f9e19164a466b9d8aa9e2015ac314 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.731737  7716 tablet_replica.cc:333] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.732231  7716 raft_consensus.cc:2243] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.732620  7716 raft_consensus.cc:2272] T 53fb4659804d4eca8989ab2670d2e821 P 2151f6dae26d4c8b9530752a0f0ea240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.734053  7716 tablet_replica.cc:333] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240: stopping tablet replica
I20260709 12:12:14.734433  7716 raft_consensus.cc:2243] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.734766  7716 raft_consensus.cc:2272] T 48754908a30042e5afa08b0e962cb69c P 2151f6dae26d4c8b9530752a0f0ea240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.822009  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
I20260709 12:12:14.844650  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:12:14.867162  7889 consensus_peers.cc:597] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b -> Peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Couldn't send request to peer 2151f6dae26d4c8b9530752a0f0ea240. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.874724  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:14.875590  7716 tablet_replica.cc:333] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.876215  7716 raft_consensus.cc:2243] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.876715  7716 raft_consensus.cc:2272] T 11cce25054234f7bb649a599cf7aff17 P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.878432  7716 tablet_replica.cc:333] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.878950  7716 raft_consensus.cc:2243] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.879812  7716 raft_consensus.cc:2272] T ac14c41b2ee24c289addb2e7191c098a P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.881417  7716 tablet_replica.cc:333] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.881927  7716 raft_consensus.cc:2243] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.882651  7716 raft_consensus.cc:2272] T 53fb4659804d4eca8989ab2670d2e821 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.884325  7716 tablet_replica.cc:333] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.884799  7716 raft_consensus.cc:2243] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.885202  7716 raft_consensus.cc:2272] T 48754908a30042e5afa08b0e962cb69c P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.886711  7716 tablet_replica.cc:333] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.887208  7716 raft_consensus.cc:2243] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.887986  7716 raft_consensus.cc:2272] T 1c2f9e19164a466b9d8aa9e2015ac314 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.889758  7716 tablet_replica.cc:333] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.890389  7716 raft_consensus.cc:2243] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.890794  7716 raft_consensus.cc:2272] T 6477735f973a499b9ffbd60072aec747 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.892372  7716 tablet_replica.cc:333] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.892800  7716 raft_consensus.cc:2243] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.893173  7716 raft_consensus.cc:2272] T 863633c660be404c90f700340cc15658 P 20fcc74f713440ffb44f50f98091a66b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.894706  7716 tablet_replica.cc:333] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.895138  7716 raft_consensus.cc:2243] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.895573  7716 raft_consensus.cc:2272] T 9f6cc139729442819e4d27d8997dd777 P 20fcc74f713440ffb44f50f98091a66b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.897111  7716 tablet_replica.cc:333] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b: stopping tablet replica
I20260709 12:12:14.897540  7716 raft_consensus.cc:2243] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.897923  7716 raft_consensus.cc:2272] T db616a85eb3841058f14f8272256533c P 20fcc74f713440ffb44f50f98091a66b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.926738  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
W20260709 12:12:14.931619  7963 consensus_peers.cc:597] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 -> Peer 2151f6dae26d4c8b9530752a0f0ea240 (127.7.137.1:36681): Couldn't send request to peer 2151f6dae26d4c8b9530752a0f0ea240. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.945354  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
W20260709 12:12:14.969606  7963 consensus_peers.cc:597] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 -> Peer 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191): Couldn't send request to peer 20fcc74f713440ffb44f50f98091a66b. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:43191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.972059  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:14.972908  7716 tablet_replica.cc:333] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.973821  7716 raft_consensus.cc:2243] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:14.974159  7963 consensus_peers.cc:597] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 -> Peer 20fcc74f713440ffb44f50f98091a66b (127.7.137.2:43191): Couldn't send request to peer 20fcc74f713440ffb44f50f98091a66b. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:43191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.974483  7716 raft_consensus.cc:2272] T ac14c41b2ee24c289addb2e7191c098a P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.976393  7716 tablet_replica.cc:333] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.976938  7716 raft_consensus.cc:2243] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.977386  7716 raft_consensus.cc:2272] T 11cce25054234f7bb649a599cf7aff17 P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.978909  7716 tablet_replica.cc:333] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.979431  7716 raft_consensus.cc:2243] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.980180  7716 raft_consensus.cc:2272] T 48754908a30042e5afa08b0e962cb69c P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.981662  7716 tablet_replica.cc:333] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.982136  7716 raft_consensus.cc:2243] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.982542  7716 raft_consensus.cc:2272] T 53fb4659804d4eca8989ab2670d2e821 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.984179  7716 tablet_replica.cc:333] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.984673  7716 raft_consensus.cc:2243] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.985420  7716 raft_consensus.cc:2272] T 9f6cc139729442819e4d27d8997dd777 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.987038  7716 tablet_replica.cc:333] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.987564  7716 raft_consensus.cc:2243] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.988332  7716 raft_consensus.cc:2272] T 863633c660be404c90f700340cc15658 P 263859ee31254c4c9dd2af92ad89ee99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.989979  7716 tablet_replica.cc:333] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.990439  7716 raft_consensus.cc:2243] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.990936  7716 raft_consensus.cc:2272] T 1c2f9e19164a466b9d8aa9e2015ac314 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.992559  7716 tablet_replica.cc:333] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.993001  7716 raft_consensus.cc:2243] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.993364  7716 raft_consensus.cc:2272] T 6477735f973a499b9ffbd60072aec747 P 263859ee31254c4c9dd2af92ad89ee99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.995008  7716 tablet_replica.cc:333] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99: stopping tablet replica
I20260709 12:12:14.995514  7716 raft_consensus.cc:2243] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.995931  7716 raft_consensus.cc:2272] T db616a85eb3841058f14f8272256533c P 263859ee31254c4c9dd2af92ad89ee99 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.023746  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:12:15.041690  7716 master.cc:562] Master@127.7.137.62:39811 shutting down...
I20260709 12:12:15.209299  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.209918  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.210268  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2813e3930fa846c6a71701f49e5c602a: stopping tablet replica
I20260709 12:12:15.229951  7716 master.cc:584] Master@127.7.137.62:39811 shutdown complete.
20fcc74f713440ffb44f50f98091a66b  4
2151f6dae26d4c8b9530752a0f0ea240  4
263859ee31254c4c9dd2af92ad89ee99  1
20fcc74f713440ffb44f50f98091a66b  3
2151f6dae26d4c8b9530752a0f0ea240  3
263859ee31254c4c9dd2af92ad89ee99  3
20fcc74f713440ffb44f50f98091a66b  8
2151f6dae26d4c8b9530752a0f0ea240  0
263859ee31254c4c9dd2af92ad89ee99  1
20fcc74f713440ffb44f50f98091a66b  3
2151f6dae26d4c8b9530752a0f0ea240  3
263859ee31254c4c9dd2af92ad89ee99  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32200 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:15.270836  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:41117
I20260709 12:12:15.271979  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.277884  8272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.277895  8273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.278836  8275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.279560  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:15.280580  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.280778  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.280934  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599135280918 us; error 0 us; skew 500 ppm
I20260709 12:12:15.281575  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.284392  7716 webserver.cc:533] Webserver started at http://127.7.137.62:46113/ using document root <none> and password file <none>
I20260709 12:12:15.284901  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.285104  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.285382  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.286581  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "88aa42bb6b804cf38a8120a14b938081"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.290910  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:15.294301  8280 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.295148  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:15.295478  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "88aa42bb6b804cf38a8120a14b938081"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.295724  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.308926  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.310070  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.347312  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:41117
I20260709 12:12:15.347553  8331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:41117 every 8 connection(s)
I20260709 12:12:15.351154  8332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.360644  8332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081: Bootstrap starting.
I20260709 12:12:15.365602  8332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.369741  8332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081: No bootstrap required, opened a new log
I20260709 12:12:15.372043  8332 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER }
I20260709 12:12:15.372457  8332 raft_consensus.cc:385] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.372699  8332 raft_consensus.cc:740] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88aa42bb6b804cf38a8120a14b938081, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.373327  8332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER }
I20260709 12:12:15.373802  8332 raft_consensus.cc:399] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:15.374039  8332 raft_consensus.cc:493] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:15.374300  8332 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.378341  8332 raft_consensus.cc:515] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER }
I20260709 12:12:15.378835  8332 leader_election.cc:304] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88aa42bb6b804cf38a8120a14b938081; no voters: 
I20260709 12:12:15.379917  8332 leader_election.cc:290] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:15.380324  8335 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.381922  8335 raft_consensus.cc:697] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 1 LEADER]: Becoming Leader. State: Replica: 88aa42bb6b804cf38a8120a14b938081, State: Running, Role: LEADER
I20260709 12:12:15.382592  8335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER }
I20260709 12:12:15.383437  8332 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:15.389567  8337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88aa42bb6b804cf38a8120a14b938081. Latest consensus state: current_term: 1 leader_uuid: "88aa42bb6b804cf38a8120a14b938081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER } }
I20260709 12:12:15.389479  8336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88aa42bb6b804cf38a8120a14b938081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88aa42bb6b804cf38a8120a14b938081" member_type: VOTER } }
I20260709 12:12:15.390206  8337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.390419  8336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.392278  8344 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:15.397163  8344 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:15.399812  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:15.405661  8344 catalog_manager.cc:1383] Generated new cluster ID: aa6c24558d33480ebbd29ca47da65ad9
I20260709 12:12:15.405954  8344 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:15.429908  8344 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:15.431177  8344 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:15.443967  8344 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081: Generated new TSK 0
I20260709 12:12:15.444590  8344 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:15.466460  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.472026  8353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.473275  8354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.474766  8356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.475214  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:15.476003  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.476219  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.476341  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599135476330 us; error 0 us; skew 500 ppm
I20260709 12:12:15.476785  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.478932  7716 webserver.cc:533] Webserver started at http://127.7.137.1:39329/ using document root <none> and password file <none>
I20260709 12:12:15.479413  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.479573  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.479797  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.480793  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.485126  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:15.488257  8361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.488969  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:15.489217  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.489449  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.500293  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.501453  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.502806  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.505107  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.505304  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.505734  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.505981  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.545675  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:36569
I20260709 12:12:15.545760  8423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:36569 every 8 connection(s)
I20260709 12:12:15.550520  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.557761  8428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.558844  8429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.561296  8431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.562068  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:15.563778  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.564013  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.564141  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599135564130 us; error 0 us; skew 500 ppm
I20260709 12:12:15.564626  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.567220  7716 webserver.cc:533] Webserver started at http://127.7.137.2:33589/ using document root <none> and password file <none>
I20260709 12:12:15.567781  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.567894  8424 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41117
I20260709 12:12:15.568039  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.568275  8424 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.568374  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.569196  8424 heartbeater.cc:507] Master 127.7.137.62:41117 requested a full tablet report, sending...
I20260709 12:12:15.569890  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "6b473635aad14f518646f7182e2d8ff5"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.571604  8297 ts_manager.cc:194] Registered new tserver with Master: 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569)
I20260709 12:12:15.573997  8297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42286
I20260709 12:12:15.575685  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:12:15.578892  8436 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.579695  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:15.579972  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "6b473635aad14f518646f7182e2d8ff5"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.580247  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.590579  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.591886  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.593256  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.595467  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.595682  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.595906  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.596072  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.634651  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:45279
I20260709 12:12:15.634766  8498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:45279 every 8 connection(s)
I20260709 12:12:15.639562  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.647325  8502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.648054  8503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.651829  7716 server_base.cc:1061] running on GCE node
W20260709 12:12:15.652287  8505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.652870  8499 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41117
I20260709 12:12:15.653204  8499 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.653265  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.653554  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.653738  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599135653721 us; error 0 us; skew 500 ppm
I20260709 12:12:15.653985  8499 heartbeater.cc:507] Master 127.7.137.62:41117 requested a full tablet report, sending...
I20260709 12:12:15.654341  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.656095  8297 ts_manager.cc:194] Registered new tserver with Master: 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:15.657013  7716 webserver.cc:533] Webserver started at http://127.7.137.3:45449/ using document root <none> and password file <none>
I20260709 12:12:15.657624  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.657867  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.657914  8297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42298
I20260709 12:12:15.658246  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.659564  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "561bfb4048b94a8899eae118937dc687"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.663761  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:12:15.666707  8510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.667503  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:15.667841  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "561bfb4048b94a8899eae118937dc687"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-9kw9"
I20260709 12:12:15.668105  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.678056  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.679195  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.680706  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.682977  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.683152  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.683451  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.683614  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.723696  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:45277
I20260709 12:12:15.723776  8572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:45277 every 8 connection(s)
I20260709 12:12:15.737476  8573 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41117
I20260709 12:12:15.737906  8573 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.738659  8573 heartbeater.cc:507] Master 127.7.137.62:41117 requested a full tablet report, sending...
I20260709 12:12:15.740645  8297 ts_manager.cc:194] Registered new tserver with Master: 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:15.741523  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014573773s
I20260709 12:12:15.742242  8297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42312
I20260709 12:12:15.768026  8297 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42328:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:15.771502  8297 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:15.849079  8387 tablet_service.cc:1511] Processing CreateTablet for tablet ac4389a0c1444cd9a16ed24b866fd660 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:15.850659  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4389a0c1444cd9a16ed24b866fd660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.850260  8388 tablet_service.cc:1511] Processing CreateTablet for tablet 1b083aa6ecfe463aa798134de3849600 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:15.851636  8388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b083aa6ecfe463aa798134de3849600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.854934  8537 tablet_service.cc:1511] Processing CreateTablet for tablet 1b083aa6ecfe463aa798134de3849600 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:15.849079  8538 tablet_service.cc:1511] Processing CreateTablet for tablet 3492e03d52034ee988079fe1033854c7 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:15.856458  8537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b083aa6ecfe463aa798134de3849600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.855186  8389 tablet_service.cc:1511] Processing CreateTablet for tablet 3492e03d52034ee988079fe1033854c7 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:15.858197  8389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3492e03d52034ee988079fe1033854c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.861423  8386 tablet_service.cc:1511] Processing CreateTablet for tablet e8527b561cd94639b23b28fef92e564b (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:15.863662  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 064fb7cabd6c4d369eabafe2a76684a5 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:15.865645  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3492e03d52034ee988079fe1033854c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.869066  8536 tablet_service.cc:1511] Processing CreateTablet for tablet ac4389a0c1444cd9a16ed24b866fd660 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:15.869832  8384 tablet_service.cc:1511] Processing CreateTablet for tablet dd07a0d34cef4c89b1f82cb9dc83f976 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:15.870579  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4389a0c1444cd9a16ed24b866fd660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.871413  8464 tablet_service.cc:1511] Processing CreateTablet for tablet 3492e03d52034ee988079fe1033854c7 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:15.872218  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 134a854fa1e745e18c9cecd8e89d3a95 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:15.872747  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3492e03d52034ee988079fe1033854c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.874507  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 134a854fa1e745e18c9cecd8e89d3a95 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:15.875877  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134a854fa1e745e18c9cecd8e89d3a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.876475  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 1b083aa6ecfe463aa798134de3849600 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:15.876979  8535 tablet_service.cc:1511] Processing CreateTablet for tablet e8527b561cd94639b23b28fef92e564b (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:15.877813  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b083aa6ecfe463aa798134de3849600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.877712  8533 tablet_service.cc:1511] Processing CreateTablet for tablet dd07a0d34cef4c89b1f82cb9dc83f976 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:15.878329  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8527b561cd94639b23b28fef92e564b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.879002  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd07a0d34cef4c89b1f82cb9dc83f976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.880451  8462 tablet_service.cc:1511] Processing CreateTablet for tablet ac4389a0c1444cd9a16ed24b866fd660 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:15.880499  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 064fb7cabd6c4d369eabafe2a76684a5 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:15.881820  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4389a0c1444cd9a16ed24b866fd660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.882040  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064fb7cabd6c4d369eabafe2a76684a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.884452  8461 tablet_service.cc:1511] Processing CreateTablet for tablet e8527b561cd94639b23b28fef92e564b (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:15.885807  8461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8527b561cd94639b23b28fef92e564b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.890043  8459 tablet_service.cc:1511] Processing CreateTablet for tablet dd07a0d34cef4c89b1f82cb9dc83f976 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:15.892709  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 064fb7cabd6c4d369eabafe2a76684a5 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:15.897850  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd07a0d34cef4c89b1f82cb9dc83f976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.901229  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064fb7cabd6c4d369eabafe2a76684a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.903623  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8527b561cd94639b23b28fef92e564b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.904294  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134a854fa1e745e18c9cecd8e89d3a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.904470  8382 tablet_service.cc:1511] Processing CreateTablet for tablet d43a67b3c01c49e6b3364fd187bfbc5a (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:15.905776  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43a67b3c01c49e6b3364fd187bfbc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.910511  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 134a854fa1e745e18c9cecd8e89d3a95 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:15.911545  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd07a0d34cef4c89b1f82cb9dc83f976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.911896  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134a854fa1e745e18c9cecd8e89d3a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.919612  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064fb7cabd6c4d369eabafe2a76684a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.921429  8457 tablet_service.cc:1511] Processing CreateTablet for tablet d43a67b3c01c49e6b3364fd187bfbc5a (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:15.922290  8531 tablet_service.cc:1511] Processing CreateTablet for tablet d43a67b3c01c49e6b3364fd187bfbc5a (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:15.922881  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43a67b3c01c49e6b3364fd187bfbc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.923694  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43a67b3c01c49e6b3364fd187bfbc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.930212  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 34649096548f4586b05d4401d407de83 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:15.931805  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34649096548f4586b05d4401d407de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.936291  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 34649096548f4586b05d4401d407de83 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:15.937695  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34649096548f4586b05d4401d407de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.951572  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 34649096548f4586b05d4401d407de83 (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:15.952955  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34649096548f4586b05d4401d407de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.957345  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 038dc417d402445eb617d8221d79317c (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:15.958866  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038dc417d402445eb617d8221d79317c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.960433  8529 tablet_service.cc:1511] Processing CreateTablet for tablet 038dc417d402445eb617d8221d79317c (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:15.961962  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038dc417d402445eb617d8221d79317c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.962028  8464 tablet_service.cc:1511] Processing CreateTablet for tablet 038dc417d402445eb617d8221d79317c (DEFAULT_TABLE table=test-workload [id=4986d14d6fb44635998fa53b696156e7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:15.970621  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038dc417d402445eb617d8221d79317c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.006861  8588 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.040789  8589 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.050278  8588 tablet_bootstrap.cc:654] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.054157  8589 tablet_bootstrap.cc:654] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.073314  8590 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.074656  8589 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.075078  8589 ts_tablet_manager.cc:1403] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.012s
I20260709 12:12:16.080849  8589 raft_consensus.cc:359] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.081427  8589 raft_consensus.cc:385] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.082239  8589 raft_consensus.cc:740] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.083159  8589 consensus_queue.cc:260] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.081252  8590 tablet_bootstrap.cc:654] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.089555  8573 heartbeater.cc:499] Master 127.7.137.62:41117 was elected leader, sending a full tablet report...
I20260709 12:12:16.091012  8588 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.091506  8588 ts_tablet_manager.cc:1403] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.000s
I20260709 12:12:16.092077  8590 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.092489  8589 ts_tablet_manager.cc:1434] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 12:12:16.092530  8590 ts_tablet_manager.cc:1403] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 12:12:16.093662  8589 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.094309  8588 raft_consensus.cc:359] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.095259  8588 raft_consensus.cc:385] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.095557  8588 raft_consensus.cc:740] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.096293  8590 raft_consensus.cc:359] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.096292  8588 consensus_queue.cc:260] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.097249  8590 raft_consensus.cc:385] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.097605  8590 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.098632  8590 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.100986  8589 tablet_bootstrap.cc:654] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.121358  8588 ts_tablet_manager.cc:1434] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.030s	user 0.013s	sys 0.015s
I20260709 12:12:16.122608  8588 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.122974  8424 heartbeater.cc:499] Master 127.7.137.62:41117 was elected leader, sending a full tablet report...
I20260709 12:12:16.123435  8499 heartbeater.cc:499] Master 127.7.137.62:41117 was elected leader, sending a full tablet report...
I20260709 12:12:16.124225  8589 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.124722  8589 ts_tablet_manager.cc:1403] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 12:12:16.127693  8589 raft_consensus.cc:359] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.128328  8589 raft_consensus.cc:385] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.128578  8589 raft_consensus.cc:740] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.129423  8588 tablet_bootstrap.cc:654] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.129220  8589 consensus_queue.cc:260] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.130831  8589 ts_tablet_manager.cc:1434] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:16.131618  8589 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.137612  8589 tablet_bootstrap.cc:654] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.140921  8590 ts_tablet_manager.cc:1434] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.014s
I20260709 12:12:16.142359  8590 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
W20260709 12:12:16.142966  8500 tablet.cc:2406] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:16.150110  8589 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.150640  8589 ts_tablet_manager.cc:1403] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:12:16.152642  8590 tablet_bootstrap.cc:654] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.153556  8588 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.153663  8589 raft_consensus.cc:359] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.154153  8588 ts_tablet_manager.cc:1403] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.009s
I20260709 12:12:16.154460  8589 raft_consensus.cc:385] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.154793  8589 raft_consensus.cc:740] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.155910  8589 consensus_queue.cc:260] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.157433  8588 raft_consensus.cc:359] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.158172  8588 raft_consensus.cc:385] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.158510  8588 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.159458  8589 ts_tablet_manager.cc:1434] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:12:16.159329  8588 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.160754  8589 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.161599  8588 ts_tablet_manager.cc:1434] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:16.162556  8588 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.168880  8588 tablet_bootstrap.cc:654] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.169739  8589 tablet_bootstrap.cc:654] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.170009  8590 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.170563  8590 ts_tablet_manager.cc:1403] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.015s
I20260709 12:12:16.173832  8590 raft_consensus.cc:359] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.174847  8590 raft_consensus.cc:385] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.175287  8590 raft_consensus.cc:740] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.176407  8590 consensus_queue.cc:260] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.179733  8590 ts_tablet_manager.cc:1434] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:16.180943  8590 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.189800  8590 tablet_bootstrap.cc:654] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.190507  8593 raft_consensus.cc:493] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.191180  8593 raft_consensus.cc:515] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.203529  8590 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.204260  8590 ts_tablet_manager.cc:1403] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.014s
I20260709 12:12:16.204517  8593 leader_election.cc:290] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.208271  8590 raft_consensus.cc:359] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.209301  8590 raft_consensus.cc:385] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.209689  8590 raft_consensus.cc:740] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.210906  8590 consensus_queue.cc:260] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.214306  8590 ts_tablet_manager.cc:1434] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:12:16.215703  8590 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.222090  8595 raft_consensus.cc:493] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.222862  8595 raft_consensus.cc:515] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.227072  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
W20260709 12:12:16.231988  8513 leader_election.cc:343] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.244311  8595 leader_election.cc:290] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.265781  8590 tablet_bootstrap.cc:654] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.274089  8590 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.274755  8590 ts_tablet_manager.cc:1403] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 12:12:16.278471  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.278415  8590 raft_consensus.cc:359] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.279367  8399 raft_consensus.cc:2468] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.279567  8590 raft_consensus.cc:385] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.280004  8590 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.280943  8511 leader_election.cc:304] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:16.282087  8593 raft_consensus.cc:2804] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.281162  8590 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.282584  8593 raft_consensus.cc:493] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.283071  8593 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.287873  8596 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.288563  8596 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.294675  8596 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.299894  8590 ts_tablet_manager.cc:1434] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.005s
I20260709 12:12:16.300985  8590 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.322897  8595 raft_consensus.cc:493] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.321872  8590 tablet_bootstrap.cc:654] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.324414  8595 raft_consensus.cc:515] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.328265  8595 leader_election.cc:290] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277), 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569)
I20260709 12:12:16.347942  8593 raft_consensus.cc:515] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.354107  8593 leader_election.cc:290] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.354630  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.355888  8548 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.354882  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.357662  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.358175  8399 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.359750  8439 leader_election.cc:304] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
W20260709 12:12:16.360736  8439 leader_election.cc:343] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.362445  8595 raft_consensus.cc:2804] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.362910  8595 raft_consensus.cc:493] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.363368  8595 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.387634  8588 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.388485  8588 ts_tablet_manager.cc:1403] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.226s	user 0.096s	sys 0.083s
W20260709 12:12:16.394588  8345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:16.398103  8399 raft_consensus.cc:2468] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.398715  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:16.399255  8589 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.399830  8589 ts_tablet_manager.cc:1403] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.239s	user 0.078s	sys 0.094s
I20260709 12:12:16.399879  8595 raft_consensus.cc:515] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.400666  8590 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
W20260709 12:12:16.400806  8513 leader_election.cc:343] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.401300  8590 ts_tablet_manager.cc:1403] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.101s	user 0.038s	sys 0.029s
I20260709 12:12:16.402901  8589 raft_consensus.cc:359] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.403944  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.404371  8589 raft_consensus.cc:385] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.404132  8511 leader_election.cc:304] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:16.404197  8590 raft_consensus.cc:359] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.404562  8547 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.404733  8589 raft_consensus.cc:740] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.405009  8590 raft_consensus.cc:385] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.405314  8590 raft_consensus.cc:740] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.405517  8593 raft_consensus.cc:2804] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.406178  8590 consensus_queue.cc:260] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.406514  8588 raft_consensus.cc:359] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.407202  8588 raft_consensus.cc:385] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.407528  8588 raft_consensus.cc:740] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.408493  8590 ts_tablet_manager.cc:1434] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:16.408346  8588 consensus_queue.cc:260] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.409386  8590 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.410856  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.413228  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.413929  8398 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.414178  8547 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.405555  8589 consensus_queue.cc:260] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.415544  8439 leader_election.cc:304] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.416481  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.417836  8437 leader_election.cc:304] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 561bfb4048b94a8899eae118937dc687
I20260709 12:12:16.419404  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.420411  8590 tablet_bootstrap.cc:654] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.422200  8595 leader_election.cc:290] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.425768  8595 raft_consensus.cc:2804] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.426282  8595 raft_consensus.cc:697] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:16.427218  8595 consensus_queue.cc:237] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
W20260709 12:12:16.425751  8364 leader_election.cc:343] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.434181  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
W20260709 12:12:16.435954  8364 leader_election.cc:343] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.436529  8364 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01; no voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:16.437695  8596 raft_consensus.cc:2749] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.438072  8590 tablet_bootstrap.cc:492] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
W20260709 12:12:16.438410  8437 leader_election.cc:343] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.438839  8590 ts_tablet_manager.cc:1403] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
W20260709 12:12:16.439342  8437 leader_election.cc:343] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.439549  8596 raft_consensus.cc:493] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.440237  8596 raft_consensus.cc:515] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.441924  8589 ts_tablet_manager.cc:1434] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 12:12:16.442003  8590 raft_consensus.cc:359] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.442909  8590 raft_consensus.cc:385] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.443199  8596 leader_election.cc:290] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.443338  8590 raft_consensus.cc:740] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.444449  8590 consensus_queue.cc:260] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.445348  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.439078  8593 raft_consensus.cc:697] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
W20260709 12:12:16.446501  8364 leader_election.cc:343] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.447639  8590 ts_tablet_manager.cc:1434] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:16.443020  8589 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.448657  8588 ts_tablet_manager.cc:1434] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 12:12:16.449712  8588 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.451299  8590 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.456130  8588 tablet_bootstrap.cc:654] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.460340  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.460842  8590 tablet_bootstrap.cc:654] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:16.465011  8364 leader_election.cc:343] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.465670  8364 leader_election.cc:304] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01; no voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:16.468326  8596 raft_consensus.cc:2749] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.463553  8589 tablet_bootstrap.cc:654] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.432260  8616 raft_consensus.cc:2804] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.469336  8593 consensus_queue.cc:237] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.469655  8295 catalog_manager.cc:5697] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.469400  8616 raft_consensus.cc:493] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.471964  8616 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.485832  8588 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.485996  8590 tablet_bootstrap.cc:492] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.486708  8588 ts_tablet_manager.cc:1403] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 12:12:16.486850  8590 ts_tablet_manager.cc:1403] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.013s
I20260709 12:12:16.490653  8590 raft_consensus.cc:359] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.491765  8590 raft_consensus.cc:385] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.492226  8590 raft_consensus.cc:740] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.492740  8589 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.493252  8589 ts_tablet_manager.cc:1403] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.019s
I20260709 12:12:16.493124  8590 consensus_queue.cc:260] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.494786  8588 raft_consensus.cc:359] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.495610  8588 raft_consensus.cc:385] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.495929  8588 raft_consensus.cc:740] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.496438  8596 raft_consensus.cc:493] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.496593  8589 raft_consensus.cc:359] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.496738  8588 consensus_queue.cc:260] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.496927  8596 raft_consensus.cc:515] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.497506  8589 raft_consensus.cc:385] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.498207  8589 raft_consensus.cc:740] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.499930  8590 ts_tablet_manager.cc:1434] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:12:16.499706  8616 raft_consensus.cc:515] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.499116  8596 leader_election.cc:290] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.500568  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.500814  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.501216  8590 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.501835  8547 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 0.
I20260709 12:12:16.499279  8589 consensus_queue.cc:260] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.501783  8474 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 0.
I20260709 12:12:16.503152  8364 leader_election.cc:304] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:16.504503  8596 raft_consensus.cc:2804] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.499284  8588 ts_tablet_manager.cc:1434] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:12:16.504863  8596 raft_consensus.cc:493] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.505268  8596 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.505537  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.506253  8589 ts_tablet_manager.cc:1434] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
W20260709 12:12:16.507061  8439 leader_election.cc:343] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.506662  8588 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.508858  8590 tablet_bootstrap.cc:654] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.509402  8589 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.509317  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.510036  8399 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.517781  8399 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.519285  8437 leader_election.cc:304] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 561bfb4048b94a8899eae118937dc687
I20260709 12:12:16.520495  8617 raft_consensus.cc:2804] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.521039  8617 raft_consensus.cc:697] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:16.521778  8588 tablet_bootstrap.cc:654] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.522049  8617 consensus_queue.cc:237] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.523129  8589 tablet_bootstrap.cc:654] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.523254  8616 leader_election.cc:290] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277), 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569)
I20260709 12:12:16.533067  8294 catalog_manager.cc:5697] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.522927  8596 raft_consensus.cc:515] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.546001  8589 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.546602  8589 ts_tablet_manager.cc:1403] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.005s
I20260709 12:12:16.547283  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.547379  8596 leader_election.cc:290] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.548009  8547 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.550788  8588 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.546394  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:16.552341  8474 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.551455  8588 ts_tablet_manager.cc:1403] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.000s
I20260709 12:12:16.556910  8590 tablet_bootstrap.cc:492] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.557375  8590 ts_tablet_manager.cc:1403] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.056s	user 0.033s	sys 0.020s
I20260709 12:12:16.557168  8589 raft_consensus.cc:359] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.557862  8589 raft_consensus.cc:385] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.558169  8588 raft_consensus.cc:359] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.559473  8588 raft_consensus.cc:385] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.559940  8588 raft_consensus.cc:740] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.559386  8593 raft_consensus.cc:493] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.558171  8589 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.560499  8590 raft_consensus.cc:359] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.560954  8593 raft_consensus.cc:515] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.561408  8590 raft_consensus.cc:385] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.561851  8590 raft_consensus.cc:740] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.561708  8589 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.563078  8588 consensus_queue.cc:260] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.563006  8590 consensus_queue.cc:260] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.564159  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.566591  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.566828  8399 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.565828  8589 ts_tablet_manager.cc:1434] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:12:16.567390  8473 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.568585  8588 ts_tablet_manager.cc:1434] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:12:16.569684  8590 ts_tablet_manager.cc:1434] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:16.569108  8513 leader_election.cc:304] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.570881  8590 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.571048  8615 raft_consensus.cc:2804] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.571502  8615 raft_consensus.cc:493] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.571843  8615 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.574873  8547 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 1.
I20260709 12:12:16.569432  8589 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.579340  8590 tablet_bootstrap.cc:654] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.579413  8364 leader_election.cc:304] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:16.580132  8596 raft_consensus.cc:493] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.570634  8588 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.580762  8596 raft_consensus.cc:515] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.575337  8593 leader_election.cc:290] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.580226  8615 raft_consensus.cc:515] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.576712  8474 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 1.
I20260709 12:12:16.583899  8596 leader_election.cc:290] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.584628  8596 raft_consensus.cc:2804] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.585244  8596 raft_consensus.cc:697] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:16.586470  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.586372  8596 consensus_queue.cc:237] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.587330  8399 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.588289  8589 tablet_bootstrap.cc:654] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.595269  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:16.595893  8474 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.599447  8615 leader_election.cc:290] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.603137  8588 tablet_bootstrap.cc:654] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.606727  8399 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.606941  8474 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.610306  8511 leader_election.cc:304] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:16.611297  8615 raft_consensus.cc:2804] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.612533  8615 raft_consensus.cc:697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:16.614524  8615 consensus_queue.cc:237] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.620265  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.623833  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
W20260709 12:12:16.626263  8364 leader_election.cc:343] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.630013  8589 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.630690  8589 ts_tablet_manager.cc:1403] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.020s
W20260709 12:12:16.631590  8364 leader_election.cc:343] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.636201  8590 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.636402  8588 tablet_bootstrap.cc:492] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.636732  8590 ts_tablet_manager.cc:1403] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.004s
I20260709 12:12:16.636852  8588 ts_tablet_manager.cc:1403] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.010s
I20260709 12:12:16.632339  8364 leader_election.cc:304] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01; no voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:16.639603  8596 raft_consensus.cc:2749] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.639721  8590 raft_consensus.cc:359] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.639955  8588 raft_consensus.cc:359] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.640554  8590 raft_consensus.cc:385] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.640883  8588 raft_consensus.cc:385] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.641224  8588 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.642210  8588 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.643643  8294 catalog_manager.cc:5697] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.654598  8590 raft_consensus.cc:740] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.655463  8590 consensus_queue.cc:260] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.657656  8590 ts_tablet_manager.cc:1434] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:16.658602  8590 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: Bootstrap starting.
I20260709 12:12:16.659756  8297 catalog_manager.cc:5697] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.644696  8588 ts_tablet_manager.cc:1434] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:12:16.647264  8589 raft_consensus.cc:359] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.662529  8589 raft_consensus.cc:385] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.662904  8589 raft_consensus.cc:740] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.664114  8588 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.664047  8589 consensus_queue.cc:260] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.666636  8589 ts_tablet_manager.cc:1434] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:12:16.667722  8589 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.669587  8590 tablet_bootstrap.cc:654] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.671023  8588 tablet_bootstrap.cc:654] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.671726  8295 catalog_manager.cc:5697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.675004  8589 tablet_bootstrap.cc:654] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.679849  8617 raft_consensus.cc:493] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.680589  8617 raft_consensus.cc:515] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.681793  8590 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: No bootstrap required, opened a new log
I20260709 12:12:16.682674  8590 ts_tablet_manager.cc:1403] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:12:16.684993  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.685935  8399 raft_consensus.cc:2468] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.687412  8590 raft_consensus.cc:359] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.688066  8590 raft_consensus.cc:385] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.688361  8588 tablet_bootstrap.cc:492] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.687958  8437 leader_election.cc:304] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.688501  8590 raft_consensus.cc:740] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.689141  8616 raft_consensus.cc:2804] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.689376  8588 ts_tablet_manager.cc:1403] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.014s
I20260709 12:12:16.689482  8616 raft_consensus.cc:493] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.689944  8616 raft_consensus.cc:3060] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.690203  8590 consensus_queue.cc:260] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.691850  8617 leader_election.cc:290] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.693099  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
W20260709 12:12:16.694621  8439 leader_election.cc:343] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.695317  8590 ts_tablet_manager.cc:1434] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:16.698189  8589 tablet_bootstrap.cc:492] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.698721  8589 ts_tablet_manager.cc:1403] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.014s
I20260709 12:12:16.701498  8589 raft_consensus.cc:359] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.702267  8589 raft_consensus.cc:385] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.702571  8589 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.703403  8589 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:16.705704  8589 ts_tablet_manager.cc:1434] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:12:16.706044  8616 raft_consensus.cc:515] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.708839  8616 leader_election.cc:290] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.706708  8589 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.710108  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.711512  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.712209  8399 raft_consensus.cc:3060] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.715138  8589 tablet_bootstrap.cc:654] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:16.711660  8439 leader_election.cc:343] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.718750  8588 raft_consensus.cc:359] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.719597  8588 raft_consensus.cc:385] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.719939  8399 raft_consensus.cc:2468] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.721320  8437 leader_election.cc:304] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 561bfb4048b94a8899eae118937dc687
I20260709 12:12:16.722159  8616 raft_consensus.cc:2804] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.719959  8588 raft_consensus.cc:740] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.722607  8589 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.722637  8616 raft_consensus.cc:697] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:16.723335  8589 ts_tablet_manager.cc:1403] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:12:16.723734  8616 consensus_queue.cc:237] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.723464  8588 consensus_queue.cc:260] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.726316  8588 ts_tablet_manager.cc:1434] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:12:16.726467  8589 raft_consensus.cc:359] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.727124  8589 raft_consensus.cc:385] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.727371  8588 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.727427  8589 raft_consensus.cc:740] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.728224  8589 consensus_queue.cc:260] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.730283  8589 ts_tablet_manager.cc:1434] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:16.731343  8589 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: Bootstrap starting.
I20260709 12:12:16.734539  8588 tablet_bootstrap.cc:654] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.737275  8589 tablet_bootstrap.cc:654] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.743849  8295 catalog_manager.cc:5697] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.746083  8588 tablet_bootstrap.cc:492] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.746878  8588 ts_tablet_manager.cc:1403] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.009s
I20260709 12:12:16.750519  8588 raft_consensus.cc:359] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.751441  8588 raft_consensus.cc:385] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.751808  8588 raft_consensus.cc:740] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.752578  8588 consensus_queue.cc:260] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.753974  8589 tablet_bootstrap.cc:492] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: No bootstrap required, opened a new log
I20260709 12:12:16.754427  8589 ts_tablet_manager.cc:1403] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 12:12:16.754563  8588 ts_tablet_manager.cc:1434] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:16.755518  8588 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.757169  8589 raft_consensus.cc:359] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.757833  8589 raft_consensus.cc:385] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.758138  8589 raft_consensus.cc:740] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.758910  8589 consensus_queue.cc:260] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.761039  8589 ts_tablet_manager.cc:1434] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:16.761751  8588 tablet_bootstrap.cc:654] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.766443  8588 tablet_bootstrap.cc:492] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.766939  8588 ts_tablet_manager.cc:1403] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:12:16.769528  8588 raft_consensus.cc:359] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.770183  8615 raft_consensus.cc:493] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.770207  8588 raft_consensus.cc:385] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.770704  8588 raft_consensus.cc:740] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.770767  8615 raft_consensus.cc:515] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.771447  8588 consensus_queue.cc:260] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.772953  8615 leader_election.cc:290] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.773681  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.774376  8399 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.774506  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.775137  8474 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.775719  8588 ts_tablet_manager.cc:1434] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:16.775794  8511 leader_election.cc:304] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:16.776108  8616 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.776602  8616 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.777110  8615 raft_consensus.cc:2804] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.777546  8615 raft_consensus.cc:493] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.777937  8615 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.778800  8616 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.780469  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.780717  8588 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: Bootstrap starting.
I20260709 12:12:16.781092  8547 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.782341  8439 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.783363  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.784050  8399 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.785745  8616 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.786115  8616 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.786644  8588 tablet_bootstrap.cc:654] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.786692  8616 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.786002  8615 raft_consensus.cc:515] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.789976  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:16.790664  8474 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.791889  8588 tablet_bootstrap.cc:492] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: No bootstrap required, opened a new log
I20260709 12:12:16.792363  8588 ts_tablet_manager.cc:1403] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:16.793895  8615 leader_election.cc:290] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.794344  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.794936  8399 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.794958  8588 raft_consensus.cc:359] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.795748  8588 raft_consensus.cc:385] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.795485  8616 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.796067  8588 raft_consensus.cc:740] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.796890  8588 consensus_queue.cc:260] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.797127  8474 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.798478  8616 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.798548  8513 leader_election.cc:304] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.799197  8588 ts_tablet_manager.cc:1434] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:16.799496  8615 raft_consensus.cc:2804] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.799973  8615 raft_consensus.cc:697] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:16.801035  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.800837  8615 consensus_queue.cc:237] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.801632  8398 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.802147  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.802699  8547 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.809022  8398 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.810258  8547 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.810494  8437 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.813850  8399 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.815303  8616 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.815941  8616 raft_consensus.cc:697] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:16.816921  8616 consensus_queue.cc:237] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.820036  8297 catalog_manager.cc:5697] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.825875  8295 catalog_manager.cc:5697] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.862458  8474 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.868389  8615 consensus_queue.cc:1048] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.876818  8615 raft_consensus.cc:493] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.877446  8615 raft_consensus.cc:515] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.879676  8616 raft_consensus.cc:493] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.880169  8616 raft_consensus.cc:515] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.881549  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.881475  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:16.882226  8399 raft_consensus.cc:2468] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.882246  8473 raft_consensus.cc:2468] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 0.
I20260709 12:12:16.883526  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687" is_pre_election: true
I20260709 12:12:16.883582  8513 leader_election.cc:304] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.884274  8547 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.884789  8613 raft_consensus.cc:2804] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.884850  8650 consensus_queue.cc:1048] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.885293  8613 raft_consensus.cc:493] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.885636  8613 raft_consensus.cc:3060] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.885855  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:16.885596  8439 leader_election.cc:304] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.886584  8399 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 0.
I20260709 12:12:16.887075  8617 raft_consensus.cc:2804] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.887217  8615 leader_election.cc:290] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.887686  8617 raft_consensus.cc:493] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.888059  8617 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.888221  8616 leader_election.cc:290] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.895515  8613 raft_consensus.cc:515] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.898592  8613 leader_election.cc:290] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:16.898691  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.898473  8617 raft_consensus.cc:515] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.899366  8399 raft_consensus.cc:3060] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.899926  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038dc417d402445eb617d8221d79317c" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:16.900508  8474 raft_consensus.cc:3060] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.901805  8617 leader_election.cc:290] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:16.901994  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:16.902562  8547 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.906100  8616 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.907883  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:16.908485  8397 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.909655  8474 raft_consensus.cc:2468] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.911373  8513 leader_election.cc:304] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.912268  8613 raft_consensus.cc:2804] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.913802  8613 raft_consensus.cc:697] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:16.914942  8613 consensus_queue.cc:237] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.924407  8396 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.931948  8399 raft_consensus.cc:2468] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 1.
I20260709 12:12:16.938683  8617 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.943001  8397 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.944577  8437 leader_election.cc:304] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:16.945716  8617 raft_consensus.cc:2804] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.946313  8617 raft_consensus.cc:697] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:16.947983  8617 consensus_queue.cc:237] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:16.952904  8547 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 1.
I20260709 12:12:16.969177  8547 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.976444  8297 catalog_manager.cc:5697] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.980374  8595 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.992810  8295 catalog_manager.cc:5697] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.009428  8617 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.011185  8596 consensus_queue.cc:1048] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.029814  8661 consensus_queue.cc:1048] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.106998  8613 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.117094  8615 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.207396  8615 raft_consensus.cc:493] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.207831  8615 raft_consensus.cc:515] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.209447  8615 leader_election.cc:290] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:17.210399  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b473635aad14f518646f7182e2d8ff5" is_pre_election: true
I20260709 12:12:17.210353  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34649096548f4586b05d4401d407de83" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" is_pre_election: true
I20260709 12:12:17.211345  8399 raft_consensus.cc:2393] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561bfb4048b94a8899eae118937dc687 in current term 1: Already voted for candidate 6b473635aad14f518646f7182e2d8ff5 in this term.
I20260709 12:12:17.212222  8511 leader_election.cc:304] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561bfb4048b94a8899eae118937dc687; no voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:17.212878  8615 raft_consensus.cc:3060] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.217257  8615 raft_consensus.cc:2749] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.266642  8474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:34214
I20260709 12:12:17.267168  8474 raft_consensus.cc:606] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:17.272405  8474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:34214
I20260709 12:12:17.272933  8474 raft_consensus.cc:606] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:17.285776  8548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:45070
I20260709 12:12:17.286309  8548 raft_consensus.cc:606] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:17.289106  8617 consensus_queue.cc:1048] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.297724  8548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:45070
I20260709 12:12:17.298331  8548 raft_consensus.cc:606] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:17.302094  8617 consensus_queue.cc:1048] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.306335  8548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
mode: GRACEFUL
new_leader_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:45070
I20260709 12:12:17.308688  8548 raft_consensus.cc:606] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Received request to transfer leadership to TS 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:17.348078  8617 consensus_queue.cc:1048] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.348290  8595 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.354558  8615 raft_consensus.cc:993] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.355063  8650 raft_consensus.cc:1081] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.357152  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56042
I20260709 12:12:17.357986  8396 raft_consensus.cc:493] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.358389  8396 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.359782  8595 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.366230  8396 raft_consensus.cc:515] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.367545  8617 raft_consensus.cc:993] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.368005  8617 raft_consensus.cc:1081] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.368600  8396 leader_election.cc:290] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:17.369925  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:17.370568  8548 raft_consensus.cc:3055] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.370903  8548 raft_consensus.cc:740] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:17.374001  8548 consensus_queue.cc:260] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.375268  8548 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.371632  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4389a0c1444cd9a16ed24b866fd660" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:17.377473  8474 raft_consensus.cc:3060] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.382583  8548 raft_consensus.cc:2468] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.384725  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:17.385308  8396 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.385311  8364 leader_election.cc:304] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:17.385926  8396 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.386356  8661 raft_consensus.cc:2804] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.386857  8661 raft_consensus.cc:697] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:17.387123  8474 raft_consensus.cc:2468] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.387889  8615 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.387801  8661 consensus_queue.cc:237] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.384287  8616 consensus_queue.cc:1048] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:17.399106  8396 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.403326  8547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:17.403939  8547 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.405429  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:17.406018  8474 raft_consensus.cc:3055] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.406337  8474 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:17.407176  8474 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.408713  8474 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.412869  8547 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.414003  8396 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:17.413950  8364 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:17.415163  8661 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.415869  8661 raft_consensus.cc:697] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:17.416517  8615 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.416850  8661 consensus_queue.cc:237] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.422333  8615 consensus_queue.cc:1048] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.422835  8474 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.423456  8650 raft_consensus.cc:993] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.432420  8650 raft_consensus.cc:1081] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.431421  8295 catalog_manager.cc:5697] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 561bfb4048b94a8899eae118937dc687 (127.7.137.3) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.435554  8295 catalog_manager.cc:5697] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.438267  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56042
I20260709 12:12:17.439121  8396 raft_consensus.cc:493] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.439734  8396 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.451500  8396 raft_consensus.cc:515] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.454196  8396 leader_election.cc:290] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:17.455447  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:17.456178  8548 raft_consensus.cc:3055] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.456611  8548 raft_consensus.cc:740] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:17.457657  8548 consensus_queue.cc:260] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.460935  8548 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.462198  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:17.467569  8548 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.470477  8595 raft_consensus.cc:993] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.471050  8595 raft_consensus.cc:1081] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:17.472239  8364 leader_election.cc:304] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:17.473883  8661 raft_consensus.cc:2804] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.474402  8661 raft_consensus.cc:697] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:17.475366  8661 consensus_queue.cc:237] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.480723  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:17.481351  8396 raft_consensus.cc:493] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.481772  8396 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.489470  8650 consensus_queue.cc:1048] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.491137  8297 catalog_manager.cc:5697] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 561bfb4048b94a8899eae118937dc687 (127.7.137.3) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.492970  8396 raft_consensus.cc:515] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:17.495869  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:17.496407  8548 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.501600  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:17.502466  8473 raft_consensus.cc:3055] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.502918  8473 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:17.504122  8473 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:17.505818  8473 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.507364  8548 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.508576  8364 leader_election.cc:304] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:17.509413  8661 raft_consensus.cc:2804] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.509902  8661 raft_consensus.cc:697] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:17.510723  8661 consensus_queue.cc:237] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:17.512163  8396 leader_election.cc:290] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:17.517772  8473 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:17.519749  8297 catalog_manager.cc:5697] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.668718  8650 raft_consensus.cc:993] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: : Instructing follower 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:17.669271  8593 raft_consensus.cc:1081] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Signalling peer 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:17.670874  8473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:34190
I20260709 12:12:17.671403  8473 raft_consensus.cc:493] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.671840  8473 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.677433  8473 raft_consensus.cc:515] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.679311  8473 leader_election.cc:290] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 2 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:17.680150  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:17.680430  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:17.680773  8396 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.681025  8548 raft_consensus.cc:3055] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.681367  8548 raft_consensus.cc:740] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:17.682276  8548 consensus_queue.cc:260] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.683657  8548 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.687321  8396 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 2.
I20260709 12:12:17.688632  8437 leader_election.cc:304] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:17.689498  8616 raft_consensus.cc:2804] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.689527  8548 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 2.
I20260709 12:12:17.690135  8616 raft_consensus.cc:697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:17.691128  8616 consensus_queue.cc:237] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:17.697552  8297 catalog_manager.cc:5697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 1 to 2, leader changed from 561bfb4048b94a8899eae118937dc687 (127.7.137.3) to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.810251  8473 raft_consensus.cc:1275] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.811568  8661 consensus_queue.cc:1048] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.821035  8548 raft_consensus.cc:1275] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.822566  8596 consensus_queue.cc:1048] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.869694  8473 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.871155  8596 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.879325  8548 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.880897  8661 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.891993  8473 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.898819  8473 raft_consensus.cc:1275] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.900233  8661 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.908711  8548 raft_consensus.cc:1275] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.910357  8631 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.952847  8473 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.954149  8631 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:17.961499  8548 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.962962  8661 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.226987  8396 raft_consensus.cc:1275] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.228206  8617 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.236442  8548 raft_consensus.cc:1275] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.238370  8616 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:20.354488  7716 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:20.355206  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:20.372077  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:20.372596  8396 raft_consensus.cc:606] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Received request to transfer leadership to TS 561bfb4048b94a8899eae118937dc687
I20260709 12:12:20.374830  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:20.375344  8396 raft_consensus.cc:606] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Received request to transfer leadership to TS 561bfb4048b94a8899eae118937dc687
I20260709 12:12:20.376341  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:20.376777  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:20.483012  8596 raft_consensus.cc:993] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:20.483501  8682 raft_consensus.cc:1081] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Signalling peer 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:20.485082  8547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:12:20.485571  8547 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.485850  8547 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.490372  8547 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:20.492175  8547 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:20.492944  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:20.493283  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:20.493530  8396 raft_consensus.cc:3055] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:20.493871  8473 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.493891  8396 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:20.494892  8396 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:20.495977  8396 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.499221  8473 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:20.500365  8513 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:20.501140  8396 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:20.501173  8593 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:20.502471  8593 raft_consensus.cc:697] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:20.503226  8593 consensus_queue.cc:237] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:20.510118  8297 catalog_manager.cc:5697] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 2 to 3, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:20.774609  8596 raft_consensus.cc:993] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:20.775148  8682 raft_consensus.cc:1081] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Signalling peer 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:20.776862  8547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:12:20.777302  8547 raft_consensus.cc:493] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.777606  8547 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.783812  8547 raft_consensus.cc:515] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:20.785674  8547 leader_election.cc:290] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:20.786407  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:20.786633  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:20.786976  8396 raft_consensus.cc:3055] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:20.787240  8473 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.787338  8396 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:20.788156  8396 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:20.789053  8396 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.792327  8473 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:20.793413  8513 leader_election.cc:304] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:20.794198  8593 raft_consensus.cc:2804] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:20.794581  8396 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:20.794693  8593 raft_consensus.cc:697] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:20.795630  8593 consensus_queue.cc:237] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:20.804454  8297 catalog_manager.cc:5697] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 2 to 3, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.957588  8473 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:20.958832  8593 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:20.967670  8396 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:20.970804  8694 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:21.334870  8396 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:21.336254  8694 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:21.344551  8473 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:21.346779  8593 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:21.377795  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.383925  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:21.384441  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:22.385625  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.391286  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:22.391665  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:23.392822  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.399492  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:23.399835  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:24.401046  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:24.407523  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:24.407913  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:25.543288  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:25.606760  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:25.608359  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:26.327072  8569 debug-util.cc:398] Leaking SignalData structure 0x7b08000abc60 after lost signal to thread 7719
W20260709 12:12:26.327993  8569 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa380 after lost signal to thread 8331
W20260709 12:12:26.328840  8569 debug-util.cc:398] Leaking SignalData structure 0x7b080017d920 after lost signal to thread 8423
W20260709 12:12:26.329572  8569 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3160 after lost signal to thread 8498
W20260709 12:12:26.330278  8569 debug-util.cc:398] Leaking SignalData structure 0x7b080005e5c0 after lost signal to thread 8572
I20260709 12:12:26.615794  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.621250  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:26.621806  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:27.622888  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.630756  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:27.631203  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.632256  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.638798  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:28.639273  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.640285  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.645715  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:29.646133  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.677809  7716 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:12:30.682664  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:45070
I20260709 12:12:30.683391  8546 raft_consensus.cc:606] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:30.688623  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:45070
I20260709 12:12:30.689128  8546 raft_consensus.cc:606] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:30.701331  8474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:34214
I20260709 12:12:30.701812  8474 raft_consensus.cc:606] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:30.708791  8474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:34214
I20260709 12:12:30.709390  8474 raft_consensus.cc:606] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:30.710346  8718 raft_consensus.cc:993] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.710989  8702 raft_consensus.cc:1081] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.712600  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:30.713142  8396 raft_consensus.cc:493] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.713539  8396 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.714309  8474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
mode: GRACEFUL
new_leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:34214
I20260709 12:12:30.714865  8474 raft_consensus.cc:606] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Received request to transfer leadership to TS 2af29b8fcdf9442ba5b118904b6d7b01
I20260709 12:12:30.720160  8396 raft_consensus.cc:515] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.722204  8396 leader_election.cc:290] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 3 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:30.722801  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:30.723156  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd07a0d34cef4c89b1f82cb9dc83f976" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:30.723573  8474 raft_consensus.cc:3055] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.723826  8546 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.723866  8474 raft_consensus.cc:740] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:30.724815  8474 consensus_queue.cc:260] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.725805  8474 raft_consensus.cc:3060] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.729200  8546 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 3.
I20260709 12:12:30.730309  8364 leader_election.cc:304] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:30.730381  8474 raft_consensus.cc:2468] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 3.
I20260709 12:12:30.731138  8708 raft_consensus.cc:2804] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.732156  8708 raft_consensus.cc:697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:30.732952  8708 consensus_queue.cc:237] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.740402  8721 raft_consensus.cc:993] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.741145  8717 raft_consensus.cc:1081] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.742687  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3492e03d52034ee988079fe1033854c7"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56042
I20260709 12:12:30.743145  8396 raft_consensus.cc:493] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.743469  8396 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.744098  8295 catalog_manager.cc:5697] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 2 to 3, leader changed from 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.748050  8396 raft_consensus.cc:515] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:30.749655  8396 leader_election.cc:290] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 4 election: Requested vote from peers 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:30.750519  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:30.750952  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3492e03d52034ee988079fe1033854c7" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:30.751268  8546 raft_consensus.cc:3055] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:30.751569  8474 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.751704  8546 raft_consensus.cc:740] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:30.752658  8546 consensus_queue.cc:260] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:30.753867  8546 raft_consensus.cc:3060] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.758131  8474 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 4.
I20260709 12:12:30.759276  8364 leader_election.cc:304] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:30.760006  8708 raft_consensus.cc:2804] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:30.760439  8708 raft_consensus.cc:697] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:30.760800  8546 raft_consensus.cc:2468] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 4.
I20260709 12:12:30.761698  8708 consensus_queue.cc:237] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } }
I20260709 12:12:30.769191  8295 catalog_manager.cc:5697] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 3 to 4, leader changed from 561bfb4048b94a8899eae118937dc687 (127.7.137.3) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.896314  8717 raft_consensus.cc:993] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.896831  8717 raft_consensus.cc:1081] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.898319  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56042
I20260709 12:12:30.898795  8396 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.899153  8396 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.903887  8396 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.905373  8396 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 4 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:30.906219  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:30.906682  8474 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.906716  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:30.907382  8548 raft_consensus.cc:3055] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:30.907708  8548 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:30.908704  8548 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.910459  8548 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.913321  8474 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 4.
I20260709 12:12:30.915028  8364 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:30.916096  8708 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:30.916766  8708 raft_consensus.cc:697] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:30.917894  8708 consensus_queue.cc:237] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.919718  8548 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 4.
I20260709 12:12:30.926139  8295 catalog_manager.cc:5697] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 3 to 4, leader changed from 561bfb4048b94a8899eae118937dc687 (127.7.137.3) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.977442  8718 raft_consensus.cc:993] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.977898  8702 raft_consensus.cc:1081] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:30.979159  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:30.979624  8396 raft_consensus.cc:493] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.979902  8396 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.984035  8396 raft_consensus.cc:515] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.985482  8396 leader_election.cc:290] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:30.986274  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:30.986588  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:30.986840  8474 raft_consensus.cc:3055] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.987126  8548 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.987138  8474 raft_consensus.cc:740] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:30.988144  8474 consensus_queue.cc:260] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:30.989312  8474 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.994055  8548 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:30.995184  8364 leader_election.cc:304] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:30.995836  8474 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:30.995975  8708 raft_consensus.cc:2804] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:30.996532  8708 raft_consensus.cc:697] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:30.997387  8708 consensus_queue.cc:237] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:31.005220  8718 raft_consensus.cc:993] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: : Instructing follower 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:31.004885  8295 catalog_manager.cc:5697] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.005738  8702 raft_consensus.cc:1081] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Signalling peer 2af29b8fcdf9442ba5b118904b6d7b01 to start an election
I20260709 12:12:31.007103  8396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:31.007642  8396 raft_consensus.cc:493] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.007930  8396 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.013548  8396 raft_consensus.cc:515] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:31.014899  8396 leader_election.cc:290] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Requested vote from peers 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:31.015704  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:31.015935  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43a67b3c01c49e6b3364fd187bfbc5a" candidate_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:31.016163  8474 raft_consensus.cc:3055] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:31.016420  8548 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.016498  8474 raft_consensus.cc:740] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:31.017238  8474 consensus_queue.cc:260] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:31.018095  8474 raft_consensus.cc:3060] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.021361  8548 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:31.022146  8474 raft_consensus.cc:2468] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2af29b8fcdf9442ba5b118904b6d7b01 in term 2.
I20260709 12:12:31.022413  8364 leader_election.cc:304] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2af29b8fcdf9442ba5b118904b6d7b01, 561bfb4048b94a8899eae118937dc687; no voters: 
I20260709 12:12:31.023224  8708 raft_consensus.cc:2804] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:31.023708  8708 raft_consensus.cc:697] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Leader. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:31.024447  8708 consensus_queue.cc:237] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:31.031589  8295 catalog_manager.cc:5697] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 reported cstate change: term changed from 1 to 2, leader changed from 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2) to 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.157522  8548 raft_consensus.cc:1275] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.158762  8708 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.169461  8474 raft_consensus.cc:1275] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.170986  8708 consensus_queue.cc:1048] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.186506  8548 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.187942  8733 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.190724  8474 raft_consensus.cc:1275] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.191998  8733 consensus_queue.cc:1048] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.383920  8548 raft_consensus.cc:1275] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.385175  8708 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.393559  8473 raft_consensus.cc:1275] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.395399  8708 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.418207  8473 raft_consensus.cc:1275] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.419445  8708 consensus_queue.cc:1048] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.427842  8548 raft_consensus.cc:1275] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.429371  8719 consensus_queue.cc:1048] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.972972  8473 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.985812  8548 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Refusing update from remote peer 2af29b8fcdf9442ba5b118904b6d7b01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.998076  8746 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:12:32.127130  8364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:45279, user_credentials={real_user=slave}} blocked reactor thread for 133961us
I20260709 12:12:32.137115  8748 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:12:32.996404  8420 debug-util.cc:398] Leaking SignalData structure 0x7b08001bde40 after lost signal to thread 7719
W20260709 12:12:32.997229  8420 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6da0 after lost signal to thread 8331
W20260709 12:12:32.998128  8420 debug-util.cc:398] Leaking SignalData structure 0x7b0800106a20 after lost signal to thread 8423
W20260709 12:12:32.998883  8420 debug-util.cc:398] Leaking SignalData structure 0x7b080017b2c0 after lost signal to thread 8498
W20260709 12:12:32.999655  8420 debug-util.cc:398] Leaking SignalData structure 0x7b08001e88a0 after lost signal to thread 8572
I20260709 12:12:34.264052  7716 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:12:34.264988  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.272852  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:34.273804  8396 raft_consensus.cc:606] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Received request to transfer leadership to TS 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:34.278451  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:34.279922  8396 raft_consensus.cc:606] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Received request to transfer leadership to TS 561bfb4048b94a8899eae118937dc687
I20260709 12:12:34.284086  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:34.284536  8396 raft_consensus.cc:606] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Received request to transfer leadership to TS 6b473635aad14f518646f7182e2d8ff5
I20260709 12:12:34.286993  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b"
dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
mode: GRACEFUL
new_leader_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:56060
I20260709 12:12:34.287492  8396 raft_consensus.cc:606] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 LEADER]: Received request to transfer leadership to TS 561bfb4048b94a8899eae118937dc687
I20260709 12:12:34.288726  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:34.289361  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:34.332455  8719 raft_consensus.cc:993] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:34.333084  8760 raft_consensus.cc:1081] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Signalling peer 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:34.334967  8474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:34200
I20260709 12:12:34.335632  8474 raft_consensus.cc:493] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.336059  8474 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.344929  8474 raft_consensus.cc:515] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.347916  8474 leader_election.cc:290] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 3 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:34.348764  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:34.349195  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064fb7cabd6c4d369eabafe2a76684a5" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:34.349704  8548 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.349685  8396 raft_consensus.cc:3055] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.350266  8396 raft_consensus.cc:740] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:34.351372  8396 consensus_queue.cc:260] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.352823  8396 raft_consensus.cc:3060] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.355444  8548 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 3.
I20260709 12:12:34.356833  8439 leader_election.cc:304] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:34.357964  8751 raft_consensus.cc:2804] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:34.359297  8751 raft_consensus.cc:697] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 3 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:34.360343  8751 consensus_queue.cc:237] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.361845  8396 raft_consensus.cc:2468] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 3.
I20260709 12:12:34.371575  8719 raft_consensus.cc:993] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:34.372144  8719 raft_consensus.cc:1081] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Signalling peer 6b473635aad14f518646f7182e2d8ff5 to start an election
I20260709 12:12:34.371902  8295 catalog_manager.cc:5697] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 2 to 3, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 3 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.373972  8474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600"
dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
 from {username='slave'} at 127.0.0.1:34200
I20260709 12:12:34.374537  8474 raft_consensus.cc:493] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.374946  8474 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.383481  8474 raft_consensus.cc:515] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.386469  8474 leader_election.cc:290] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 5 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 561bfb4048b94a8899eae118937dc687 (127.7.137.3:45277)
I20260709 12:12:34.387079  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "561bfb4048b94a8899eae118937dc687"
I20260709 12:12:34.387853  8548 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.387079  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b083aa6ecfe463aa798134de3849600" candidate_uuid: "6b473635aad14f518646f7182e2d8ff5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:34.388676  8396 raft_consensus.cc:3055] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:34.388998  8396 raft_consensus.cc:740] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:34.389871  8396 consensus_queue.cc:260] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.391580  8396 raft_consensus.cc:3060] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.393492  8548 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 5.
I20260709 12:12:34.394508  8439 leader_election.cc:304] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:34.395212  8751 raft_consensus.cc:2804] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:34.395757  8751 raft_consensus.cc:697] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 5 LEADER]: Becoming Leader. State: Replica: 6b473635aad14f518646f7182e2d8ff5, State: Running, Role: LEADER
I20260709 12:12:34.396662  8751 consensus_queue.cc:237] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.398340  8396 raft_consensus.cc:2468] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b473635aad14f518646f7182e2d8ff5 in term 5.
I20260709 12:12:34.404775  8295 catalog_manager.cc:5697] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 reported cstate change: term changed from 4 to 5, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2). New cstate: current_term: 5 leader_uuid: "6b473635aad14f518646f7182e2d8ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.437896  8760 raft_consensus.cc:993] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:34.438378  8719 raft_consensus.cc:1081] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Signalling peer 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:34.440109  8548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:12:34.440688  8548 raft_consensus.cc:493] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.440977  8548 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.445660  8548 raft_consensus.cc:515] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.447912  8548 leader_election.cc:290] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:34.448964  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:34.449196  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134a854fa1e745e18c9cecd8e89d3a95" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:34.449571  8396 raft_consensus.cc:3055] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.449684  8474 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.449994  8396 raft_consensus.cc:740] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:34.450718  8396 consensus_queue.cc:260] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.451957  8396 raft_consensus.cc:3060] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.456434  8474 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:34.457957  8513 leader_election.cc:304] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:34.458491  8396 raft_consensus.cc:2468] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 3.
I20260709 12:12:34.459129  8755 raft_consensus.cc:2804] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:34.460752  8755 raft_consensus.cc:697] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:34.461807  8755 consensus_queue.cc:237] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.470860  8295 catalog_manager.cc:5697] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 2 to 3, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.525627  8760 raft_consensus.cc:993] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: : Instructing follower 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:34.526129  8719 raft_consensus.cc:1081] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 LEADER]: Signalling peer 561bfb4048b94a8899eae118937dc687 to start an election
I20260709 12:12:34.527513  8548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b"
dest_uuid: "561bfb4048b94a8899eae118937dc687"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:12:34.528095  8548 raft_consensus.cc:493] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.528457  8548 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.535609  8548 raft_consensus.cc:515] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.537679  8548 leader_election.cc:290] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 2 election: Requested vote from peers 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569), 6b473635aad14f518646f7182e2d8ff5 (127.7.137.2:45279)
I20260709 12:12:34.538758  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b473635aad14f518646f7182e2d8ff5"
I20260709 12:12:34.539238  8474 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.539274  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8527b561cd94639b23b28fef92e564b" candidate_uuid: "561bfb4048b94a8899eae118937dc687" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2af29b8fcdf9442ba5b118904b6d7b01"
I20260709 12:12:34.539942  8396 raft_consensus.cc:3055] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:34.540246  8396 raft_consensus.cc:740] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2af29b8fcdf9442ba5b118904b6d7b01, State: Running, Role: LEADER
I20260709 12:12:34.540930  8396 consensus_queue.cc:260] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.542102  8396 raft_consensus.cc:3060] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:34.545733  8474 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 2.
I20260709 12:12:34.546805  8513 leader_election.cc:304] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561bfb4048b94a8899eae118937dc687, 6b473635aad14f518646f7182e2d8ff5; no voters: 
I20260709 12:12:34.547608  8755 raft_consensus.cc:2804] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:34.548127  8755 raft_consensus.cc:697] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 2 LEADER]: Becoming Leader. State: Replica: 561bfb4048b94a8899eae118937dc687, State: Running, Role: LEADER
I20260709 12:12:34.548574  8396 raft_consensus.cc:2468] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561bfb4048b94a8899eae118937dc687 in term 2.
I20260709 12:12:34.549057  8755 consensus_queue.cc:237] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } }
I20260709 12:12:34.557955  8295 catalog_manager.cc:5697] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 reported cstate change: term changed from 1 to 2, leader changed from 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1) to 561bfb4048b94a8899eae118937dc687 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "561bfb4048b94a8899eae118937dc687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.756340  8548 raft_consensus.cc:1275] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.757784  8751 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.778537  8396 raft_consensus.cc:1275] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.782166  8775 consensus_queue.cc:1048] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:34.895612  8547 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 5 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:34.897140  8775 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561bfb4048b94a8899eae118937dc687" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:34.907038  8396 raft_consensus.cc:1275] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 5 FOLLOWER]: Refusing update from remote peer 6b473635aad14f518646f7182e2d8ff5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:34.909296  8761 consensus_queue.cc:1048] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:34.959214  8474 raft_consensus.cc:1275] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.960529  8755 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.971873  8396 raft_consensus.cc:1275] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.974224  8755 consensus_queue.cc:1048] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:35.017935  8474 raft_consensus.cc:1275] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:35.019336  8755 consensus_queue.cc:1048] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b473635aad14f518646f7182e2d8ff5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:35.030213  8396 raft_consensus.cc:1275] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Refusing update from remote peer 561bfb4048b94a8899eae118937dc687: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:35.031945  8769 consensus_queue.cc:1048] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2af29b8fcdf9442ba5b118904b6d7b01" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:35.290555  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.296577  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.297025  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.297991  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.304255  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:36.304744  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:37.305766  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:37.311285  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:37.311764  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:38.312812  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.318493  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:38.318883  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.319711  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.324798  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:39.325176  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:40.326046  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:40.331286  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:40.331748  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.332674  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.338361  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:41.338732  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.339666  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.345039  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:42.345487  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.347059  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.356419  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:43.356913  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.390043  7716 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:12:44.390558  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
I20260709 12:12:44.423074  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.423908  7716 tablet_replica.cc:333] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.424597  7716 raft_consensus.cc:2243] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.425524  7716 raft_consensus.cc:2272] T dd07a0d34cef4c89b1f82cb9dc83f976 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.427634  7716 tablet_replica.cc:333] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.428206  7716 raft_consensus.cc:2243] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.428658  7716 raft_consensus.cc:2272] T 134a854fa1e745e18c9cecd8e89d3a95 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.430616  7716 tablet_replica.cc:333] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.431146  7716 raft_consensus.cc:2243] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.432042  7716 raft_consensus.cc:2272] T 3492e03d52034ee988079fe1033854c7 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.433882  7716 tablet_replica.cc:333] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.434449  7716 raft_consensus.cc:2243] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.435344  7716 raft_consensus.cc:2272] T d43a67b3c01c49e6b3364fd187bfbc5a P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.437253  7716 tablet_replica.cc:333] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.437745  7716 raft_consensus.cc:2243] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.438174  7716 raft_consensus.cc:2272] T 34649096548f4586b05d4401d407de83 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.440088  7716 tablet_replica.cc:333] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.440587  7716 raft_consensus.cc:2243] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.441006  7716 raft_consensus.cc:2272] T 064fb7cabd6c4d369eabafe2a76684a5 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.442972  7716 tablet_replica.cc:333] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.443526  7716 raft_consensus.cc:2243] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.443964  7716 raft_consensus.cc:2272] T 038dc417d402445eb617d8221d79317c P 2af29b8fcdf9442ba5b118904b6d7b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.445746  7716 tablet_replica.cc:333] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.446226  7716 raft_consensus.cc:2243] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.446661  7716 raft_consensus.cc:2272] T e8527b561cd94639b23b28fef92e564b P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.448256  7716 tablet_replica.cc:333] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.448712  7716 raft_consensus.cc:2243] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.449445  7716 raft_consensus.cc:2272] T ac4389a0c1444cd9a16ed24b866fd660 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.451198  7716 tablet_replica.cc:333] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01: stopping tablet replica
I20260709 12:12:44.451776  7716 raft_consensus.cc:2243] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.452275  7716 raft_consensus.cc:2272] T 1b083aa6ecfe463aa798134de3849600 P 2af29b8fcdf9442ba5b118904b6d7b01 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.453446  8437 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:12:44.457146  8437 consensus_peers.cc:597] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 -> Peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Couldn't send request to peer 2af29b8fcdf9442ba5b118904b6d7b01. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.504415  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:12:44.523398  8437 consensus_peers.cc:597] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 -> Peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Couldn't send request to peer 2af29b8fcdf9442ba5b118904b6d7b01. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:36569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.529392  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:12:44.543987  8511 consensus_peers.cc:597] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 -> Peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Couldn't send request to peer 2af29b8fcdf9442ba5b118904b6d7b01. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:36569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.558830  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.559871  7716 tablet_replica.cc:333] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.560729  7716 raft_consensus.cc:2243] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.561306  7716 raft_consensus.cc:2272] T 038dc417d402445eb617d8221d79317c P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.564152  7716 tablet_replica.cc:333] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.564677  7716 raft_consensus.cc:2243] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.565544  7716 raft_consensus.cc:2272] T 1b083aa6ecfe463aa798134de3849600 P 6b473635aad14f518646f7182e2d8ff5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.567452  7716 tablet_replica.cc:333] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.567955  7716 raft_consensus.cc:2243] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.568442  7716 raft_consensus.cc:2272] T dd07a0d34cef4c89b1f82cb9dc83f976 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.570108  7716 tablet_replica.cc:333] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.570583  7716 raft_consensus.cc:2243] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.571415  7716 raft_consensus.cc:2272] T 064fb7cabd6c4d369eabafe2a76684a5 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.573302  7716 tablet_replica.cc:333] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.573725  7716 raft_consensus.cc:2243] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.574110  7716 raft_consensus.cc:2272] T d43a67b3c01c49e6b3364fd187bfbc5a P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.575877  7716 tablet_replica.cc:333] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.576339  7716 raft_consensus.cc:2243] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.577107  7716 raft_consensus.cc:2272] T 34649096548f4586b05d4401d407de83 P 6b473635aad14f518646f7182e2d8ff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.578744  7716 tablet_replica.cc:333] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.579190  7716 raft_consensus.cc:2243] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.579602  7716 raft_consensus.cc:2272] T ac4389a0c1444cd9a16ed24b866fd660 P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.581364  7716 tablet_replica.cc:333] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.581804  7716 raft_consensus.cc:2243] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.582132  7716 raft_consensus.cc:2272] T e8527b561cd94639b23b28fef92e564b P 6b473635aad14f518646f7182e2d8ff5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.583840  7716 tablet_replica.cc:333] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.584256  7716 raft_consensus.cc:2243] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.584614  7716 raft_consensus.cc:2272] T 3492e03d52034ee988079fe1033854c7 P 6b473635aad14f518646f7182e2d8ff5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.586252  7716 tablet_replica.cc:333] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5: stopping tablet replica
I20260709 12:12:44.586635  7716 raft_consensus.cc:2243] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.587006  7716 raft_consensus.cc:2272] T 134a854fa1e745e18c9cecd8e89d3a95 P 6b473635aad14f518646f7182e2d8ff5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.618475  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
W20260709 12:12:44.619072  8511 consensus_peers.cc:597] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 -> Peer 2af29b8fcdf9442ba5b118904b6d7b01 (127.7.137.1:36569): Couldn't send request to peer 2af29b8fcdf9442ba5b118904b6d7b01. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:36569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.641654  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
I20260709 12:12:44.667856  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.668694  7716 tablet_replica.cc:333] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.669759  7716 raft_consensus.cc:2243] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.670593  7716 raft_consensus.cc:2272] T 038dc417d402445eb617d8221d79317c P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.672567  7716 tablet_replica.cc:333] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.673081  7716 raft_consensus.cc:2243] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.673451  7716 raft_consensus.cc:2272] T 3492e03d52034ee988079fe1033854c7 P 561bfb4048b94a8899eae118937dc687 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.675132  7716 tablet_replica.cc:333] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.675688  7716 raft_consensus.cc:2243] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.676098  7716 raft_consensus.cc:2272] T 1b083aa6ecfe463aa798134de3849600 P 561bfb4048b94a8899eae118937dc687 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.677861  7716 tablet_replica.cc:333] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.678316  7716 raft_consensus.cc:2243] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.678674  7716 raft_consensus.cc:2272] T ac4389a0c1444cd9a16ed24b866fd660 P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.680339  7716 tablet_replica.cc:333] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.680790  7716 raft_consensus.cc:2243] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.681501  7716 raft_consensus.cc:2272] T e8527b561cd94639b23b28fef92e564b P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.683137  7716 tablet_replica.cc:333] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.683663  7716 raft_consensus.cc:2243] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.684028  7716 raft_consensus.cc:2272] T dd07a0d34cef4c89b1f82cb9dc83f976 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.685631  7716 tablet_replica.cc:333] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.686070  7716 raft_consensus.cc:2243] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.686770  7716 raft_consensus.cc:2272] T 134a854fa1e745e18c9cecd8e89d3a95 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.688823  7716 tablet_replica.cc:333] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.689266  7716 raft_consensus.cc:2243] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.689639  7716 raft_consensus.cc:2272] T 34649096548f4586b05d4401d407de83 P 561bfb4048b94a8899eae118937dc687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.691165  7716 tablet_replica.cc:333] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.691641  7716 raft_consensus.cc:2243] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.692005  7716 raft_consensus.cc:2272] T 064fb7cabd6c4d369eabafe2a76684a5 P 561bfb4048b94a8899eae118937dc687 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.693619  7716 tablet_replica.cc:333] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687: stopping tablet replica
I20260709 12:12:44.694003  7716 raft_consensus.cc:2243] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.694358  7716 raft_consensus.cc:2272] T d43a67b3c01c49e6b3364fd187bfbc5a P 561bfb4048b94a8899eae118937dc687 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.739544  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:12:44.760043  7716 master.cc:562] Master@127.7.137.62:41117 shutting down...
I20260709 12:12:44.783377  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.783993  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.784325  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88aa42bb6b804cf38a8120a14b938081: stopping tablet replica
I20260709 12:12:44.805006  7716 master.cc:584] Master@127.7.137.62:41117 shutdown complete.
2af29b8fcdf9442ba5b118904b6d7b01  5
561bfb4048b94a8899eae118937dc687  1
6b473635aad14f518646f7182e2d8ff5  4
2af29b8fcdf9442ba5b118904b6d7b01  3
561bfb4048b94a8899eae118937dc687  3
6b473635aad14f518646f7182e2d8ff5  4
2af29b8fcdf9442ba5b118904b6d7b01  8
561bfb4048b94a8899eae118937dc687  1
6b473635aad14f518646f7182e2d8ff5  1
2af29b8fcdf9442ba5b118904b6d7b01  4
561bfb4048b94a8899eae118937dc687  3
6b473635aad14f518646f7182e2d8ff5  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29578 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:12:44.849749  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:33577
I20260709 12:12:44.850945  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.857510  8799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.857535  8801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.857715  8798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.860560  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:44.861793  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.862048  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.862273  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599164862237 us; error 0 us; skew 500 ppm
I20260709 12:12:44.862872  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.865646  7716 webserver.cc:533] Webserver started at http://127.7.137.62:35321/ using document root <none> and password file <none>
I20260709 12:12:44.866207  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.866411  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.866735  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.868088  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "a8a9637095964e1e964bf3e778be9bbd"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-9kw9"
I20260709 12:12:44.873020  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:44.876895  8806 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.877915  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:12:44.878190  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "a8a9637095964e1e964bf3e778be9bbd"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-9kw9"
I20260709 12:12:44.878448  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.893019  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.894251  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.938776  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:33577
I20260709 12:12:44.938880  8857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:33577 every 8 connection(s)
I20260709 12:12:44.942878  8858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:44.953045  8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Bootstrap starting.
I20260709 12:12:44.957751  8858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:44.962102  8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: No bootstrap required, opened a new log
I20260709 12:12:44.964340  8858 raft_consensus.cc:359] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER }
I20260709 12:12:44.964789  8858 raft_consensus.cc:385] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:44.965062  8858 raft_consensus.cc:740] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a9637095964e1e964bf3e778be9bbd, State: Initialized, Role: FOLLOWER
I20260709 12:12:44.965628  8858 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER }
I20260709 12:12:44.966102  8858 raft_consensus.cc:399] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:44.966351  8858 raft_consensus.cc:493] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:44.966605  8858 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:44.970888  8858 raft_consensus.cc:515] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER }
I20260709 12:12:44.971418  8858 leader_election.cc:304] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8a9637095964e1e964bf3e778be9bbd; no voters: 
I20260709 12:12:44.972666  8858 leader_election.cc:290] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:44.972978  8861 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:44.974346  8861 raft_consensus.cc:697] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 1 LEADER]: Becoming Leader. State: Replica: a8a9637095964e1e964bf3e778be9bbd, State: Running, Role: LEADER
I20260709 12:12:44.975095  8861 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER }
I20260709 12:12:44.975704  8858 sys_catalog.cc:565] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:44.980690  8863 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8a9637095964e1e964bf3e778be9bbd. Latest consensus state: current_term: 1 leader_uuid: "a8a9637095964e1e964bf3e778be9bbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER } }
I20260709 12:12:44.981424  8863 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.982112  8862 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8a9637095964e1e964bf3e778be9bbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a9637095964e1e964bf3e778be9bbd" member_type: VOTER } }
I20260709 12:12:44.982894  8862 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.985953  8870 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:44.993970  8870 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:44.995028  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:45.003567  8870 catalog_manager.cc:1383] Generated new cluster ID: a2a19b656f384928b144655dad90e463
I20260709 12:12:45.003870  8870 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:45.022886  8870 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:45.024271  8870 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:45.036093  8870 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Generated new TSK 0
I20260709 12:12:45.036691  8870 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:45.061697  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.068591  8879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.069936  8880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.071554  8882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.071638  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:45.072956  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:45.073199  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.073379  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599165073355 us; error 0 us; skew 500 ppm
I20260709 12:12:45.073902  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.076325  7716 webserver.cc:533] Webserver started at http://127.7.137.1:43367/ using document root <none> and password file <none>
I20260709 12:12:45.076862  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.077112  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.077430  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.078665  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "fd11e77b4be14e658672599b30d51e76"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.083465  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:12:45.087049  8887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.087911  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:45.088246  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "fd11e77b4be14e658672599b30d51e76"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.088573  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.114850  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.116278  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.117815  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.120102  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.120337  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.120579  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.120769  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.160786  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:41023
I20260709 12:12:45.160887  8949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:41023 every 8 connection(s)
I20260709 12:12:45.165781  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.173471  8954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.176458  8955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.176642  7716 server_base.cc:1061] running on GCE node
W20260709 12:12:45.178623  8957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.179684  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:45.179884  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.180084  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599165180058 us; error 0 us; skew 500 ppm
I20260709 12:12:45.180614  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.182796  7716 webserver.cc:533] Webserver started at http://127.7.137.2:44503/ using document root <none> and password file <none>
I20260709 12:12:45.183367  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.183594  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.183864  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.185060  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "2fec7bba20864beea35ba1b33132e47d"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.186794  8950 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33577
I20260709 12:12:45.187160  8950 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:45.187963  8950 heartbeater.cc:507] Master 127.7.137.62:33577 requested a full tablet report, sending...
I20260709 12:12:45.190388  8823 ts_manager.cc:194] Registered new tserver with Master: fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:12:45.190505  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:12:45.192169  8823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54642
I20260709 12:12:45.194483  8962 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.195456  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:45.195798  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "2fec7bba20864beea35ba1b33132e47d"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.196099  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.212486  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.213801  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.215446  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.217885  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.218137  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.218395  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.218590  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.260077  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:35539
I20260709 12:12:45.260176  9024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:35539 every 8 connection(s)
I20260709 12:12:45.265043  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:45.272202  9028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.274158  9029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:45.276533  9031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:45.277184  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:45.277928  9025 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33577
I20260709 12:12:45.278185  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:45.278337  9025 heartbeater.cc:461] Registering TS with master...
W20260709 12:12:45.278448  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:45.278699  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599165278679 us; error 0 us; skew 500 ppm
I20260709 12:12:45.279286  9025 heartbeater.cc:507] Master 127.7.137.62:33577 requested a full tablet report, sending...
I20260709 12:12:45.279500  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:45.281769  8823 ts_manager.cc:194] Registered new tserver with Master: 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:45.282146  7716 webserver.cc:533] Webserver started at http://127.7.137.3:33805/ using document root <none> and password file <none>
I20260709 12:12:45.282598  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:45.282747  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:45.282953  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:45.283166  8823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54654
I20260709 12:12:45.284168  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "491a1127924f43d4a369f7d09c3a68db"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.288988  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:12:45.292502  9036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.293305  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:45.293618  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "491a1127924f43d4a369f7d09c3a68db"
format_stamp: "Formatted at 2026-07-09 12:12:45 on dist-test-slave-9kw9"
I20260709 12:12:45.293918  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:45.309751  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:45.310999  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:45.312521  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:45.314762  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:45.315016  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.315296  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:45.315478  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:45.354101  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:34547
I20260709 12:12:45.354216  9098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:34547 every 8 connection(s)
I20260709 12:12:45.368011  9099 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33577
I20260709 12:12:45.368350  9099 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:45.369036  9099 heartbeater.cc:507] Master 127.7.137.62:33577 requested a full tablet report, sending...
I20260709 12:12:45.371018  8823 ts_manager.cc:194] Registered new tserver with Master: 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:45.371793  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01452823s
I20260709 12:12:45.372395  8823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54660
I20260709 12:12:45.397536  8823 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54668:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:45.403640  8823 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:45.601146  8988 tablet_service.cc:1511] Processing CreateTablet for tablet d1231588583a41de9b59e17189e8545b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.601966  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 4be7ce502f794156a9be9d258ca1e04f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.602727  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1231588583a41de9b59e17189e8545b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.603358  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 4be7ce502f794156a9be9d258ca1e04f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.604749  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be7ce502f794156a9be9d258ca1e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.604452  8915 tablet_service.cc:1511] Processing CreateTablet for tablet ae12ea4362164b50bece754b6f6bd834 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.604483  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 1681ffac65ee495d8dd8530b021d3307 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.604893  8987 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd74f835814289a7dddc3be9b40dbf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.605867  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12ea4362164b50bece754b6f6bd834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.606495  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681ffac65ee495d8dd8530b021d3307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.606853  8913 tablet_service.cc:1511] Processing CreateTablet for tablet d1231588583a41de9b59e17189e8545b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.608167  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1231588583a41de9b59e17189e8545b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.607970  8990 tablet_service.cc:1511] Processing CreateTablet for tablet ae12ea4362164b50bece754b6f6bd834 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.609164  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be7ce502f794156a9be9d258ca1e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.608855  8986 tablet_service.cc:1511] Processing CreateTablet for tablet 1681ffac65ee495d8dd8530b021d3307 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.610208  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681ffac65ee495d8dd8530b021d3307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.611564  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12ea4362164b50bece754b6f6bd834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.612550  8912 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd74f835814289a7dddc3be9b40dbf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.613909  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd74f835814289a7dddc3be9b40dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.615568  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd74f835814289a7dddc3be9b40dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.628171  8910 tablet_service.cc:1511] Processing CreateTablet for tablet f56979e1608d4fcc873d5537e8345d33 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.629662  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56979e1608d4fcc873d5537e8345d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.630291  8985 tablet_service.cc:1511] Processing CreateTablet for tablet f56979e1608d4fcc873d5537e8345d33 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.631747  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56979e1608d4fcc873d5537e8345d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.650872  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 3f04df98e77b4f7a85750662c7bcaf22 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.652359  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f04df98e77b4f7a85750662c7bcaf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.656358  8984 tablet_service.cc:1511] Processing CreateTablet for tablet 3f04df98e77b4f7a85750662c7bcaf22 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.657889  8984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f04df98e77b4f7a85750662c7bcaf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.667059  9064 tablet_service.cc:1511] Processing CreateTablet for tablet ae12ea4362164b50bece754b6f6bd834 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.668480  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12ea4362164b50bece754b6f6bd834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.672478  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 4be7ce502f794156a9be9d258ca1e04f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.673923  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be7ce502f794156a9be9d258ca1e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.675427  8915 tablet_service.cc:1511] Processing CreateTablet for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.676753  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.676967  8986 tablet_service.cc:1511] Processing CreateTablet for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.678153  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 1681ffac65ee495d8dd8530b021d3307 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.678834  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.680678  9062 tablet_service.cc:1511] Processing CreateTablet for tablet d1231588583a41de9b59e17189e8545b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.683039  9059 tablet_service.cc:1511] Processing CreateTablet for tablet f56979e1608d4fcc873d5537e8345d33 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.676404  9061 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbd74f835814289a7dddc3be9b40dbf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.684538  9115 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:45.685206  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681ffac65ee495d8dd8530b021d3307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.690053  8985 tablet_service.cc:1511] Processing CreateTablet for tablet 9093f0f82b7942b39a479d2142fc6b1f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.691392  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9093f0f82b7942b39a479d2142fc6b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.691659  9061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd74f835814289a7dddc3be9b40dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.695751  9114 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:45.697353  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 3f04df98e77b4f7a85750662c7bcaf22 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.698663  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f04df98e77b4f7a85750662c7bcaf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.700525  9057 tablet_service.cc:1511] Processing CreateTablet for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.701839  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.702268  9114 tablet_bootstrap.cc:654] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.704303  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56979e1608d4fcc873d5537e8345d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.705015  9056 tablet_service.cc:1511] Processing CreateTablet for tablet 9093f0f82b7942b39a479d2142fc6b1f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.706387  9056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9093f0f82b7942b39a479d2142fc6b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.706387  8986 tablet_service.cc:1511] Processing CreateTablet for tablet b9be656547ea464996d40fcd3eb6a653 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.707785  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be656547ea464996d40fcd3eb6a653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.708429  8908 tablet_service.cc:1511] Processing CreateTablet for tablet b9be656547ea464996d40fcd3eb6a653 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.710088  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be656547ea464996d40fcd3eb6a653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.714952  9115 tablet_bootstrap.cc:654] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.715595  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1231588583a41de9b59e17189e8545b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.721772  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 1d515be0508e478dbeaa4e7bf253d48d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.723317  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d515be0508e478dbeaa4e7bf253d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.724279  8984 tablet_service.cc:1511] Processing CreateTablet for tablet 1d515be0508e478dbeaa4e7bf253d48d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.725020  9055 tablet_service.cc:1511] Processing CreateTablet for tablet b9be656547ea464996d40fcd3eb6a653 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.725592  8984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d515be0508e478dbeaa4e7bf253d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.726400  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be656547ea464996d40fcd3eb6a653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.727978  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 9093f0f82b7942b39a479d2142fc6b1f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.729261  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9093f0f82b7942b39a479d2142fc6b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.734704  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 123584ad57374d41b689f4592fe92d4d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.736569  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123584ad57374d41b689f4592fe92d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.735596  8987 tablet_service.cc:1511] Processing CreateTablet for tablet 123584ad57374d41b689f4592fe92d4d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.740377  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123584ad57374d41b689f4592fe92d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.746371  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee1ce8134fc4f7e9ce1860cf467105b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.747838  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee1ce8134fc4f7e9ce1860cf467105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.764971  8912 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee1ce8134fc4f7e9ce1860cf467105b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.766358  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee1ce8134fc4f7e9ce1860cf467105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.779389  8910 tablet_service.cc:1511] Processing CreateTablet for tablet cca28c4486a64eceb7e839d2891ef357 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.784294  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca28c4486a64eceb7e839d2891ef357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.785813  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 1d515be0508e478dbeaa4e7bf253d48d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.787176  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d515be0508e478dbeaa4e7bf253d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.796156  8989 tablet_service.cc:1511] Processing CreateTablet for tablet cca28c4486a64eceb7e839d2891ef357 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.797608  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca28c4486a64eceb7e839d2891ef357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.801541  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 284fe781057a4484a4910b55152f99af (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.803422  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284fe781057a4484a4910b55152f99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.815533  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 123584ad57374d41b689f4592fe92d4d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.816946  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123584ad57374d41b689f4592fe92d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.817322  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 284fe781057a4484a4910b55152f99af (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.818559  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284fe781057a4484a4910b55152f99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.819679  9062 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee1ce8134fc4f7e9ce1860cf467105b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.820922  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee1ce8134fc4f7e9ce1860cf467105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.820806  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 6e90ec1fa86446378a1fdff46884228e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.822088  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e90ec1fa86446378a1fdff46884228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.830749  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 6e90ec1fa86446378a1fdff46884228e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.832186  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e90ec1fa86446378a1fdff46884228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.838608  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 747c26453321457087376c5a57b2b7bb (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.839990  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747c26453321457087376c5a57b2b7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.850749  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 747c26453321457087376c5a57b2b7bb (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.852259  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747c26453321457087376c5a57b2b7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.858043  9115 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:45.858584  9115 ts_tablet_manager.cc:1403] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.016s
I20260709 12:12:45.859580  9057 tablet_service.cc:1511] Processing CreateTablet for tablet cca28c4486a64eceb7e839d2891ef357 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.860936  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca28c4486a64eceb7e839d2891ef357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.861518  9115 raft_consensus.cc:359] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:45.862257  9115 raft_consensus.cc:385] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.862546  9115 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.863687  9115 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:45.872378  9059 tablet_service.cc:1511] Processing CreateTablet for tablet 6e90ec1fa86446378a1fdff46884228e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.878417  9025 heartbeater.cc:499] Master 127.7.137.62:33577 was elected leader, sending a full tablet report...
I20260709 12:12:45.878648  9062 tablet_service.cc:1511] Processing CreateTablet for tablet 284fe781057a4484a4910b55152f99af (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.886901  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e90ec1fa86446378a1fdff46884228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.906229  9115 ts_tablet_manager.cc:1434] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.007s
I20260709 12:12:45.907380  9115 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:45.910676  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 5dde2f9282d04104a95b6e08dc322ad4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.912000  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dde2f9282d04104a95b6e08dc322ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.912744  8985 tablet_service.cc:1511] Processing CreateTablet for tablet 5dde2f9282d04104a95b6e08dc322ad4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.913792  9115 tablet_bootstrap.cc:654] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.914011  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dde2f9282d04104a95b6e08dc322ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.921555  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 5dde2f9282d04104a95b6e08dc322ad4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.922092  8906 tablet_service.cc:1511] Processing CreateTablet for tablet ea78b632dcc844fabe1d6e7b6012f9ff (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.922885  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dde2f9282d04104a95b6e08dc322ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.923856  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea78b632dcc844fabe1d6e7b6012f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.934671  8988 tablet_service.cc:1511] Processing CreateTablet for tablet ea78b632dcc844fabe1d6e7b6012f9ff (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.936086  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea78b632dcc844fabe1d6e7b6012f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.935776  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 747c26453321457087376c5a57b2b7bb (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.936421  9060 tablet_service.cc:1511] Processing CreateTablet for tablet ea78b632dcc844fabe1d6e7b6012f9ff (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.944839  9114 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:45.945443  9114 ts_tablet_manager.cc:1403] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.250s	user 0.026s	sys 0.031s
I20260709 12:12:45.949012  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea78b632dcc844fabe1d6e7b6012f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.957293  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284fe781057a4484a4910b55152f99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.958986  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 023d28c087e64377a9e2790180949da6 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.960345  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023d28c087e64377a9e2790180949da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.967522  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747c26453321457087376c5a57b2b7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.968402  9055 tablet_service.cc:1511] Processing CreateTablet for tablet 023d28c087e64377a9e2790180949da6 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.969736  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023d28c087e64377a9e2790180949da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.977808  9114 raft_consensus.cc:359] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:45.978713  9114 raft_consensus.cc:385] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.978969  9114 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.981144  9114 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:45.986737  8913 tablet_service.cc:1511] Processing CreateTablet for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 12:12:45.987965  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:45.988121  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.988504  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 023d28c087e64377a9e2790180949da6 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.989791  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023d28c087e64377a9e2790180949da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.996696  9115 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:45.997232  9115 ts_tablet_manager.cc:1403] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.003s
I20260709 12:12:45.998606  8982 tablet_service.cc:1511] Processing CreateTablet for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:45.999923  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.000396  9115 raft_consensus.cc:359] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.001425  9115 raft_consensus.cc:385] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.001792  9115 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.003320  9115 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.005537  9115 ts_tablet_manager.cc:1434] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:46.007644  9115 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:46.013886  9115 tablet_bootstrap.cc:654] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.025460  9058 tablet_service.cc:1511] Processing CreateTablet for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:46.026813  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.037333  9119 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:46.043805  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 64324fda988042f2a6200271577d02a9 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.046736  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 64324fda988042f2a6200271577d02a9 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.046890  9059 tablet_service.cc:1511] Processing CreateTablet for tablet 64324fda988042f2a6200271577d02a9 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:46.048130  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64324fda988042f2a6200271577d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.049391  8906 tablet_service.cc:1511] Processing CreateTablet for tablet e24627c251054d5eb5c50b970605e2b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.048220  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64324fda988042f2a6200271577d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.054399  9118 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.055078  9118 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.056713  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64324fda988042f2a6200271577d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.057406  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24627c251054d5eb5c50b970605e2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.099658  8983 tablet_service.cc:1511] Processing CreateTablet for tablet e24627c251054d5eb5c50b970605e2b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.100405  9119 tablet_bootstrap.cc:654] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.101107  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24627c251054d5eb5c50b970605e2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.100754  9064 tablet_service.cc:1511] Processing CreateTablet for tablet e24627c251054d5eb5c50b970605e2b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:46.102032  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24627c251054d5eb5c50b970605e2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.108304  9115 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:46.108932  9115 ts_tablet_manager.cc:1403] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.012s
I20260709 12:12:46.112270  8950 heartbeater.cc:499] Master 127.7.137.62:33577 was elected leader, sending a full tablet report...
I20260709 12:12:46.113526  9115 raft_consensus.cc:359] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.115389  9115 raft_consensus.cc:385] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.120101  9057 tablet_service.cc:1511] Processing CreateTablet for tablet c47609ef9e5d4514945afe81e24e790d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.120204  8985 tablet_service.cc:1511] Processing CreateTablet for tablet c47609ef9e5d4514945afe81e24e790d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.124172  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47609ef9e5d4514945afe81e24e790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.125602  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2c8c51a5344057978683f2249e4fab (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:46.127058  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c8c51a5344057978683f2249e4fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.127506  9114 ts_tablet_manager.cc:1434] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.182s	user 0.015s	sys 0.003s
I20260709 12:12:46.128482  9114 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:46.129567  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47609ef9e5d4514945afe81e24e790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.128126  8908 tablet_service.cc:1511] Processing CreateTablet for tablet c47609ef9e5d4514945afe81e24e790d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:46.140110  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47609ef9e5d4514945afe81e24e790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.149704  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2c8c51a5344057978683f2249e4fab (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:46.151089  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c8c51a5344057978683f2249e4fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.134363  9115 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.158617  9115 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.144464  9118 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:46.168298  8951 tablet.cc:2406] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:46.174575  8910 tablet_service.cc:1511] Processing CreateTablet for tablet a4285e23e73840659806e00d6213792a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.175891  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2c8c51a5344057978683f2249e4fab (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:46.176462  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4285e23e73840659806e00d6213792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.177188  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2c8c51a5344057978683f2249e4fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.189142  8986 tablet_service.cc:1511] Processing CreateTablet for tablet a4285e23e73840659806e00d6213792a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.190164  9114 tablet_bootstrap.cc:654] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.190629  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4285e23e73840659806e00d6213792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.191776  9059 tablet_service.cc:1511] Processing CreateTablet for tablet a4285e23e73840659806e00d6213792a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:46.193099  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4285e23e73840659806e00d6213792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.196457  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:46.199842  8966 leader_election.cc:343] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.207494  9119 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:46.208087  9119 ts_tablet_manager.cc:1403] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.010s
I20260709 12:12:46.220623  9115 ts_tablet_manager.cc:1434] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.111s	user 0.022s	sys 0.015s
I20260709 12:12:46.220223  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 0daf2fc07a0041229724f51fb6f5fc01 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.221729  9115 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:46.221807  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daf2fc07a0041229724f51fb6f5fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.221446  9119 raft_consensus.cc:359] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.226104  9119 raft_consensus.cc:385] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.226531  9119 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.227921  9119 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.237290  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:46.236233  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 0daf2fc07a0041229724f51fb6f5fc01 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.241865  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 0daf2fc07a0041229724f51fb6f5fc01 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:46.243619  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daf2fc07a0041229724f51fb6f5fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.244211  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 447f05dcf4904c71bfa27d72667dc990 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.246294  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f05dcf4904c71bfa27d72667dc990. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.240622  8964 leader_election.cc:343] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.255652  8964 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:46.257311  9126 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.259586  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daf2fc07a0041229724f51fb6f5fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.263254  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 447f05dcf4904c71bfa27d72667dc990 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.264617  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f05dcf4904c71bfa27d72667dc990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.265734  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 447f05dcf4904c71bfa27d72667dc990 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:46.268824  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f05dcf4904c71bfa27d72667dc990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.281644  9119 ts_tablet_manager.cc:1434] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.004s
I20260709 12:12:46.282601  9099 heartbeater.cc:499] Master 127.7.137.62:33577 was elected leader, sending a full tablet report...
I20260709 12:12:46.286885  9115 tablet_bootstrap.cc:654] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.282694  9114 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:46.293661  9119 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:46.294462  9114 ts_tablet_manager.cc:1403] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.042s
I20260709 12:12:46.301160  9126 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.301669  9126 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.303829  9126 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.305544  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:46.307163  8964 leader_election.cc:343] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.305378  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:46.310128  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.311493  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.314029  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.307624  9114 raft_consensus.cc:359] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.315332  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.315217  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfeb6de89004568abc3f47eb68ee5bf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.316593  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfeb6de89004568abc3f47eb68ee5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.318306  9115 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:46.318786  9115 ts_tablet_manager.cc:1403] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.015s
I20260709 12:12:46.321741  9115 raft_consensus.cc:359] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.322436  9115 raft_consensus.cc:385] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.322710  9115 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.315603  9114 raft_consensus.cc:385] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.323437  9114 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.324201  9114 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.325202  8925 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:46.325877  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:46.327315  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.328773  8966 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:46.329993  9126 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.330356  9126 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.330701  9126 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.331749  9114 ts_tablet_manager.cc:1434] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:12:46.332727  9114 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:46.340889  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 9e996a3dae284298bc7fecf1e8fdc675 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.342250  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e996a3dae284298bc7fecf1e8fdc675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.343614  9126 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.344305  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfeb6de89004568abc3f47eb68ee5bf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.345611  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfeb6de89004568abc3f47eb68ee5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.347673  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:46.347546  9115 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.348335  8925 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.349905  9115 ts_tablet_manager.cc:1434] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:12:46.358884  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:46.360339  8964 leader_election.cc:343] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.360410  8925 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:46.361596  8966 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:46.362464  9118 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.360562  9115 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:46.364682  8986 tablet_service.cc:1511] Processing CreateTablet for tablet 9e996a3dae284298bc7fecf1e8fdc675 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.366026  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e996a3dae284298bc7fecf1e8fdc675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.366842  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 9e996a3dae284298bc7fecf1e8fdc675 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.370519  9126 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.373025  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 6c56340353dd41d9a99bb2e22fe8c536 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.373495  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e996a3dae284298bc7fecf1e8fdc675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.374372  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c56340353dd41d9a99bb2e22fe8c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.374660  9119 tablet_bootstrap.cc:654] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.373034  9059 tablet_service.cc:1511] Processing CreateTablet for tablet 6c56340353dd41d9a99bb2e22fe8c536 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.377526  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c56340353dd41d9a99bb2e22fe8c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.370823  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 6c56340353dd41d9a99bb2e22fe8c536 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.380012  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c56340353dd41d9a99bb2e22fe8c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.380437  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfeb6de89004568abc3f47eb68ee5bf (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.381711  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfeb6de89004568abc3f47eb68ee5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.370829  9115 tablet_bootstrap.cc:654] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.389690  8913 tablet_service.cc:1511] Processing CreateTablet for tablet b6874650616d4242a2b161a9a22a07ad (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.392020  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6874650616d4242a2b161a9a22a07ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.397920  9114 tablet_bootstrap.cc:654] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.400552  9119 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:46.401069  9119 ts_tablet_manager.cc:1403] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 12:12:46.405191  9119 raft_consensus.cc:359] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.406224  9119 raft_consensus.cc:385] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.406531  9119 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.407439  9058 tablet_service.cc:1511] Processing CreateTablet for tablet b6874650616d4242a2b161a9a22a07ad (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.408196  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 703a24767eb84ead9befa5c1beff0063 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.408340  8982 tablet_service.cc:1511] Processing CreateTablet for tablet b6874650616d4242a2b161a9a22a07ad (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.408895  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6874650616d4242a2b161a9a22a07ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.409530  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a24767eb84ead9befa5c1beff0063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.412483  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6874650616d4242a2b161a9a22a07ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.412442  9119 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.410741  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 703a24767eb84ead9befa5c1beff0063 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.416347  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a24767eb84ead9befa5c1beff0063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.421627  9126 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.422299  9126 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.425513  9128 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.426021  9128 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.429808  9121 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.430409  9121 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.451997  9119 ts_tablet_manager.cc:1434] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.003s
I20260709 12:12:46.475891  9119 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:46.478272  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:46.479084  8925 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:46.480273  8966 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:46.480317  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:46.482647  8964 leader_election.cc:343] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.487372  9126 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.487920  9126 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.488433  9115 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:46.488178  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 13d273c2182c4f4d86d85935b864463c (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.488955  9115 ts_tablet_manager.cc:1403] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.008s
I20260709 12:12:46.489557  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d273c2182c4f4d86d85935b864463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.490433  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 703a24767eb84ead9befa5c1beff0063 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.491763  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a24767eb84ead9befa5c1beff0063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.507011  9114 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:46.507599  9114 ts_tablet_manager.cc:1403] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.175s	user 0.007s	sys 0.022s
I20260709 12:12:46.513614  9128 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:46.525066  9114 raft_consensus.cc:359] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.526305  9114 raft_consensus.cc:385] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.526638  9114 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.532498  9114 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.488379  9126 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.544416  9130 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.544977  9130 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.545397  9130 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.547350  9118 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:46.548365  9118 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.540407  9121 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.556437  9130 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.558746  9130 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.561836  9115 raft_consensus.cc:359] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.562841  9115 raft_consensus.cc:385] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.566891  9119 tablet_bootstrap.cc:654] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.563206  9115 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.581410  9115 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.577075  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 13d273c2182c4f4d86d85935b864463c (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.583205  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d273c2182c4f4d86d85935b864463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.583730  9115 ts_tablet_manager.cc:1434] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.006s
I20260709 12:12:46.584770  9115 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:46.596856  9064 tablet_service.cc:1511] Processing CreateTablet for tablet f24528c4e0f24715985149f6366da832 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.598269  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24528c4e0f24715985149f6366da832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.602151  9115 tablet_bootstrap.cc:654] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:46.574785  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 94612.4us
I20260709 12:12:46.603946  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:46.605542  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:46.616133  9055 tablet_service.cc:1511] Processing CreateTablet for tablet e5bea2f56e504744b5355171d4aae5f3 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.617545  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bea2f56e504744b5355171d4aae5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.619513  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 422d007cdc2c44f4b486ca22b87c8dd8 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.620105  9056 tablet_service.cc:1511] Processing CreateTablet for tablet 8552a23b53d0499abefc4f4a5af10c93 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.620820  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422d007cdc2c44f4b486ca22b87c8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.623219  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:46.623382  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b85fd0864fe18832be4b2550889d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.623873  8925 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.624660  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b85fd0864fe18832be4b2550889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.624364  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 4febe4c7f30f402a93c27138f2b4c778 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.625620  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4febe4c7f30f402a93c27138f2b4c778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.626497  8909 tablet_service.cc:1511] Processing CreateTablet for tablet db8cdabd573f46e28a22e367d9de5201 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.627830  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8cdabd573f46e28a22e367d9de5201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.628080  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9e57d64a28430bb24c6a130105d58e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:46.629307  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9e57d64a28430bb24c6a130105d58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.632233  8986 tablet_service.cc:1511] Processing CreateTablet for tablet 13d273c2182c4f4d86d85935b864463c (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.632926  8989 tablet_service.cc:1511] Processing CreateTablet for tablet f24528c4e0f24715985149f6366da832 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.633554  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d273c2182c4f4d86d85935b864463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.633287  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 8552a23b53d0499abefc4f4a5af10c93 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.634238  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24528c4e0f24715985149f6366da832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.634560  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8552a23b53d0499abefc4f4a5af10c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.608861  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:46.635495  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b85fd0864fe18832be4b2550889d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.636291  9134 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.636689  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b85fd0864fe18832be4b2550889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.636754  8911 tablet_service.cc:1511] Processing CreateTablet for tablet e5bea2f56e504744b5355171d4aae5f3 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.636788  9134 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.638159  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bea2f56e504744b5355171d4aae5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.639482  9134 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.632251  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 422d007cdc2c44f4b486ca22b87c8dd8 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.640523  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422d007cdc2c44f4b486ca22b87c8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.626574  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9e57d64a28430bb24c6a130105d58e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:12:46.640983  9037 leader_election.cc:343] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.641520  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9e57d64a28430bb24c6a130105d58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.644448  8912 tablet_service.cc:1511] Processing CreateTablet for tablet 8e25b484158d4e599cd55c7f9a740e11 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.645717  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e25b484158d4e599cd55c7f9a740e11. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.646658  8964 leader_election.cc:343] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.648141  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:46.649675  8964 leader_election.cc:343] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:46.650416  8964 leader_election.cc:343] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.652037  8988 tablet_service.cc:1511] Processing CreateTablet for tablet e5bea2f56e504744b5355171d4aae5f3 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.653398  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bea2f56e504744b5355171d4aae5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.656785  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 30cab06a8b964cdc84cf62efa5868208 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.658125  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cab06a8b964cdc84cf62efa5868208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.666860  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 4febe4c7f30f402a93c27138f2b4c778 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.668241  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4febe4c7f30f402a93c27138f2b4c778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.671485  9056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8552a23b53d0499abefc4f4a5af10c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.672230  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:46.674579  8925 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
W20260709 12:12:46.675694  8807 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53885us
I20260709 12:12:46.679963  8821 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.607538  9126 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:46.685602  9058 tablet_service.cc:1511] Processing CreateTablet for tablet db8cdabd573f46e28a22e367d9de5201 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.686609  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8cdabd573f46e28a22e367d9de5201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.625643  9059 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b85fd0864fe18832be4b2550889d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.692423  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b85fd0864fe18832be4b2550889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.692131  9062 tablet_service.cc:1511] Processing CreateTablet for tablet 8e25b484158d4e599cd55c7f9a740e11 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.697119  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e25b484158d4e599cd55c7f9a740e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.699535  8906 tablet_service.cc:1511] Processing CreateTablet for tablet f24528c4e0f24715985149f6366da832 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.700841  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24528c4e0f24715985149f6366da832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.700691  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 4febe4c7f30f402a93c27138f2b4c778 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.706291  8989 tablet_service.cc:1511] Processing CreateTablet for tablet db8cdabd573f46e28a22e367d9de5201 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.707221  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9e57d64a28430bb24c6a130105d58e (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:46.707710  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8cdabd573f46e28a22e367d9de5201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.708221  8985 tablet_service.cc:1511] Processing CreateTablet for tablet 422d007cdc2c44f4b486ca22b87c8dd8 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.708860  8984 tablet_service.cc:1511] Processing CreateTablet for tablet 8e25b484158d4e599cd55c7f9a740e11 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.709476  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422d007cdc2c44f4b486ca22b87c8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.710078  8984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e25b484158d4e599cd55c7f9a740e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.712265  8987 tablet_service.cc:1511] Processing CreateTablet for tablet 8552a23b53d0499abefc4f4a5af10c93 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.713542  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8552a23b53d0499abefc4f4a5af10c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.715571  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9e57d64a28430bb24c6a130105d58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.720786  8981 tablet_service.cc:1511] Processing CreateTablet for tablet 30cab06a8b964cdc84cf62efa5868208 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.729301  8981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cab06a8b964cdc84cf62efa5868208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.731657  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4febe4c7f30f402a93c27138f2b4c778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.740898  9114 ts_tablet_manager.cc:1434] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.233s	user 0.007s	sys 0.007s
I20260709 12:12:46.742367  9114 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:46.772115  8912 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d6970fddb4442a12d0adcf1a1980b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.773572  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d6970fddb4442a12d0adcf1a1980b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.785753  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d6970fddb4442a12d0adcf1a1980b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.786454  9119 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:46.786974  9119 ts_tablet_manager.cc:1403] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.321s	user 0.013s	sys 0.006s
I20260709 12:12:46.787086  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d6970fddb4442a12d0adcf1a1980b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.791885  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:46.793489  8889 leader_election.cc:343] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.794687  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:46.795035  8966 leader_election.cc:343] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.795522  8925 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:46.797317  9119 raft_consensus.cc:359] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.798205  9119 raft_consensus.cc:385] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.798511  9119 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.799450  9119 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.803083  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 566f7a1027e341e88b14a77db605c154 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.804621  9119 ts_tablet_manager.cc:1434] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 12:12:46.805801  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566f7a1027e341e88b14a77db605c154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.809845  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 4eae6c679d7f4d4a9422d66f842d1d7d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.811635  9119 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:46.811128  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eae6c679d7f4d4a9422d66f842d1d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.834728  9115 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:46.835317  9115 ts_tablet_manager.cc:1403] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.006s
I20260709 12:12:46.795585  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:46.843849  9126 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.850457  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 996aff69fd874168bec179a4292ac2e2 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:46.850979  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 566f7a1027e341e88b14a77db605c154 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.852595  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566f7a1027e341e88b14a77db605c154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.854825  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba05ad5deb4210a163e266631b3e67 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:46.856619  9114 tablet_bootstrap.cc:654] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.857213  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba05ad5deb4210a163e266631b3e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.860196  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.861572  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.862422  9128 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.862920  9128 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.865100  9128 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:46.865394  9115 raft_consensus.cc:359] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.866158  9115 raft_consensus.cc:385] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.866467  9115 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.866888  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:46.868468  9037 leader_election.cc:343] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.869937  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:46.872689  8808 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50570.1us
I20260709 12:12:46.875077  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d6970fddb4442a12d0adcf1a1980b (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.878961  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d6970fddb4442a12d0adcf1a1980b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.879693  8909 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.881253  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.881960  9119 tablet_bootstrap.cc:654] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.882823  9056 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.884299  9056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.886788  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 91796.8us
I20260709 12:12:46.887668  8966 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:46.888573  9126 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.889228  9126 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:46.889521  8986 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.890867  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.890714  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 566f7a1027e341e88b14a77db605c154 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.892264  9060 tablet_service.cc:1511] Processing CreateTablet for tablet 996aff69fd874168bec179a4292ac2e2 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:46.892881  9115 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.890308  9126 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.895717  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996aff69fd874168bec179a4292ac2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.889516  9055 tablet_service.cc:1511] Processing CreateTablet for tablet 4eae6c679d7f4d4a9422d66f842d1d7d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.900372  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 3f07e4a3742b455d9d586fda2b111e62 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:46.902070  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f07e4a3742b455d9d586fda2b111e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.919169  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 30cab06a8b964cdc84cf62efa5868208 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.932289  9115 ts_tablet_manager.cc:1434] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.003s
I20260709 12:12:46.933411  9115 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
W20260709 12:12:46.935371  8808 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61634.1us
I20260709 12:12:46.937465  8987 tablet_service.cc:1511] Processing CreateTablet for tablet 4eae6c679d7f4d4a9422d66f842d1d7d (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.949406  9114 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:46.950022  9114 ts_tablet_manager.cc:1403] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.000s
I20260709 12:12:46.950620  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 996aff69fd874168bec179a4292ac2e2 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:46.954319  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba05ad5deb4210a163e266631b3e67 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:12:46.956095  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 68550.9us
I20260709 12:12:46.937106  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8de493054d15b198c2f7ddeb70b4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:46.956890  8966 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:46.957580  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8de493054d15b198c2f7ddeb70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.957700  9118 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.958119  9118 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.958474  9118 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.963543  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 22ba05ad5deb4210a163e266631b3e67 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:46.965783  9118 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.973372  9061 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.972182  9114 raft_consensus.cc:359] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:46.974263  9114 raft_consensus.cc:385] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.974622  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eae6c679d7f4d4a9422d66f842d1d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.979825  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:46.986716  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 030add77af8944519fa93baf328b3e4a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:46.981352  8984 tablet_service.cc:1511] Processing CreateTablet for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.982429  8906 tablet_service.cc:1511] Processing CreateTablet for tablet c98b3fa87be744c6a1d2a811af614ebc (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:46.980551  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566f7a1027e341e88b14a77db605c154. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.991973  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:46.994613  8909 tablet_service.cc:1511] Processing CreateTablet for tablet f774722c966e4c2b94851308244cbffd (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:46.996001  8888 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:46.988868  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030add77af8944519fa93baf328b3e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.997710  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996aff69fd874168bec179a4292ac2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.998081  9141 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.998623  8984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.001406  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba05ad5deb4210a163e266631b3e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.002192  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eae6c679d7f4d4a9422d66f842d1d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.002787  9061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.003401  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996aff69fd874168bec179a4292ac2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.978722  9114 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.022351  9134 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.022895  9134 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.023910  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cab06a8b964cdc84cf62efa5868208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.025151  9134 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.026576  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba05ad5deb4210a163e266631b3e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.026787  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:47.028126  8964 leader_election.cc:343] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.028751  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.029350  9073 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.036414  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.023991  9114 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.034011  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f774722c966e4c2b94851308244cbffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.053401  8981 tablet_service.cc:1511] Processing CreateTablet for tablet 030add77af8944519fa93baf328b3e4a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:47.054275  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8de493054d15b198c2f7ddeb70b4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:47.054796  8981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030add77af8944519fa93baf328b3e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.055744  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8de493054d15b198c2f7ddeb70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.056432  8912 tablet_service.cc:1511] Processing CreateTablet for tablet f4167a86c30a432d84c12cddcaef4f30 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.060925  9114 ts_tablet_manager.cc:1434] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.001s
I20260709 12:12:47.028784  9118 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.063264  9119 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
W20260709 12:12:47.063448  9040 leader_election.cc:343] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.063853  9119 ts_tablet_manager.cc:1403] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.258s	user 0.008s	sys 0.010s
I20260709 12:12:47.063890  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.042986  9073 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:47.000180  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 3f07e4a3742b455d9d586fda2b111e62 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:47.069892  8988 tablet_service.cc:1511] Processing CreateTablet for tablet c98b3fa87be744c6a1d2a811af614ebc (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:47.067669  9128 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.071286  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b3fa87be744c6a1d2a811af614ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.071813  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b3fa87be744c6a1d2a811af614ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.074301  9115 tablet_bootstrap.cc:654] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.074443  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:47.067821  9141 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.075815  9141 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.079104  9141 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.091751  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4167a86c30a432d84c12cddcaef4f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.101905  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 617ce264333c4b249320780af77038ce (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:47.105557  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617ce264333c4b249320780af77038ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.109071  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.109720  8925 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:47.112555  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:47.114598  9114 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.114554  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:47.115306  8925 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.029961  8910 tablet_service.cc:1511] Processing CreateTablet for tablet 617ce264333c4b249320780af77038ce (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:12:47.107952  9040 leader_election.cc:343] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.100631  9126 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.124996  8988 tablet_service.cc:1511] Processing CreateTablet for tablet f4167a86c30a432d84c12cddcaef4f30 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.126005  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4167a86c30a432d84c12cddcaef4f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.123208  9134 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.126823  9119 raft_consensus.cc:359] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.129004  9119 raft_consensus.cc:385] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.129294  9119 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.129976  9126 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:47.130905  9126 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.131565  8985 tablet_service.cc:1511] Processing CreateTablet for tablet f774722c966e4c2b94851308244cbffd (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:47.133301  8985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f774722c966e4c2b94851308244cbffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.134132  9119 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.135769  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617ce264333c4b249320780af77038ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.139488  9119 ts_tablet_manager.cc:1434] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.003s
I20260709 12:12:47.140384  9119 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.120815  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:47.148690  8889 leader_election.cc:343] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.151356  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.154286  9134 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.155025  9115 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.159425  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f07e4a3742b455d9d586fda2b111e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.165017  9119 tablet_bootstrap.cc:654] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.124727  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.169076  9128 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:47.170469  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 63925.9us
I20260709 12:12:47.163897  9134 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.178902  9128 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.179499  9128 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.182209  9128 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:47.190109  9114 tablet_bootstrap.cc:654] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.197129  8925 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:47.203617  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.206009  9064 tablet_service.cc:1511] Processing CreateTablet for tablet c98b3fa87be744c6a1d2a811af614ebc (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:47.205870  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 030add77af8944519fa93baf328b3e4a (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:47.220849  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b3fa87be744c6a1d2a811af614ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.223744  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030add77af8944519fa93baf328b3e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.206399  9059 tablet_service.cc:1511] Processing CreateTablet for tablet f774722c966e4c2b94851308244cbffd (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:47.227981  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f774722c966e4c2b94851308244cbffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.207527  9056 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8de493054d15b198c2f7ddeb70b4 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:47.233177  9056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8de493054d15b198c2f7ddeb70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.207954  9062 tablet_service.cc:1511] Processing CreateTablet for tablet f4167a86c30a432d84c12cddcaef4f30 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:47.208901  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 617ce264333c4b249320780af77038ce (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:47.209237  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:47.204941  8964 consensus_peers.cc:597] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:47.240725  9040 leader_election.cc:343] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:47.241254  9037 leader_election.cc:343] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.241673  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.242581  9128 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.213330  9152 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.186369  9115 ts_tablet_manager.cc:1403] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.012s
I20260709 12:12:47.236328  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617ce264333c4b249320780af77038ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.247849  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4167a86c30a432d84c12cddcaef4f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.248481  9115 raft_consensus.cc:359] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.249305  9115 raft_consensus.cc:385] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.249718  9115 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.252185  8821 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.254742  8821 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.256829  9115 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.259120  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 3f07e4a3742b455d9d586fda2b111e62 (DEFAULT_TABLE table=test-workload [id=b89290bd61324e6c9215460ecb991b4b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:47.262204  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f07e4a3742b455d9d586fda2b111e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.270452  9114 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.271358  9114 ts_tablet_manager.cc:1403] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.008s
I20260709 12:12:47.274809  9114 raft_consensus.cc:359] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.275620  9114 raft_consensus.cc:385] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.276015  9114 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.276122  9115 ts_tablet_manager.cc:1434] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.007s
I20260709 12:12:47.277261  9115 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.291595  9114 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.294281  9114 ts_tablet_manager.cc:1434] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:12:47.299188  9134 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.300539  9000 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:47.302256  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:47.303396  9141 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.304296  9115 tablet_bootstrap.cc:654] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.313750  9141 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.322557  9114 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.331552  9152 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.332078  9152 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.334254  9152 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.335829  9119 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.336529  9119 ts_tablet_manager.cc:1403] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.196s	user 0.032s	sys 0.041s
I20260709 12:12:47.338951  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.339509  9119 raft_consensus.cc:359] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.339906  9073 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:47.340188  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.341203  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:47.335795  9114 tablet_bootstrap.cc:654] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:47.341835  8966 leader_election.cc:343] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.342283  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:47.342971  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.343983  9152 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.341487  9134 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:47.344312  8964 leader_election.cc:343] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.344393  9152 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.345243  9152 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.349997  9115 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.350498  9115 ts_tablet_manager.cc:1403] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.011s
I20260709 12:12:47.351228  8925 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:47.352586  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:47.354281  9134 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.353420  9115 raft_consensus.cc:359] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.355204  9115 raft_consensus.cc:385] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.355607  9115 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.356129  9134 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:47.356535  9115 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.354480  9119 raft_consensus.cc:385] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.358309  9114 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.358222  9119 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.358810  9114 ts_tablet_manager.cc:1403] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.000s
I20260709 12:12:47.359524  9115 ts_tablet_manager.cc:1434] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:12:47.351423  9152 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.357262  9134 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.360560  9115 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.359179  9119 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.361730  9114 raft_consensus.cc:359] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.362484  9114 raft_consensus.cc:385] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.362869  9114 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.364526  9119 ts_tablet_manager.cc:1434] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:12:47.366869  9115 tablet_bootstrap.cc:654] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.367134  9119 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.369405  9114 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.374512  9114 ts_tablet_manager.cc:1434] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:47.375746  9114 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.382212  8823 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.384311  9114 tablet_bootstrap.cc:654] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.386866  9119 tablet_bootstrap.cc:654] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.390681  9141 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.391361  9141 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.394809  9141 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.396567  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.397430  9000 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.398808  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.399377  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:47.400343  9141 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.400846  9141 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.401310  9141 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.407248  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.408181  9073 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
W20260709 12:12:47.415663  8966 leader_election.cc:343] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.415796  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.417145  9073 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.419111  9141 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.422457  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.423033  9000 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.423995  9152 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.433593  9073 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:47.435549  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.436803  9000 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.437228  9152 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.438313  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.439049  9152 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:47.440335  9152 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.449954  9165 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.450690  9165 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:47.452904  9141 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.454901  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.456554  9074 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.456700  9134 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.455685  9165 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.465359  9115 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.466249  9115 ts_tablet_manager.cc:1403] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.073s
I20260709 12:12:47.469594  9114 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.470191  9114 ts_tablet_manager.cc:1403] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.008s
I20260709 12:12:47.470558  9074 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.473647  9119 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.474176  9119 ts_tablet_manager.cc:1403] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.037s
W20260709 12:12:47.474116  8964 consensus_peers.cc:597] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:47.473774  9114 raft_consensus.cc:359] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.474653  9114 raft_consensus.cc:385] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.474974  9114 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.475543  9115 raft_consensus.cc:359] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.476397  9115 raft_consensus.cc:385] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.476025  9114 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.476711  9115 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.477785  9115 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.479112  9114 ts_tablet_manager.cc:1434] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:12:47.478744  9119 raft_consensus.cc:359] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.480396  9119 raft_consensus.cc:385] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.481041  9119 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.482159  9119 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.485675  9115 ts_tablet_manager.cc:1434] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:12:47.486788  9115 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.480381  9114 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.493637  9115 tablet_bootstrap.cc:654] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.496107  9114 tablet_bootstrap.cc:654] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.495007  8823 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.501956  9119 ts_tablet_manager.cc:1434] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:12:47.503032  9119 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.508635  9115 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.509147  9115 ts_tablet_manager.cc:1403] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:12:47.510622  9119 tablet_bootstrap.cc:654] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.511754  9115 raft_consensus.cc:359] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.512410  9115 raft_consensus.cc:385] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.512657  9115 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.513646  9115 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.515751  9115 ts_tablet_manager.cc:1434] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:12:47.516117  9114 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.516578  9114 ts_tablet_manager.cc:1403] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.008s
I20260709 12:12:47.516636  9115 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.518661  9119 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.519115  9119 ts_tablet_manager.cc:1403] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:12:47.519145  9114 raft_consensus.cc:359] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.520022  9114 raft_consensus.cc:385] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.520311  9114 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.521092  9114 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.522555  9115 tablet_bootstrap.cc:654] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.522153  9119 raft_consensus.cc:359] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.522876  9119 raft_consensus.cc:385] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.523204  9119 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.523378  9114 ts_tablet_manager.cc:1434] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:47.524326  9114 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.524132  9119 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.526407  9119 ts_tablet_manager.cc:1434] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:47.527462  9119 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.531608  9114 tablet_bootstrap.cc:654] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.532471  8821 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.535319  9115 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.533936  9119 tablet_bootstrap.cc:654] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.535893  9115 ts_tablet_manager.cc:1403] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:12:47.544420  9115 raft_consensus.cc:359] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.545646  9115 raft_consensus.cc:385] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.546054  9115 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.547456  9115 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.550949  9115 ts_tablet_manager.cc:1434] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:47.552389  9115 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.558564  9114 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.559067  9114 ts_tablet_manager.cc:1403] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.019s
I20260709 12:12:47.560070  9115 tablet_bootstrap.cc:654] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.562434  9114 raft_consensus.cc:359] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.563441  9114 raft_consensus.cc:385] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.563827  9114 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.564960  9114 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.568575  9114 ts_tablet_manager.cc:1434] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:47.569978  9114 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.579332  9114 tablet_bootstrap.cc:654] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.584180  9118 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.584910  9118 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.588378  9118 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.589895  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.591650  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.592352  9074 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
W20260709 12:12:47.594074  8966 leader_election.cc:343] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.594900  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.596109  9118 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.596484  9118 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.596833  9118 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.602293  9165 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.603065  9165 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.604286  9118 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.606863  9165 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.607090  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.607851  9000 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.609133  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.610136  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:47.610373  9115 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.610901  9115 ts_tablet_manager.cc:1403] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.059s	user 0.034s	sys 0.022s
I20260709 12:12:47.611685  9119 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
W20260709 12:12:47.612304  8966 leader_election.cc:343] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.612377  9119 ts_tablet_manager.cc:1403] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.036s
I20260709 12:12:47.611629  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:47.613919  8889 leader_election.cc:343] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.614032  9115 raft_consensus.cc:359] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.614810  9115 raft_consensus.cc:385] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.614871  9165 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.615377  9165 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.615751  9165 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.616556  9118 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.616425  9119 raft_consensus.cc:359] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.617203  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.617559  9119 raft_consensus.cc:385] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.617799  9074 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.618033  9119 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.619273  9119 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.624361  9165 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.627759  9114 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.628281  9114 ts_tablet_manager.cc:1403] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.022s
I20260709 12:12:47.628423  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:47.629977  8889 leader_election.cc:343] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.615386  9115 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.628322  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.630823  9000 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.631362  9114 raft_consensus.cc:359] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.631657  9165 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.633563  9114 raft_consensus.cc:385] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.631377  9119 ts_tablet_manager.cc:1434] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:12:47.633986  9114 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.634702  9114 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.636735  9114 ts_tablet_manager.cc:1434] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:47.636430  9118 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.638446  9119 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.640278  9114 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.625092  9074 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:47.644364  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.645262  9119 tablet_bootstrap.cc:654] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.645623  9118 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.630919  9115 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.646205  9118 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:47.646894  9114 tablet_bootstrap.cc:654] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.647178  9118 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.648451  9115 ts_tablet_manager.cc:1434] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:12:47.649382  9115 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.653339  9000 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.655169  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:47.656366  9165 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.656898  9165 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:47.658116  9165 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.673002  9134 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.682698  9115 tablet_bootstrap.cc:654] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.686182  9141 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.686769  9141 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.690865  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.691617  9000 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.692529  9119 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.693027  9119 ts_tablet_manager.cc:1403] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 12:12:47.693168  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.694027  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.694895  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.694276  9166 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.695989  9166 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.696487  9166 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.703372  9141 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.702824  8821 catalog_manager.cc:5697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.691838  9114 tablet_bootstrap.cc:492] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.704852  9114 ts_tablet_manager.cc:1403] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.033s
I20260709 12:12:47.708455  9114 raft_consensus.cc:359] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.708534  8822 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.715508  9114 raft_consensus.cc:385] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.715929  9114 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.716459  9119 raft_consensus.cc:359] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.717435  9119 raft_consensus.cc:385] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.716840  9114 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.717788  9119 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.714955  9166 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.723871  9166 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.720841  9114 ts_tablet_manager.cc:1434] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:47.725059  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.734925  9000 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.726372  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.735101  9114 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.735680  9073 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.742478  9115 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.743005  9115 ts_tablet_manager.cc:1403] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.033s
I20260709 12:12:47.743361  9114 tablet_bootstrap.cc:654] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.743193  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.744905  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.746053  9166 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.745958  9115 raft_consensus.cc:359] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.746701  9166 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:47.747098  9115 raft_consensus.cc:385] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.747597  9115 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.747678  9166 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.748675  9115 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.718634  9119 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.743193  9000 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.752161  9115 ts_tablet_manager.cc:1434] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:47.753221  9115 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.754107  9119 ts_tablet_manager.cc:1434] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:12:47.755594  9119 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.756908  9114 tablet_bootstrap.cc:492] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.757383  9114 ts_tablet_manager.cc:1403] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 12:12:47.759411  9115 tablet_bootstrap.cc:654] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.760008  9114 raft_consensus.cc:359] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.760727  9114 raft_consensus.cc:385] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.761001  9114 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.761833  9114 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.761847  9119 tablet_bootstrap.cc:654] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.766362  9166 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.766867  9166 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.769853  9166 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.772617  9114 ts_tablet_manager.cc:1434] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:12:47.772020  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.772130  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.773856  9073 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.774081  9000 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.776631  8889 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.777539  9166 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.777971  9166 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.778340  9166 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.782078  9119 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.782780  9119 ts_tablet_manager.cc:1403] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.007s
I20260709 12:12:47.786252  9119 raft_consensus.cc:359] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.786481  9166 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.787335  9119 raft_consensus.cc:385] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.786873  8823 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.788004  9119 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.788939  9119 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.773865  9114 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.797145  9165 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.797766  9165 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.798386  9128 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.798943  9128 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.801195  9128 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:47.801990  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.802709  9000 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.803471  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.804107  9166 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.805033  9114 tablet_bootstrap.cc:654] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.805475  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.805820  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.806262  9000 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:47.806526  8924 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:47.807538  9037 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:47.807053  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.809072  9141 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.809499  9141 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.809870  9141 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.798147  9119 ts_tablet_manager.cc:1434] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:47.814015  9119 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.807626  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.804152  9073 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.816980  9128 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.815971  8999 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.817864  9128 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.818281  9128 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.805413  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.820554  9074 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.819969  9166 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.819706  9165 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.830034  9074 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.830199  9128 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.830051  9141 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.832888  8999 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.833317  9141 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.830152  9166 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.834615  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:47.835424  9073 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:12:47.835994  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:47.836845  8924 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:47.834636  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:47.838618  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.839609  9073 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:47.839908  9128 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:47.840626  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.841180  9141 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.841777  8999 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.842250  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:47.842746  9141 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:47.841542  9118 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.843634  9118 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.843933  9141 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.845937  9118 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.839934  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.848337  9037 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.849963  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.850019  8999 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:47.851766  9128 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.853320  9119 tablet_bootstrap.cc:654] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.853020  8888 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:12:47.853408  8966 leader_election.cc:343] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.838655  9166 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.847313  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.854502  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:47.855281  9165 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:47.857538  8964 leader_election.cc:343] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.856686  9166 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.858376  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.858385  9115 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:47.859875  9115 ts_tablet_manager.cc:1403] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.032s
I20260709 12:12:47.863993  9114 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.864509  9114 ts_tablet_manager.cc:1403] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.007s
I20260709 12:12:47.865767  9165 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.865128  9118 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.863134  9115 raft_consensus.cc:359] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.868422  9115 raft_consensus.cc:385] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.868746  9115 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.869473  9115 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.868187  9166 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:47.875519  9115 ts_tablet_manager.cc:1434] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:47.874444  9114 raft_consensus.cc:359] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.877650  9114 raft_consensus.cc:385] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.878015  9114 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.872754  9166 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.878893  9114 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.882474  9115 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:47.885807  9114 ts_tablet_manager.cc:1434] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:12:47.887140  9114 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.888491  9118 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.889955  9119 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.890434  9119 ts_tablet_manager.cc:1403] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.006s
I20260709 12:12:47.883940  8820 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.883487  9192 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:47.900357  9119 raft_consensus.cc:359] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.901067  9119 raft_consensus.cc:385] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.901360  9119 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.902150  9128 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.902014  9119 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.902827  9128 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.906220  9128 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:47.908200  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.909698  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.910624  8924 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:47.915303  9074 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.916528  9114 tablet_bootstrap.cc:654] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.918380  9118 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.915169  9040 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.918887  9118 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.921207  9118 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.921785  9119 ts_tablet_manager.cc:1434] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.006s
I20260709 12:12:47.922761  9119 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.923606  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:47.923738  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.924432  9128 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:47.925074  8966 leader_election.cc:343] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:47.926165  8964 leader_election.cc:343] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.926632  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:47.928669  9126 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.931097  9119 tablet_bootstrap.cc:654] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.935102  9134 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.935914  8823 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.937136  9119 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:47.937567  9119 ts_tablet_manager.cc:1403] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:12:47.939097  9118 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.942696  9115 tablet_bootstrap.cc:654] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.945181  9119 raft_consensus.cc:359] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.945904  9119 raft_consensus.cc:385] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.946161  9119 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.946782  9119 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.948827  9119 ts_tablet_manager.cc:1434] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:47.949755  9119 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:47.951968  9192 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.955976  9119 tablet_bootstrap.cc:654] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.967116  9134 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.968930  9192 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.969496  9192 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.972630  9192 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:47.974243  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:47.983197  9114 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:47.983752  9114 ts_tablet_manager.cc:1403] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.000s
W20260709 12:12:47.983860  8888 leader_election.cc:343] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.984972  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:47.986768  9072 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.986547  9114 raft_consensus.cc:359] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.987391  9114 raft_consensus.cc:385] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.987762  9114 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.988598  9114 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:47.991575  9114 ts_tablet_manager.cc:1434] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:12:47.992612  9114 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:47.985742  9073 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:47.994002  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:47.994979  9193 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.995462  9193 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.995885  9193 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.002776  9197 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.003403  9197 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.005329  9193 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.007311  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.009073  9197 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:12:48.009433  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.009935  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:48.010763  8888 leader_election.cc:343] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.011910  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.012337  9193 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.014443  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.015116  9073 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:48.015339  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:48.019649  9134 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.020370  9134 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.023118  9114 tablet_bootstrap.cc:654] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.024526  9197 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.027710  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.028561  9119 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.029093  9119 ts_tablet_manager.cc:1403] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.031s
W20260709 12:12:48.029270  8964 leader_election.cc:343] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.029961  9134 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.031493  9119 raft_consensus.cc:359] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.032068  9119 raft_consensus.cc:385] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.032339  9119 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.034068  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.034188  9119 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.036005  9115 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
W20260709 12:12:48.036265  8966 leader_election.cc:343] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.036469  9115 ts_tablet_manager.cc:1403] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.154s	user 0.029s	sys 0.015s
I20260709 12:12:48.036696  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.036974  9119 ts_tablet_manager.cc:1434] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:48.037830  9152 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.039433  9119 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.043007  9115 raft_consensus.cc:359] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.043764  9115 raft_consensus.cc:385] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.044046  9115 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.046204  9119 tablet_bootstrap.cc:654] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.046620  9114 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.047540  9114 ts_tablet_manager.cc:1403] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:12:48.046064  9073 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.049384  9115 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.051443  9115 ts_tablet_manager.cc:1434] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:48.052917  9114 raft_consensus.cc:359] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.054064  9114 raft_consensus.cc:385] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.054317  9114 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.054934  9114 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.056108  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:48.057494  9193 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.057938  9193 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:48.058732  9193 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.061362  9115 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.067512  9114 ts_tablet_manager.cc:1434] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:12:48.068817  9114 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.072693  9115 tablet_bootstrap.cc:654] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.074285  9119 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.074779  9119 ts_tablet_manager.cc:1403] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.006s
I20260709 12:12:48.076150  8924 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.086665  9152 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.090502  9114 tablet_bootstrap.cc:654] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.090298  9119 raft_consensus.cc:359] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.091020  9119 raft_consensus.cc:385] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.091336  9119 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.095593  9119 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.095254  8819 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.100042  9119 ts_tablet_manager.cc:1434] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.007s
I20260709 12:12:48.100922  9115 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.101301  9119 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.101565  9115 ts_tablet_manager.cc:1403] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:12:48.105351  9115 raft_consensus.cc:359] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.106320  9115 raft_consensus.cc:385] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.106673  9115 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.108896  9115 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.110038  9119 tablet_bootstrap.cc:654] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.112640  9115 ts_tablet_manager.cc:1434] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:12:48.116089  9119 tablet_bootstrap.cc:492] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.116093  9114 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.116710  9114 ts_tablet_manager.cc:1403] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.016s
I20260709 12:12:48.116710  9119 ts_tablet_manager.cc:1403] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:12:48.119556  9119 raft_consensus.cc:359] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.120179  9119 raft_consensus.cc:385] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.120429  9119 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.121086  9119 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.121932  9114 raft_consensus.cc:359] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.122491  9074 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.122661  9114 raft_consensus.cc:385] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.123117  9114 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.123323  9119 ts_tablet_manager.cc:1434] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:48.124632  9115 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.124377  9114 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.124882  9119 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.127676  9114 ts_tablet_manager.cc:1434] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:48.131106  9115 tablet_bootstrap.cc:654] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.131650  9119 tablet_bootstrap.cc:654] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.133533  9114 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.139978  9141 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.131614  9192 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.142279  9192 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.148383  9152 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.149350  9114 tablet_bootstrap.cc:654] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.163178  9114 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.163846  9114 ts_tablet_manager.cc:1403] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:12:48.167795  9114 raft_consensus.cc:359] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.169124  9114 raft_consensus.cc:385] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.169624  9114 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.170969  9192 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.170625  9114 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.171620  9197 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.172158  9197 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.173554  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.176039  9114 ts_tablet_manager.cc:1434] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:12:48.176268  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.174361  9197 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.177052  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:48.177910  8889 leader_election.cc:343] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.177989  8998 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:48.179524  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:48.180262  9197 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.180759  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.180788  9197 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.183074  9197 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:48.185858  8888 leader_election.cc:343] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.186600  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.197237  8924 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:48.207522  9193 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.211107  9114 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.191491  9192 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.220759  9193 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.224826  9141 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.224838  9128 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.225605  9128 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.225536  9141 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.230963  9128 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.239447  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.240499  9000 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:48.242039  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:48.232347  9128 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.248565  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.261413  9115 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.264961  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.246675  9128 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.271142  9115 ts_tablet_manager.cc:1403] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.147s	user 0.026s	sys 0.055s
I20260709 12:12:48.269078  9141 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.257959  9219 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.301523  9115 raft_consensus.cc:359] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.305445  9115 raft_consensus.cc:385] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.306181  9115 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.276499  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.273413  8924 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:48.273815  9000 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:48.309036  9115 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.310842  9119 tablet_bootstrap.cc:492] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.311302  9119 ts_tablet_manager.cc:1403] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.187s	user 0.046s	sys 0.051s
I20260709 12:12:48.312717  9128 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.314073  9115 ts_tablet_manager.cc:1434] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.008s
I20260709 12:12:48.315366  9115 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.313222  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.316736  9114 tablet_bootstrap.cc:654] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.318821  9073 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.306813  9219 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.321512  9119 raft_consensus.cc:359] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.322818  9219 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.323258  9119 raft_consensus.cc:385] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.323117  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.323633  9119 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.324783  9193 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.325172  9193 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.323036  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.325591  9193 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.326058  9119 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:48.328770  8889 leader_election.cc:343] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.330343  9119 ts_tablet_manager.cc:1434] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:12:48.331285  9119 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.333546  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.327085  9197 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.343109  9193 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.343546  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.344180  8923 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.349151  9193 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.350207  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.350631  9071 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.354835  9128 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.357613  9141 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.358331  9192 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.358963  9166 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.355890  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.362568  8999 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.374101  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.374964  9000 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.375066  9152 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.375851  9152 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.379751  9152 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.380364  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.381511  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.382527  9073 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:48.384256  8964 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.386234  9118 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.373131  9197 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.394064  8923 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:48.396129  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.397011  9197 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.397555  9197 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:48.398581  9197 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.403090  9119 tablet_bootstrap.cc:654] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.404810  9118 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.415431  8999 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.417069  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.418433  9165 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.427098  9000 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:48.419080  9165 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:48.429862  9165 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.444676  9193 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.447831  9115 tablet_bootstrap.cc:654] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.458848  9114 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.479962  9114 ts_tablet_manager.cc:1403] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.269s	user 0.022s	sys 0.019s
I20260709 12:12:48.480839  9071 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.483595  9197 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.485082  9197 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.486481  9114 raft_consensus.cc:359] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.491353  9114 raft_consensus.cc:385] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.491632  9114 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.493808  9219 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.498154  9197 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.500459  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.501709  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.503639  9114 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:48.504120  9040 leader_election.cc:343] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.505388  9114 ts_tablet_manager.cc:1434] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:12:48.506306  9114 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.502161  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.502305  8924 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.509302  9000 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.502131  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.503608  9219 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:12:48.512017  9037 leader_election.cc:343] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.512552  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.514508  9219 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.520406  9114 tablet_bootstrap.cc:654] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.520568  9193 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.529230  8924 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:48.531695  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.532831  9219 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.532898  9119 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.533365  9219 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:48.534677  9119 ts_tablet_manager.cc:1403] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.004s
I20260709 12:12:48.535276  9219 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.533694  9193 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:48.535445  9000 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:48.553041  9119 raft_consensus.cc:359] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.553833  9119 raft_consensus.cc:385] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.554023  9119 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.557446  9119 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.561228  9119 ts_tablet_manager.cc:1434] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.007s
I20260709 12:12:48.562062  9119 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.558670  9165 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.564041  9165 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.566635  9165 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.568137  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:48.569826  8889 leader_election.cc:343] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.539155  8819 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.571935  9115 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.572436  9115 ts_tablet_manager.cc:1403] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.257s	user 0.012s	sys 0.012s
I20260709 12:12:48.574553  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.578370  9115 raft_consensus.cc:359] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.579671  9115 raft_consensus.cc:385] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.579968  9115 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.580001  9193 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:48.583038  9119 tablet_bootstrap.cc:654] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.585170  9115 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:48.589707  8888 leader_election.cc:343] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.590734  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.591746  9193 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.594901  8820 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.600032  9114 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.600742  9114 ts_tablet_manager.cc:1403] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.012s
I20260709 12:12:48.602139  9115 ts_tablet_manager.cc:1434] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:12:48.606066  9115 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.605648  9152 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.608018  9152 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.612884  9114 raft_consensus.cc:359] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.614333  9114 raft_consensus.cc:385] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.614636  9114 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.615335  9114 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.616035  9152 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.616386  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.616992  8924 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:48.617705  9114 ts_tablet_manager.cc:1434] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 12:12:48.618621  9114 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.618460  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.619532  9118 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.619920  9118 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.620261  9118 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.621575  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:48.623380  8964 leader_election.cc:343] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.629735  9118 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.634327  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.634816  9115 tablet_bootstrap.cc:654] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.634994  8923 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.635885  9118 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.640913  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.642418  9193 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:48.643404  8964 leader_election.cc:343] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.643100  9193 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.646912  8923 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:48.650363  9114 tablet_bootstrap.cc:654] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.650694  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.652235  9152 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.652856  9152 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:48.653870  9152 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.656152  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.656839  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:48.663892  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.664814  9165 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.665185  9165 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.665530  9165 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.671854  9193 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.674329  8821 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.673149  9119 tablet_bootstrap.cc:492] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.673493  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.677866  9119 ts_tablet_manager.cc:1403] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.025s
W20260709 12:12:48.678766  8889 leader_election.cc:343] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.683821  9119 raft_consensus.cc:359] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.684517  9119 raft_consensus.cc:385] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.684811  9119 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.685495  9165 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.689812  9115 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.689975  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.685580  9119 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.691846  9071 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.694725  9114 tablet_bootstrap.cc:492] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.695308  9114 ts_tablet_manager.cc:1403] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.014s
I20260709 12:12:48.695533  9115 ts_tablet_manager.cc:1403] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.015s
I20260709 12:12:48.697048  9071 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.698357  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.699285  9193 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.698357  9114 raft_consensus.cc:359] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.700143  9114 raft_consensus.cc:385] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.700416  9114 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.690797  9165 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.699777  9193 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:48.701260  9119 ts_tablet_manager.cc:1434] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:12:48.701036  9114 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.701440  9193 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.702330  9119 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.703302  9114 ts_tablet_manager.cc:1434] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:12:48.704200  9114 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.689855  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.706598  8997 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.708290  9119 tablet_bootstrap.cc:654] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.709888  9114 tablet_bootstrap.cc:654] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.712119  9115 raft_consensus.cc:359] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.712831  9115 raft_consensus.cc:385] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.713096  9115 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.713727  9152 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.714327  9152 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.713735  9115 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.717273  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.717871  8923 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:48.719036  9115 ts_tablet_manager.cc:1434] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:12:48.719129  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.720059  9115 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.719991  9118 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.720417  9118 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.720748  9118 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.724591  9152 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.727684  8821 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.729439  9193 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.729525  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.728876  9152 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.730752  9152 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.731817  9118 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.733947  9115 tablet_bootstrap.cc:654] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.733450  8819 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.734823  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.735128  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.735746  8924 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.734823  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.736506  8923 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:48.738452  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.739336  9126 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.739727  9126 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.740067  9126 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.742806  8924 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:48.744114  9152 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.746189  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:48.747679  8964 leader_election.cc:343] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.748690  9126 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.744153  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.750803  9126 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.752348  9119 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.752820  9119 ts_tablet_manager.cc:1403] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.013s
I20260709 12:12:48.730093  9193 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.756033  9114 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.756557  9114 ts_tablet_manager.cc:1403] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 12:12:48.757340  9119 raft_consensus.cc:359] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.758090  9119 raft_consensus.cc:385] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.758364  9119 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.758823  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.759044  9119 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.759507  9070 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:48.760412  9193 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.760942  9118 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.761765  9126 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.762264  9126 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:48.763108  9126 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.763578  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:48.765074  8964 leader_election.cc:343] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.767639  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.768798  9192 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.769170  9192 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.769496  9192 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.770956  9119 ts_tablet_manager.cc:1434] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:12:48.771981  9119 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.777495  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.778999  9119 tablet_bootstrap.cc:654] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:48.779220  8888 leader_election.cc:343] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.782289  9219 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.783349  9115 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.731616  9071 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:48.782763  9219 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.784467  9115 ts_tablet_manager.cc:1403] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.029s
I20260709 12:12:48.728591  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.786450  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.786744  9114 raft_consensus.cc:359] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.787318  8923 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:48.787509  9114 raft_consensus.cc:385] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.787278  9115 raft_consensus.cc:359] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.787875  9114 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.788048  9115 raft_consensus.cc:385] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.788362  9115 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.788574  9114 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.785578  9219 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:48.789024  9115 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.791023  9115 ts_tablet_manager.cc:1434] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:48.791999  9115 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.794720  9114 ts_tablet_manager.cc:1434] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:12:48.795784  9114 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.800376  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.801195  9115 tablet_bootstrap.cc:654] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.801605  9114 tablet_bootstrap.cc:654] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.802038  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:48.803211  9219 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.811179  9197 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.812767  9114 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.813241  9114 ts_tablet_manager.cc:1403] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:12:48.820205  9114 raft_consensus.cc:359] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.821038  9114 raft_consensus.cc:385] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.821388  9114 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.822347  9114 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.815037  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.813815  9192 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.817070  9115 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.824577  9115 ts_tablet_manager.cc:1403] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:12:48.827023  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:48.827459  9115 raft_consensus.cc:359] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.827881  8997 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.828130  9115 raft_consensus.cc:385] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.828464  9115 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.823628  8924 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.833102  9192 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.833453  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:48.834259  9070 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.834924  8924 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:48.836395  9114 ts_tablet_manager.cc:1434] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:12:48.837450  9114 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.837492  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.838877  9115 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.839943  9134 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.840593  9134 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:48.841022  9115 ts_tablet_manager.cc:1434] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:12:48.841936  9115 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:48.841678  9134 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.843628  9114 tablet_bootstrap.cc:654] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.822775  9219 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.857147  9115 tablet_bootstrap.cc:654] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.868481  9070 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.871223  8821 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.872826  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.874698  9119 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.875145  9119 ts_tablet_manager.cc:1403] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.000s
I20260709 12:12:48.879839  9193 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.882277  9193 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:48.883112  9193 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.880723  9134 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.884846  9134 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.880817  8997 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:48.893844  9128 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.894857  9119 raft_consensus.cc:359] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.895584  9119 raft_consensus.cc:385] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.895862  9119 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.896698  9119 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.900594  9114 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.900950  9114 ts_tablet_manager.cc:1403] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.015s
I20260709 12:12:48.904614  9119 ts_tablet_manager.cc:1434] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:12:48.905944  9119 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:48.916110  9114 raft_consensus.cc:359] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.916787  9114 raft_consensus.cc:385] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.917032  9114 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.917711  9114 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.920341  9114 ts_tablet_manager.cc:1434] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:12:48.921276  9114 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.923456  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:48.924214  8925 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:48.925562  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:48.926363  9119 tablet_bootstrap.cc:654] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.927685  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.928934  9152 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.929337  9152 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:48.929411  8964 leader_election.cc:343] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.929718  9152 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.923471  9134 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.936275  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.938529  9152 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.940619  9152 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.941601  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:48.942225  8924 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.938505  9114 tablet_bootstrap.cc:654] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.942427  8819 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.947947  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:48.951068  8964 leader_election.cc:343] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.953847  8924 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:48.955459  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:48.956413  9152 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.956915  9152 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:48.957615  9114 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:48.958081  9114 ts_tablet_manager.cc:1403] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:12:48.957764  9152 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.958747  9115 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:48.959156  9115 ts_tablet_manager.cc:1403] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.008s
I20260709 12:12:48.960850  9114 raft_consensus.cc:359] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.961504  9114 raft_consensus.cc:385] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.961766  9114 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.962348  9114 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.966957  9255 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.969614  9119 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:48.976945  9119 ts_tablet_manager.cc:1403] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.004s
I20260709 12:12:48.980002  9141 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.980383  9119 raft_consensus.cc:359] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.980515  9141 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.981084  9119 raft_consensus.cc:385] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.981369  9119 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.976660  9115 raft_consensus.cc:359] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.982033  9115 raft_consensus.cc:385] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.982328  9115 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.983362  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:48.983006  9115 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:48.985461  9119 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:48.986650  8888 leader_election.cc:343] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.987955  9119 ts_tablet_manager.cc:1434] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:48.984884  9114 ts_tablet_manager.cc:1434] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:12:48.982612  9141 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:48.984786  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:48.984400  9193 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.989024  9114 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:48.989190  9070 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:48.990851  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:48.992022  9141 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.992450  9141 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.992854  9141 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.997272  9119 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.003650  9114 tablet_bootstrap.cc:654] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.007371  9115 ts_tablet_manager.cc:1434] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:12:49.007861  9192 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.023634  9192 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.024358  9192 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.028318  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.018718  9115 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.029799  8997 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:49.032567  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.033314  9193 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.038942  9119 tablet_bootstrap.cc:654] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.036211  9193 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.044072  9193 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.036043  9192 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.050443  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.053225  9114 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.054009  9114 ts_tablet_manager.cc:1403] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.009s
W20260709 12:12:49.061721  8889 leader_election.cc:343] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.062587  9141 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.100253  9141 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.104509  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:12:49.106407  8888 leader_election.cc:343] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.106810  9115 tablet_bootstrap.cc:654] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.089991  8820 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.108119  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.108947  9071 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.109766  9255 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.110217  9255 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.107172  9152 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:49.113365  9255 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:49.113998  9255 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.118692  9193 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.119284  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.120922  8924 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:49.120836  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.124827  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:49.125437  8997 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.120489  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.125128  9114 raft_consensus.cc:359] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.126861  9114 raft_consensus.cc:385] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.126969  9193 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.127200  9114 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.127988  9114 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.129230  9040 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.129498  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:49.133652  9165 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.132637  9255 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.142473  9114 ts_tablet_manager.cc:1434] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
I20260709 12:12:49.142544  9141 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.145609  9141 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:49.146453  9114 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.150975  9165 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.148770  9141 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.148244  9119 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.165738  9119 ts_tablet_manager.cc:1403] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.006s
I20260709 12:12:49.168887  9119 raft_consensus.cc:359] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.171058  9115 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.180138  9119 raft_consensus.cc:385] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.180655  9115 ts_tablet_manager.cc:1403] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.162s	user 0.024s	sys 0.004s
I20260709 12:12:49.180866  9119 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.144729  8997 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.173275  9255 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.173734  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.181752  9119 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.184836  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.184362  9114 tablet_bootstrap.cc:654] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.185814  9141 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.186327  9141 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:49.186748  9119 ts_tablet_manager.cc:1434] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:12:49.187369  9141 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.189587  9119 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
W20260709 12:12:49.190790  8889 leader_election.cc:343] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:49.187093  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:49.196762  9115 raft_consensus.cc:359] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.197667  9115 raft_consensus.cc:385] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.197988  9115 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.198694  9115 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.218189  9115 ts_tablet_manager.cc:1434] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:12:49.219185  9115 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.234402  9115 tablet_bootstrap.cc:654] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.241701  9165 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.242245  9165 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.247629  9152 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.253206  9119 tablet_bootstrap.cc:654] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.254215  9115 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.255102  9115 ts_tablet_manager.cc:1403] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.005s
I20260709 12:12:49.256728  9165 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.257074  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.257720  9070 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:49.258270  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.258502  9115 raft_consensus.cc:359] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.259205  9115 raft_consensus.cc:385] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.259027  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.261488  9114 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.261947  9114 ts_tablet_manager.cc:1403] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.031s
I20260709 12:12:49.262605  9141 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.262977  9141 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.263451  9141 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.258924  9000 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:49.266132  9070 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.271167  9141 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.273325  9115 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.273855  9114 raft_consensus.cc:359] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.274039  9115 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.274564  9114 raft_consensus.cc:385] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.274858  9114 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.275885  9141 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.275563  9114 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.278151  9114 ts_tablet_manager.cc:1434] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:12:49.278580  9115 ts_tablet_manager.cc:1434] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:12:49.279031  9114 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.279577  9115 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.279767  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:49.280359  8997 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.284364  9152 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.285795  9115 tablet_bootstrap.cc:654] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.287249  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.287853  9072 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.302026  9072 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.302579  9152 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.305071  8997 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.306099  9114 tablet_bootstrap.cc:654] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.306366  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.307343  9141 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.308074  9141 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:49.308988  9141 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.299893  8820 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.314705  9115 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.315376  9115 ts_tablet_manager.cc:1403] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.027s
I20260709 12:12:49.318578  9115 raft_consensus.cc:359] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.320356  9115 raft_consensus.cc:385] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.320699  9115 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.321595  9115 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.324445  9115 ts_tablet_manager.cc:1434] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:49.325660  9115 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.333029  9115 tablet_bootstrap.cc:654] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.337870  9114 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.338217  9114 ts_tablet_manager.cc:1403] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.006s
I20260709 12:12:49.338513  9141 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.341280  9141 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.340382  9114 raft_consensus.cc:359] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.344332  9114 raft_consensus.cc:385] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.344091  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.344871  8997 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:49.347204  9126 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.347702  9126 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.348363  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:49.349717  8889 leader_election.cc:343] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.349799  9126 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.350278  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.350948  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.351121  9165 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.351533  9165 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.351889  9165 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.348366  9141 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.351955  8821 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.354359  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.353996  8821 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.355123  9071 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:49.356212  8964 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.356949  9152 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.364705  9152 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.365146  9165 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.367280  9119 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.367774  9119 ts_tablet_manager.cc:1403] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.000s
I20260709 12:12:49.370458  9119 raft_consensus.cc:359] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.370366  9141 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.374341  9114 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.371210  9119 raft_consensus.cc:385] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.375607  9119 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.378612  9119 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.382194  9114 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.387682  9192 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.382272  9119 ts_tablet_manager.cc:1434] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:49.388860  9114 ts_tablet_manager.cc:1434] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:12:49.389739  9115 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.389802  9114 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.390272  9115 ts_tablet_manager.cc:1403] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.014s
I20260709 12:12:49.395633  9115 raft_consensus.cc:359] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.396291  9115 raft_consensus.cc:385] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.396559  9115 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.397195  9115 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.398923  9270 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.399569  9115 ts_tablet_manager.cc:1434] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:49.399408  9270 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.400521  9115 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.400995  9165 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.401521  9270 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.403510  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.404191  9114 tablet_bootstrap.cc:654] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.404789  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.407065  9115 tablet_bootstrap.cc:654] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.408159  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:49.409865  8889 leader_election.cc:343] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:49.410538  8889 leader_election.cc:343] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.414232  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:49.414904  8997 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.420755  9119 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.426549  9152 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.433085  9119 tablet_bootstrap.cc:654] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:49.434044  8888 leader_election.cc:343] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.435099  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.436667  9270 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.467275  9114 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.467792  9114 ts_tablet_manager.cc:1403] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.001s
I20260709 12:12:49.470001  9126 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.470575  9114 raft_consensus.cc:359] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.471282  9114 raft_consensus.cc:385] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.471203  9152 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.471633  9114 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.472411  9114 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.477520  9115 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.478199  9115 ts_tablet_manager.cc:1403] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.078s	user 0.036s	sys 0.020s
I20260709 12:12:49.483161  9114 ts_tablet_manager.cc:1434] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 12:12:49.484889  8964 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.483487  9115 raft_consensus.cc:359] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.486034  9114 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.486454  9115 raft_consensus.cc:385] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.486845  9115 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.488917  8997 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.489467  9115 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.497570  9118 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.498199  9118 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.498974  9115 ts_tablet_manager.cc:1434] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:12:49.500095  9115 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.503166  9118 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.504081  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.504860  8925 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:49.506043  9115 tablet_bootstrap.cc:654] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.506139  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.496966  9114 tablet_bootstrap.cc:654] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.507108  9152 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.507498  9152 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.507885  9152 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.507601  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:49.512562  8964 leader_election.cc:343] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.516333  9114 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.516170  9152 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.516779  9114 ts_tablet_manager.cc:1403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 12:12:49.517619  9115 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.518044  9115 ts_tablet_manager.cc:1403] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 12:12:49.519102  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:49.519721  8923 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.519424  9114 raft_consensus.cc:359] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.520233  9114 raft_consensus.cc:385] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.520489  9114 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.520802  9115 raft_consensus.cc:359] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.521593  9115 raft_consensus.cc:385] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.521196  9114 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.521857  9115 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.522634  9115 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.523309  9114 ts_tablet_manager.cc:1434] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:12:49.524214  9114 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.524685  9115 ts_tablet_manager.cc:1434] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:12:49.526041  9115 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.526906  8923 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:49.528209  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.529132  9118 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.529597  9118 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:49.530290  9114 tablet_bootstrap.cc:654] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.530424  9118 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.538344  9115 tablet_bootstrap.cc:654] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.544394  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.544399  9134 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.546355  9134 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.547328  9119 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.547840  9119 ts_tablet_manager.cc:1403] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.014s
I20260709 12:12:49.549767  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.551191  9192 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.551739  9192 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:49.551841  9134 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.552593  9192 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.553097  9141 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.553543  9141 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.556300  9141 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.556907  9141 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.557646  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.557613  9119 raft_consensus.cc:359] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.559095  9119 raft_consensus.cc:385] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.559787  9119 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
W20260709 12:12:49.560835  8889 leader_election.cc:343] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.561257  9255 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.561789  9255 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.560811  9119 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.564016  9255 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:49.565907  9119 ts_tablet_manager.cc:1434] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:49.572212  9119 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.575428  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.576395  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.582862  8923 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:49.579538  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.585175  8997 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:49.587055  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.587495  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.588958  9270 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.589488  9270 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.590023  9270 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.590103  9193 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.592998  9152 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.594132  8819 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.592944  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.596215  9000 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:49.600306  9270 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:49.605731  8964 leader_election.cc:343] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.611111  9118 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.610702  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.611693  9118 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.612191  9118 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.612285  9128 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.622920  9128 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.625257  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:49.626107  8997 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.629271  8821 catalog_manager.cc:5697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.634491  9115 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.634490  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.635082  9270 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.636865  9119 tablet_bootstrap.cc:654] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:49.636979  8889 leader_election.cc:343] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.623939  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.642207  8997 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:49.643739  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.645151  9270 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.634568  9118 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.648692  9270 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:49.648185  9115 ts_tablet_manager.cc:1403] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.035s
I20260709 12:12:49.648784  9114 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
W20260709 12:12:49.648866  8964 leader_election.cc:343] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.650063  9114 ts_tablet_manager.cc:1403] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.033s
I20260709 12:12:49.652688  9114 raft_consensus.cc:359] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.653419  9114 raft_consensus.cc:385] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.653731  9114 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.654731  9118 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.653092  9115 raft_consensus.cc:359] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.656073  9115 raft_consensus.cc:385] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.656157  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:49.656454  9115 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.656805  8925 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.657307  9115 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.649680  9270 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.660926  9115 ts_tablet_manager.cc:1434] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:12:49.662252  9115 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.666733  8925 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:49.667884  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:49.654515  9114 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.670595  9118 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.671562  9118 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:49.672079  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.672475  9118 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.676679  9114 ts_tablet_manager.cc:1434] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:12:49.677464  9114 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
W20260709 12:12:49.678036  8964 leader_election.cc:343] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.686985  8819 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.692233  9119 tablet_bootstrap.cc:492] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.692701  9119 ts_tablet_manager.cc:1403] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.000s
I20260709 12:12:49.691918  9192 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.699869  9115 tablet_bootstrap.cc:654] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.704344  9114 tablet_bootstrap.cc:654] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.711369  9119 raft_consensus.cc:359] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.712098  9119 raft_consensus.cc:385] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.712364  9119 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.713081  9192 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.712994  9119 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.722369  9119 ts_tablet_manager.cc:1434] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:12:49.727388  9119 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.733994  9114 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.734501  9114 ts_tablet_manager.cc:1403] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.003s
I20260709 12:12:49.737443  9119 tablet_bootstrap.cc:654] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.741451  9192 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.746433  9192 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.748809  9192 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.749904  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.751161  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.752038  9115 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.752511  9115 ts_tablet_manager.cc:1403] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.010s
W20260709 12:12:49.753780  8888 leader_election.cc:343] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:49.754812  8889 leader_election.cc:343] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.755280  8889 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.756047  9270 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.758531  9270 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.768425  9115 raft_consensus.cc:359] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.769120  9115 raft_consensus.cc:385] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.769384  9115 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.770049  9115 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.770757  9114 raft_consensus.cc:359] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.771842  9114 raft_consensus.cc:385] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.772172  9115 ts_tablet_manager.cc:1434] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:49.772176  9114 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.773239  9115 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.772941  9114 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.777787  9165 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.783733  9119 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.784229  9119 ts_tablet_manager.cc:1403] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.010s
I20260709 12:12:49.784574  9115 tablet_bootstrap.cc:654] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.786854  9119 raft_consensus.cc:359] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.787609  9119 raft_consensus.cc:385] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.787866  9119 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.789361  9114 ts_tablet_manager.cc:1434] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:12:49.788982  9119 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.796871  9114 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.803906  8819 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.808410  9119 ts_tablet_manager.cc:1434] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:12:49.812072  9119 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.845549  9119 tablet_bootstrap.cc:654] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.847597  9114 tablet_bootstrap.cc:654] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.854803  9115 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.855302  9115 ts_tablet_manager.cc:1403] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.082s	user 0.035s	sys 0.023s
I20260709 12:12:49.856241  9119 tablet_bootstrap.cc:492] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.856712  9119 ts_tablet_manager.cc:1403] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.003s
I20260709 12:12:49.857661  9114 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.858147  9114 ts_tablet_manager.cc:1403] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.003s
I20260709 12:12:49.857858  9115 raft_consensus.cc:359] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.858693  9115 raft_consensus.cc:385] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.859054  9115 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.859530  9119 raft_consensus.cc:359] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.859760  9115 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.860188  9119 raft_consensus.cc:385] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.860877  9119 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.861805  9115 ts_tablet_manager.cc:1434] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:49.861543  9119 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.862663  9114 raft_consensus.cc:359] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.863298  9115 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.863345  9114 raft_consensus.cc:385] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.863808  9114 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.863510  9119 ts_tablet_manager.cc:1434] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:49.865118  9119 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:49.865506  9114 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.869144  9115 tablet_bootstrap.cc:654] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.872748  9119 tablet_bootstrap.cc:654] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.873775  9134 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.874917  9134 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.877117  9134 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.879120  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.879853  9070 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.881735  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.879760  8923 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:49.884439  8966 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:12:49.885396  8964 leader_election.cc:343] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.886905  9134 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.887377  9134 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.887754  9134 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.892854  9115 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.893396  9115 ts_tablet_manager.cc:1403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.016s
I20260709 12:12:49.897370  9115 raft_consensus.cc:359] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.898288  9115 raft_consensus.cc:385] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.898681  9115 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.896804  9114 ts_tablet_manager.cc:1434] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.003s
I20260709 12:12:49.899545  9115 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.902916  9115 ts_tablet_manager.cc:1434] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:12:49.904368  9115 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:49.909632  9114 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:49.914947  9128 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.915503  9128 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.916262  9114 tablet_bootstrap.cc:654] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.917616  9128 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:49.902829  9134 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.919600  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.920331  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.921132  8998 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:49.922959  9134 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.923616  9115 tablet_bootstrap.cc:654] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.922899  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.924392  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:49.924923  8925 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.927218  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:49.927416  9192 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.928026  9192 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:49.929710  8964 leader_election.cc:343] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.930176  9192 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.932410  9115 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.932837  9115 ts_tablet_manager.cc:1403] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.001s
I20260709 12:12:49.933993  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:49.935686  8888 leader_election.cc:343] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.935917  9115 raft_consensus.cc:359] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.936615  9115 raft_consensus.cc:385] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.936880  9115 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.937584  9115 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.939596  9115 ts_tablet_manager.cc:1434] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:12:49.942333  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.943897  9115 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
W20260709 12:12:49.944880  8889 leader_election.cc:343] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.945566  8889 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.947139  9270 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.948354  9128 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.949952  9115 tablet_bootstrap.cc:654] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.952193  8925 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:49.955317  9219 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.970350  9219 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.963953  9118 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.971132  9134 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.971633  9134 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.972586  9219 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:49.969317  9115 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:49.971603  9118 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.973361  9115 ts_tablet_manager.cc:1403] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.010s
I20260709 12:12:49.974124  9192 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.974550  9071 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.975574  9118 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.976935  8966 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.976831  9115 raft_consensus.cc:359] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.977545  9115 raft_consensus.cc:385] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.977672  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.977825  9115 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.977998  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.978636  9115 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:49.979091  8964 leader_election.cc:343] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.979815  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.980446  8924 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:49.980914  9115 ts_tablet_manager.cc:1434] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:49.981262  9152 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.981792  9114 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:49.981747  9152 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:49.982280  9114 ts_tablet_manager.cc:1403] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 12:12:49.982702  9152 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:49.984242  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:49.985513  9115 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
W20260709 12:12:49.985919  8966 leader_election.cc:343] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.987463  8966 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:49.963148  9128 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.973666  9134 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:49.979250  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:49.990953  9299 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:49.991178  8964 leader_election.cc:343] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.991487  9299 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.991794  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.992115  9115 tablet_bootstrap.cc:654] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.992318  9299 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.992601  9134 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.973290  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:49.994068  8925 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:49.995332  9040 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:49.998871  9119 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:49.984804  9114 raft_consensus.cc:359] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.000417  9114 raft_consensus.cc:385] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.000898  9114 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.002018  9114 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.002873  9119 ts_tablet_manager.cc:1403] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.138s	user 0.032s	sys 0.056s
I20260709 12:12:50.003436  9128 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.004371  9114 ts_tablet_manager.cc:1434] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:12:50.005654  9114 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.009948  9115 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.010435  9115 ts_tablet_manager.cc:1403] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 12:12:50.014950  9114 tablet_bootstrap.cc:654] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.016314  9119 raft_consensus.cc:359] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.018538  9119 raft_consensus.cc:385] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.018901  9119 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.017740  9115 raft_consensus.cc:359] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.019421  9115 raft_consensus.cc:385] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.019752  9115 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.020458  9115 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.022344  9115 ts_tablet_manager.cc:1434] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:12:50.024463  9115 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.027350  9270 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.023092  9119 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.036284  9119 ts_tablet_manager.cc:1434] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:12:50.037345  9119 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:50.037349  9152 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:50.039674  8820 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.045325  9119 tablet_bootstrap.cc:654] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.057828  9114 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:50.058408  9114 ts_tablet_manager.cc:1403] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.006s
I20260709 12:12:50.060983  9119 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:50.061436  9152 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.045222  9128 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.049106  9115 tablet_bootstrap.cc:654] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.061777  9119 ts_tablet_manager.cc:1403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 12:12:50.077338  9119 raft_consensus.cc:359] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.078262  9119 raft_consensus.cc:385] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.078636  9119 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.062652  9299 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.061097  9114 raft_consensus.cc:359] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.081630  9114 raft_consensus.cc:385] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.082381  9114 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.083098  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:50.084486  9115 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.084950  9115 ts_tablet_manager.cc:1403] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.013s
I20260709 12:12:50.084857  9114 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.086962  9152 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.087442  9152 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.088912  9114 ts_tablet_manager.cc:1434] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:12:50.086570  9299 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.083212  9119 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:50.086160  8964 leader_election.cc:343] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.089401  9152 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.091806  9114 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.091572  9115 raft_consensus.cc:359] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.092577  9115 raft_consensus.cc:385] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.092945  9115 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.093464  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.093606  9115 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:50.095820  8964 leader_election.cc:343] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.095813  9115 ts_tablet_manager.cc:1434] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:12:50.098965  9115 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.103260  9119 ts_tablet_manager.cc:1434] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 12:12:50.104933  9115 tablet_bootstrap.cc:654] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.106072  9071 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.107898  9114 tablet_bootstrap.cc:654] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.111654  9193 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.112306  9193 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.115628  9193 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.116673  9119 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:50.117491  9114 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:50.118311  9114 ts_tablet_manager.cc:1403] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:12:50.123586  9119 tablet_bootstrap.cc:654] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.126677  9115 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.127137  9115 ts_tablet_manager.cc:1403] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.010s
I20260709 12:12:50.121428  9114 raft_consensus.cc:359] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.127830  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:50.128739  8924 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.128739  9114 raft_consensus.cc:385] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.129833  9114 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.130722  9115 raft_consensus.cc:359] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.131448  9115 raft_consensus.cc:385] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.131722  9115 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.131212  9114 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.132362  9115 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.135654  8924 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:50.136075  9115 ts_tablet_manager.cc:1434] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:50.137054  9115 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.138270  9114 ts_tablet_manager.cc:1434] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:50.140731  9114 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.141353  9119 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:50.141829  9119 ts_tablet_manager.cc:1403] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.013s
I20260709 12:12:50.142716  9115 tablet_bootstrap.cc:654] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.144678  9119 raft_consensus.cc:359] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.145442  9119 raft_consensus.cc:385] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.145746  9119 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.145803  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.146351  9114 tablet_bootstrap.cc:654] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.146461  8924 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:50.146806  9119 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.150328  9119 ts_tablet_manager.cc:1434] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:12:50.150420  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.154747  8997 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:50.155153  9192 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.155794  9114 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:50.155884  9119 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:50.156873  9114 ts_tablet_manager.cc:1403] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:12:50.159523  9114 raft_consensus.cc:359] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.160214  9114 raft_consensus.cc:385] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.160449  9128 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.160983  9128 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.162398  9115 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.162990  9115 ts_tablet_manager.cc:1403] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.006s
I20260709 12:12:50.163568  9128 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:50.165932  8966 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:50.166392  9115 raft_consensus.cc:359] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.167280  9115 raft_consensus.cc:385] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.167470  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.167685  9115 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.168171  8997 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:50.168748  9119 tablet_bootstrap.cc:654] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.168606  9115 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.160472  9114 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.169756  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:50.170142  9114 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.170542  9299 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.172478  9299 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:50.172837  9115 ts_tablet_manager.cc:1434] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:50.173012  9128 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:50.173563  9128 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.173431  9299 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.173977  9128 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.174114  9115 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.180716  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:50.183614  9115 tablet_bootstrap.cc:654] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.184314  9114 ts_tablet_manager.cc:1434] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:12:50.185216  9114 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.188797  9165 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.189275  9165 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.189635  9165 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.202422  9114 tablet_bootstrap.cc:654] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.221472  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:50.225387  9165 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.231577  9152 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.234840  9152 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.235335  9152 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.241820  9152 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:50.232599  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51969.2us
I20260709 12:12:50.245289  9165 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.245510  9141 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.252414  8820 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.251607  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.254156  9071 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:50.256229  9152 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.259408  9119 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:50.259931  9119 ts_tablet_manager.cc:1403] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.105s	user 0.037s	sys 0.047s
I20260709 12:12:50.233088  9128 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.234143  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.260254  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:50.264060  9114 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
W20260709 12:12:50.265358  8964 leader_election.cc:343] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.267928  9114 ts_tablet_manager.cc:1403] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.083s	user 0.006s	sys 0.006s
I20260709 12:12:50.277257  9114 raft_consensus.cc:359] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.277724  9152 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.278086  9114 raft_consensus.cc:385] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.278434  9114 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.278240  9152 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.279429  9115 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.279119  9114 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.279904  9115 ts_tablet_manager.cc:1403] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.106s	user 0.039s	sys 0.048s
I20260709 12:12:50.280303  9152 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.280889  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:50.281366  9114 ts_tablet_manager.cc:1434] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:50.282716  9070 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:50.283095  9114 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.281443  9000 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.282904  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.286614  9071 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:50.287110  9339 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.287958  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:50.292323  9339 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.293274  9298 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.293632  9298 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.293964  9298 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.272643  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:50.288501  9141 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.290930  9119 raft_consensus.cc:359] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.295287  9152 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.297065  9115 raft_consensus.cc:359] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.299090  9115 raft_consensus.cc:385] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.297840  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:50.299050  9152 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.299482  9115 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.300065  9119 raft_consensus.cc:385] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.300365  9119 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.296482  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.301119  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.294850  9339 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:50.302618  8889 leader_election.cc:343] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.303725  8923 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:50.304777  8924 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.306537  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:50.307173  9128 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:50.301757  9072 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.306541  9114 tablet_bootstrap.cc:654] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.309376  9119 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.310099  9152 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.314893  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.313251  9115 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.315207  9298 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:50.322034  8964 leader_election.cc:343] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.326166  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:50.331475  9340 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.332006  9340 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:50.337994  9115 ts_tablet_manager.cc:1434] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:12:50.342904  9115 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.337543  9000 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:50.350113  9298 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.362224  9219 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.366740  9219 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.367662  9119 ts_tablet_manager.cc:1434] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 12:12:50.340523  9299 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:12:50.368659  9119 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:50.372015  9072 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:50.383776  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:50.384383  8925 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.380427  9134 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:50.386783  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.387465  9000 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:50.387398  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:50.393020  8966 leader_election.cc:343] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.393658  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:50.395294  8889 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:50.376073  9340 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.398224  9340 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.396101  9298 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.402962  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.403841  8920 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:50.397147  9339 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.404726  9339 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:50.405531  9339 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.413815  8924 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:50.409265  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:50.415407  9219 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:12:50.422190  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:50.420028  9298 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.426518  9298 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.428853  9298 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.423370  9141 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.429554  9141 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.429944  9141 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.394680  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:50.447322  9128 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:50.447628  9298 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.448335  9298 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.451081  9298 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:50.456707  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65295.5us
I20260709 12:12:50.458499  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:50.459874  9070 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.495062  9298 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.530797  9298 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.552451  9114 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:50.553270  9114 ts_tablet_manager.cc:1403] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.270s	user 0.004s	sys 0.029s
I20260709 12:12:50.495349  9070 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:50.586699  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.578867  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.712875  9192 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.713393  9192 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.715562  9192 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.743105  9119 tablet_bootstrap.cc:654] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.748139  9119 tablet_bootstrap.cc:492] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:50.748672  9119 ts_tablet_manager.cc:1403] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.380s	user 0.008s	sys 0.009s
I20260709 12:12:50.751327  9119 raft_consensus.cc:359] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.752236  9119 raft_consensus.cc:385] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.752529  9119 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.753165  9119 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.755520  9119 ts_tablet_manager.cc:1434] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:50.781095  9141 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.783344  9141 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.796149  9115 tablet_bootstrap.cc:654] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.801469  9115 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.801908  9115 ts_tablet_manager.cc:1403] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.463s	user 0.014s	sys 0.000s
I20260709 12:12:50.804402  9115 raft_consensus.cc:359] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.804921  9115 raft_consensus.cc:385] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.805195  9115 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.805676  9115 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.806733  9115 ts_tablet_manager.cc:1434] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
I20260709 12:12:50.807575  9115 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.813266  9115 tablet_bootstrap.cc:654] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.813099  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:50.814251  9348 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:50.814394  8964 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.814756  9348 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:12:50.815034  8964 leader_election.cc:343] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.815629  9348 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.822978  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.828502  9339 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.829193  9339 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.831625  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.832368  9339 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.838706  9192 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.839488  9192 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.841069  9348 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.841478  9348 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.842460  9192 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.843325  9348 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.850414  9115 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.851260  9115 ts_tablet_manager.cc:1403] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 12:12:50.854439  9298 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.859191  9115 raft_consensus.cc:359] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.860128  9115 raft_consensus.cc:385] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.860457  9115 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.861222  9115 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.862867  9115 ts_tablet_manager.cc:1434] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.002s
I20260709 12:12:50.864115  9115 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:50.868114  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.870167  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:50.871177  9354 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.879555  9354 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.880614  9115 tablet_bootstrap.cc:654] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.891906  9115 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:50.892412  9115 ts_tablet_manager.cc:1403] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.006s
I20260709 12:12:50.895013  8925 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:50.895743  9115 raft_consensus.cc:359] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.896402  9115 raft_consensus.cc:385] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.896667  9115 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.897294  9115 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.897835  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.898568  8998 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:50.899931  9115 ts_tablet_manager.cc:1434] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:50.900899  9115 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
W20260709 12:12:50.907181  8964 leader_election.cc:343] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.911121  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.911443  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.908316  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:50.918922  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.919883  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:50.921380  8997 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.916301  8925 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:50.925215  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:12:50.926446  8964 leader_election.cc:343] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.916635  8998 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:50.927839  9348 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.929426  9134 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:50.930465  8966 leader_election.cc:343] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.932691  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:50.933352  9134 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.934235  9114 raft_consensus.cc:359] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:50.934649  8966 leader_election.cc:343] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.934846  9114 raft_consensus.cc:385] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.934989  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:50.935204  9114 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.936169  9298 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.936283  9118 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.937347  9348 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:50.935989  9114 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.938329  9348 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.940171  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:50.940672  9114 ts_tablet_manager.cc:1434] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.387s	user 0.012s	sys 0.006s
I20260709 12:12:50.941911  9115 tablet_bootstrap.cc:654] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.942857  9114 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:50.946314  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:50.950153  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:50.954511  9193 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.954901  9193 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.955298  9193 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.955077  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:50.956220  8888 leader_election.cc:343] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.963644  9339 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.969080  8997 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:50.974125  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.982445  9119 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:50.987936  9219 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.988492  9219 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.964278  9339 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:50.994398  9339 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:50.996856  9219 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:50.997663  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:50.998503  8921 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:51.000011  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.000819  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:51.001096  8889 leader_election.cc:343] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:51.001395  8966 leader_election.cc:343] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.003861  9298 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.004405  9298 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.004892  9298 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:51.006757  8889 leader_election.cc:343] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:51.022395  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61206.3us
W20260709 12:12:51.023432  8889 leader_election.cc:343] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.024462  8889 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.025221  9165 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.029482  9298 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.060658  9299 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.050805  9349 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 12:12:51.078940  9193 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.068835  9299 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.087318  8888 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.089627  9339 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.090083  9339 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.090425  9339 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.089731  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.093220  9192 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.093710  9192 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:51.102209  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:51.102911  8997 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
W20260709 12:12:51.104231  8964 leader_election.cc:343] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.104646  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.106093  9152 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.108670  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.098219  9193 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.108541  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:51.110296  9299 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.120747  8997 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:51.121028  9119 tablet_bootstrap.cc:654] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.120674  9192 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.114439  9165 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:51.123673  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:51.124215  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:51.124490  8924 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:51.125960  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.129012  9360 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.129469  9360 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.129784  9360 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.131417  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:51.137205  8966 leader_election.cc:343] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.141244  9115 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.141765  9115 ts_tablet_manager.cc:1403] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.241s	user 0.057s	sys 0.047s
W20260709 12:12:51.147962  8964 leader_election.cc:343] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.148561  8964 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.149494  9152 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.143649  9298 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.130743  9339 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.157714  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.158874  9219 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.161154  9339 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.166877  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.168234  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:51.168699  8889 leader_election.cc:343] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.169373  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:51.197190  8889 leader_election.cc:343] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.197638  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:12:51.198678  8889 leader_election.cc:343] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.199959  9141 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.200435  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:51.212320  9219 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.218814  9115 raft_consensus.cc:359] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.219782  9115 raft_consensus.cc:385] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.220081  9115 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.218025  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:51.224586  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.215672  8998 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.227658  8821 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.229836  9114 tablet_bootstrap.cc:654] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:51.234939  8889 leader_election.cc:343] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.236958  9165 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:51.240525  8964 leader_election.cc:343] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.241080  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.242764  9348 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.224458  9115 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.243383  9360 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.258338  9115 ts_tablet_manager.cc:1434] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.003s
I20260709 12:12:51.260115  9115 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.311023  8998 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:51.316524  9119 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.317262  9119 ts_tablet_manager.cc:1403] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.335s	user 0.017s	sys 0.013s
I20260709 12:12:51.297513  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:51.328100  9114 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.320806  9360 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.331163  9114 ts_tablet_manager.cc:1403] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.388s	user 0.033s	sys 0.019s
I20260709 12:12:51.332055  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:51.333504  8889 leader_election.cc:343] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.335994  9299 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.327883  8997 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.352679  8888 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:12:51.357066  9367 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:51.355983  9339 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.360944  9339 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:51.361934  9339 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.364780  8997 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:51.367512  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.368492  9270 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.369022  9270 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:51.369858  9270 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.372740  9119 raft_consensus.cc:359] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.373612  9119 raft_consensus.cc:385] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.370355  9115 tablet_bootstrap.cc:654] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.373948  9119 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.388145  9119 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.394546  9119 ts_tablet_manager.cc:1434] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.002s
I20260709 12:12:51.381934  9299 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:12:51.415424  9114 raft_consensus.cc:359] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.416168  9114 raft_consensus.cc:385] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.415921  9299 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.416481  9114 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.418480  9114 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.419498  9219 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.420099  9219 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.422252  9219 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:51.422752  9115 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.423308  9115 ts_tablet_manager.cc:1403] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.012s
I20260709 12:12:51.425523  9119 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.428124  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.433995  9114 ts_tablet_manager.cc:1434] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 12:12:51.438091  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:51.443749  9114 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.459481  9115 raft_consensus.cc:359] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.460325  9115 raft_consensus.cc:385] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.460633  9115 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.461485  9115 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.448999  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.463294  9354 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.467801  9115 ts_tablet_manager.cc:1434] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:12:51.468917  9115 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.476230  9069 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.481002  9349 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.498452  9114 tablet_bootstrap.cc:654] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.505510  9115 tablet_bootstrap.cc:654] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.508466  9119 tablet_bootstrap.cc:654] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.526362  8820 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.529026  8820 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:51.551679  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:51.564113  9119 tablet_bootstrap.cc:492] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.564611  9119 ts_tablet_manager.cc:1403] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.005s
I20260709 12:12:51.565521  9114 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.566046  9114 ts_tablet_manager.cc:1403] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.008s
I20260709 12:12:51.567320  9119 raft_consensus.cc:359] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.568010  9119 raft_consensus.cc:385] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.568285  9119 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.568974  9119 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.569517  9114 raft_consensus.cc:359] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.570266  9114 raft_consensus.cc:385] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.570572  9114 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.571079  9119 ts_tablet_manager.cc:1434] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:51.571406  9114 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.571957  9119 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.573608  9114 ts_tablet_manager.cc:1434] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:51.574555  9114 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.578009  9119 tablet_bootstrap.cc:654] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.580418  9114 tablet_bootstrap.cc:654] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.587893  9114 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.588326  9119 tablet_bootstrap.cc:492] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.588383  9114 ts_tablet_manager.cc:1403] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:51.588965  9119 ts_tablet_manager.cc:1403] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:12:51.587049  8821 catalog_manager.cc:5697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.590641  8821 catalog_manager.cc:5697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.591203  9114 raft_consensus.cc:359] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.591427  9119 raft_consensus.cc:359] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.591910  9114 raft_consensus.cc:385] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.586153  9115 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.592234  9114 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.592438  9115 ts_tablet_manager.cc:1403] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.008s
I20260709 12:12:51.592031  8821 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.593294  9114 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.595070  9115 raft_consensus.cc:359] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.595808  9115 raft_consensus.cc:385] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.596050  9115 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.596210  9114 ts_tablet_manager.cc:1434] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:51.596681  9115 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.597118  9114 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.598656  9115 ts_tablet_manager.cc:1434] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:51.592072  9119 raft_consensus.cc:385] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.599716  9119 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.600409  9119 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.602589  9119 ts_tablet_manager.cc:1434] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 12:12:51.602355  9298 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.603072  9298 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.603523  9119 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.606848  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.607218  9114 tablet_bootstrap.cc:654] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.607560  8920 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:51.609256  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.610320  9115 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.610384  9119 tablet_bootstrap.cc:654] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.610859  9072 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.614840  9299 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.615475  9299 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.615928  9299 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.617676  9115 tablet_bootstrap.cc:654] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.619954  9119 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.620388  9119 ts_tablet_manager.cc:1403] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.009s
I20260709 12:12:51.620343  9298 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.621771  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:51.623294  8964 leader_election.cc:343] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.623080  9119 raft_consensus.cc:359] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.623798  9119 raft_consensus.cc:385] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.624061  9119 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.624814  9119 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.627033  9119 ts_tablet_manager.cc:1434] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:51.620374  9114 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.628135  9119 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.628515  9114 ts_tablet_manager.cc:1403] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 12:12:51.632059  9114 raft_consensus.cc:359] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.632745  9114 raft_consensus.cc:385] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.632998  9114 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.626673  9299 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.633586  9192 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.635443  9299 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.633612  9114 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.636983  9115 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.637089  9119 tablet_bootstrap.cc:654] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.637459  9115 ts_tablet_manager.cc:1403] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.001s
I20260709 12:12:51.637523  9114 ts_tablet_manager.cc:1434] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:12:51.638466  9114 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.640210  9115 raft_consensus.cc:359] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.640851  9115 raft_consensus.cc:385] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.641132  9115 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
W20260709 12:12:51.641752  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac900 after lost signal to thread 7719
W20260709 12:12:51.642715  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3ce0 after lost signal to thread 8857
W20260709 12:12:51.643823  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080022c100 after lost signal to thread 8949
I20260709 12:12:51.643746  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:51.644393  8920 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:51.644883  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7380 after lost signal to thread 9024
W20260709 12:12:51.645882  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080017e660 after lost signal to thread 9098
I20260709 12:12:51.646375  9114 tablet_bootstrap.cc:654] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:51.646476  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080003bf60 after lost signal to thread 9272
I20260709 12:12:51.650992  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:51.652709  8964 leader_election.cc:343] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.654983  9141 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.655526  9141 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.657759  9141 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.641726  9115 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.661792  9115 ts_tablet_manager.cc:1434] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:12:51.662696  9115 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.666368  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:51.672626  9340 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.674187  9115 tablet_bootstrap.cc:654] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.680034  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.680811  9073 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:12:51.681963  9114 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.682555  9114 ts_tablet_manager.cc:1403] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.016s
I20260709 12:12:51.686134  9114 raft_consensus.cc:359] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.687162  9114 raft_consensus.cc:385] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.687533  9114 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.688748  9115 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.688580  9114 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.689231  9115 ts_tablet_manager.cc:1403] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:12:51.691367  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:51.692207  9339 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:51.692759  9339 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.693188  9339 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.692159  9115 raft_consensus.cc:359] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.694870  9115 raft_consensus.cc:385] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.695171  9115 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.699218  9114 ts_tablet_manager.cc:1434] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:12:51.700613  9141 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.701119  9141 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.702507  9114 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.703835  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:51.704577  8997 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:51.711891  9298 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.708485  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.696013  9115 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.719326  9141 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.719743  9119 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.720220  9119 ts_tablet_manager.cc:1403] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.092s	user 0.033s	sys 0.052s
I20260709 12:12:51.721053  9270 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.721496  9270 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.721837  9270 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.725239  9339 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.727663  9339 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.722899  9119 raft_consensus.cc:359] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.719667  9115 ts_tablet_manager.cc:1434] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:12:51.731081  9119 raft_consensus.cc:385] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.731400  9119 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.731877  9115 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.732057  9119 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.733556  9119 ts_tablet_manager.cc:1434] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:51.734437  9119 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.712431  9298 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.743646  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:51.744269  9073 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.744915  9114 tablet_bootstrap.cc:654] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.734668  9270 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.737607  8920 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:51.745707  9298 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.752214  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.749400  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:51.750665  9270 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.751739  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:51.759356  8964 leader_election.cc:343] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.759629  9115 tablet_bootstrap.cc:654] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.762743  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:51.763430  8999 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.767343  9349 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:12:51.767911  9349 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.770262  9349 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.772506  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.774385  8999 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:51.778733  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.779914  9141 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.780486  9141 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:51.781599  9141 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.787961  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:51.790361  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.792495  9299 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.793010  9299 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:51.793859  9299 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:51.797771  8889 leader_election.cc:343] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:51.798954  8889 leader_election.cc:343] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.801991  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.802791  8923 raft_consensus.cc:2368] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:12:51.806973  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.807770  8920 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:51.808233  9073 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:12:51.814746  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:12:51.816143  8966 leader_election.cc:400] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:12:51.816507  8966 leader_election.cc:403] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.818467  9192 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:51.823863  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.821931  9119 tablet_bootstrap.cc:654] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.827576  9349 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:51.824786  9192 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:51.833611  9192 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.839325  9298 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.839759  9298 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.840123  9298 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.847004  9349 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:12:51.851678  9115 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.852195  9115 ts_tablet_manager.cc:1403] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.015s
I20260709 12:12:51.854869  9115 raft_consensus.cc:359] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.858007  9115 raft_consensus.cc:385] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.858309  9115 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.858980  9115 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.861588  8823 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.866200  9115 ts_tablet_manager.cc:1434] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:12:51.867290  9115 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.870245  9298 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.873386  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:51.874038  8925 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.874765  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:51.874974  9298 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:51.876489  8964 leader_election.cc:343] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.878590  9115 tablet_bootstrap.cc:654] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.880517  9114 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:51.880968  9114 ts_tablet_manager.cc:1403] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.180s	user 0.031s	sys 0.010s
I20260709 12:12:51.884212  9114 raft_consensus.cc:359] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.884946  9114 raft_consensus.cc:385] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.885303  9114 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.886929  9134 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.887421  9134 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:51.887976  8889 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.889395  9134 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.890321  9114 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.891054  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.886514  8925 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
W20260709 12:12:51.892573  8966 leader_election.cc:343] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:51.895888  8889 consensus_peers.cc:597] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.896196  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.896739  9134 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.897274  9134 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:51.897737  8964 leader_election.cc:343] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.898115  9348 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.898227  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:51.898679  9348 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.899794  9152 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.892587  9114 ts_tablet_manager.cc:1434] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:51.900309  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.900986  8920 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:51.901471  9114 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:51.901577  9348 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.902468  9134 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.903713  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:51.903991  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:51.904948  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.905684  9298 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.906052  9298 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.906477  9299 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.908639  9299 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:51.905184  8920 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:51.909722  9299 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.895879  8821 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.911099  9298 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.913709  8821 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.920342  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.922544  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:51.924742  8964 leader_election.cc:343] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.927299  8966 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.923288  9073 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:51.928714  9299 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.932583  9339 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.923883  9192 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.929092  9299 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.936431  9299 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.936242  9192 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.935592  8823 catalog_manager.cc:5697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.956969  9114 tablet_bootstrap.cc:654] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.959012  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:51.961432  8888 leader_election.cc:343] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.960032  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:51.965184  9119 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:51.965653  9119 ts_tablet_manager.cc:1403] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.014s
W20260709 12:12:51.966747  8889 leader_election.cc:343] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.967140  8889 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:51.967753  9141 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.970181  9115 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:51.970649  9115 ts_tablet_manager.cc:1403] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.007s
I20260709 12:12:51.957701  9192 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:51.954159  9298 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.978197  9115 raft_consensus.cc:359] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.979099  9115 raft_consensus.cc:385] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.979465  9115 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.980176  9115 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.982525  9115 ts_tablet_manager.cc:1434] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:51.987195  9115 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:51.989241  9119 raft_consensus.cc:359] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.990006  9119 raft_consensus.cc:385] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.990305  9119 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.990974  9119 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.992228  9270 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:51.994436  9119 ts_tablet_manager.cc:1434] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:12:51.996017  9349 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.996380  9119 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:51.996592  9349 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:51.998878  9349 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.001570  9298 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.003084  9299 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.004024  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.007149  9299 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.013762  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.014743  9115 tablet_bootstrap.cc:654] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.014063  9119 tablet_bootstrap.cc:654] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.026726  9219 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.027369  9219 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.029685  9219 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.032608  9114 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.033160  9114 ts_tablet_manager.cc:1403] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.004s
I20260709 12:12:52.036134  9114 raft_consensus.cc:359] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.036877  9114 raft_consensus.cc:385] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.037215  9114 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.037892  9114 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.041268  9115 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.041738  9119 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:52.042081  9340 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.042598  9340 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.044854  9340 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.041801  9115 ts_tablet_manager.cc:1403] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.014s
I20260709 12:12:52.048151  9119 ts_tablet_manager.cc:1403] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:12:52.048369  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.049135  9072 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:52.049160  9115 raft_consensus.cc:359] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.051045  9115 raft_consensus.cc:385] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.051366  9115 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.052093  9115 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.053153  8889 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.053623  9119 raft_consensus.cc:359] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.054232  9141 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.054358  9119 raft_consensus.cc:385] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.054719  9141 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.054819  9119 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.055164  9141 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.060356  9119 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.062075  9119 ts_tablet_manager.cc:1434] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:52.062999  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:52.064083  8921 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.064173  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:52.064917  8925 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.065717  9119 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:52.056188  9115 ts_tablet_manager.cc:1434] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:52.057737  9340 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.059307  9114 ts_tablet_manager.cc:1434] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:12:52.036381  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:12:52.072816  8966 leader_election.cc:343] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.069443  9115 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.070304  9141 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.069309  9114 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.069052  9340 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.085407  9141 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.098109  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.098732  8996 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.078356  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.095885  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:52.103785  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:52.106731  9072 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.106863  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:52.113093  8925 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:52.114346  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.115098  9299 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.118065  9299 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:52.119117  9299 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.120749  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:52.122694  8888 leader_election.cc:343] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.117053  8920 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:52.108750  9073 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.133298  9340 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.134570  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:52.136053  8889 leader_election.cc:343] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.136541  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:52.137959  9340 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.141687  8921 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
W20260709 12:12:52.146795  8964 leader_election.cc:343] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.149474  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.135711  9072 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:52.156144  9219 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.156385  9298 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:52.156180  8964 leader_election.cc:343] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.145076  8996 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:52.159605  9219 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.160617  8889 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.157706  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.162128  9340 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.164270  8997 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:52.164572  9340 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:52.164618  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.164294  9219 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.166564  8966 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:52.165596  9340 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.165567  8923 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:52.168249  9298 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.168844  9298 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:52.170089  9115 tablet_bootstrap.cc:654] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.170022  9298 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.172288  9037 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.173050  9219 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.175258  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.183138  8997 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:52.190013  9114 tablet_bootstrap.cc:654] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.189873  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.190680  9219 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.193172  9219 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.194494  8820 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.214311  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.215008  8923 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:52.216290  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.225419  9119 tablet_bootstrap.cc:654] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.228221  9219 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.204515  9073 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:52.233186  9219 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.241285  9219 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.242143  9219 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.242630  9219 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.243008  9219 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.253275  9115 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.254671  9115 ts_tablet_manager.cc:1403] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.026s
I20260709 12:12:52.242918  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:52.255963  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66194.7us
I20260709 12:12:52.259893  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.260505  8997 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:52.260952  9114 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.261457  9114 ts_tablet_manager.cc:1403] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.006s
I20260709 12:12:52.264166  9114 raft_consensus.cc:359] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.264914  9114 raft_consensus.cc:385] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.265563  9114 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
W20260709 12:12:52.269846  8889 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:52.270793  8964 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.272244  9115 raft_consensus.cc:359] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.272018  8821 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.266312  9114 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.272996  9115 raft_consensus.cc:385] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.273327  9115 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.276316  9114 ts_tablet_manager.cc:1434] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:12:52.277245  9114 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.283092  9119 tablet_bootstrap.cc:492] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:52.284205  9119 ts_tablet_manager.cc:1403] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.219s	user 0.008s	sys 0.008s
I20260709 12:12:52.286782  9114 tablet_bootstrap.cc:654] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.290160  9219 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.291503  9115 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.294060  9119 raft_consensus.cc:359] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.294776  9119 raft_consensus.cc:385] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.295045  9119 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.297397  9115 ts_tablet_manager.cc:1434] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:12:52.298302  9114 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.298444  9115 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.298817  9114 ts_tablet_manager.cc:1403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.012s
I20260709 12:12:52.300563  9219 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.301316  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:52.301900  8923 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.295771  9119 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.303606  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.304394  8997 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.305747  9119 ts_tablet_manager.cc:1434] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.004s
I20260709 12:12:52.306643  9119 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:52.312649  9115 tablet_bootstrap.cc:654] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.315114  9219 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.315693  9219 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.316277  8997 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.318565  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.319422  8920 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:52.319438  9114 raft_consensus.cc:359] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.320360  9114 raft_consensus.cc:385] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.320650  9114 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.320894  9119 tablet_bootstrap.cc:654] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.321149  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:52.321331  9114 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.325006  9114 ts_tablet_manager.cc:1434] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:12:52.325906  9114 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.328109  9115 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.328605  9115 ts_tablet_manager.cc:1403] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:12:52.331315  9219 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.332046  9115 raft_consensus.cc:359] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.332749  9115 raft_consensus.cc:385] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.332878  8923 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.333050  9115 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.333716  9115 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.334786  9219 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.335595  9219 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:52.337321  9219 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.339066  9114 tablet_bootstrap.cc:654] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.339717  9115 ts_tablet_manager.cc:1434] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:12:52.342006  9115 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.344242  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.344691  9000 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:52.346242  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.346704  9192 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.347127  9413 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.347644  9119 tablet_bootstrap.cc:492] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:52.348127  9119 ts_tablet_manager.cc:1403] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.005s
I20260709 12:12:52.352111  9349 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.352828  9299 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.352645  9349 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.353344  9299 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.354810  9349 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.357439  9115 tablet_bootstrap.cc:654] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.358039  9299 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.350878  9119 raft_consensus.cc:359] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.360438  9119 raft_consensus.cc:385] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.360733  9119 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.361374  9119 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.363502  9119 ts_tablet_manager.cc:1434] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:52.364467  9119 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:52.364496  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.366518  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.370257  9119 tablet_bootstrap.cc:654] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.371438  9192 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.374682  9114 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.375211  9114 ts_tablet_manager.cc:1403] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.005s
I20260709 12:12:52.378494  9114 raft_consensus.cc:359] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.379230  9114 raft_consensus.cc:385] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.379565  9114 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
W20260709 12:12:52.379609  8966 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.380316  9114 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.382705  9114 ts_tablet_manager.cc:1434] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:12:52.385044  9115 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.385296  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.385587  9115 ts_tablet_manager.cc:1403] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.000s
W20260709 12:12:52.380339  8966 leader_election.cc:343] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.389285  9115 raft_consensus.cc:359] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.390172  9115 raft_consensus.cc:385] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.390475  9115 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.391139  9115 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.393369  9115 ts_tablet_manager.cc:1434] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:52.394323  9114 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.404697  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.405786  9114 tablet_bootstrap.cc:654] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.409680  9115 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.391386  9413 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.411576  9068 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:12:52.412379  8964 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.412809  8964 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.415299  9349 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:52.417392  8964 leader_election.cc:343] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.417806  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.419068  9298 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.419718  9298 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.423112  9141 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.425943  9349 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:12:52.435688  8964 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.445936  9299 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.446434  9299 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.447530  9413 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.448015  9413 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.448761  9299 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.450562  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.451193  8923 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:52.456629  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.457435  9219 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.457835  9219 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.458178  9219 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.458969  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.460521  9416 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.460317  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.464975  9416 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.467144  9416 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:12:52.468767  8966 leader_election.cc:343] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.478757  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.479460  9114 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.480093  9114 ts_tablet_manager.cc:1403] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.003s
W20260709 12:12:52.480321  9040 leader_election.cc:343] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.490712  9119 tablet_bootstrap.cc:492] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:52.490191  8823 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.492741  9114 raft_consensus.cc:359] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.502276  9114 raft_consensus.cc:385] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.502665  9114 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.475710  9413 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.501820  9219 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.503587  9114 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.506770  9114 ts_tablet_manager.cc:1434] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:12:52.507771  9114 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.499584  9115 tablet_bootstrap.cc:654] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.510371  9219 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.510864  9119 ts_tablet_manager.cc:1403] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.147s	user 0.025s	sys 0.007s
I20260709 12:12:52.513773  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:52.514441  8920 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.524449  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64525.3us
W20260709 12:12:52.525319  8964 leader_election.cc:343] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.525763  8964 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.527055  9349 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.529129  9119 raft_consensus.cc:359] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.529577  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.530290  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.538589  8996 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:52.531409  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.540185  9119 raft_consensus.cc:385] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.540210  8997 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:52.540738  9119 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.533524  9114 tablet_bootstrap.cc:654] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.544667  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.539839  9000 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.545568  9119 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.554512  9119 ts_tablet_manager.cc:1434] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.043s	user 0.001s	sys 0.006s
I20260709 12:12:52.551518  9416 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.559789  9416 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.560174  9416 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.601295  9115 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.601840  9115 ts_tablet_manager.cc:1403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.192s	user 0.019s	sys 0.010s
W20260709 12:12:52.602238  8964 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.604544  9115 raft_consensus.cc:359] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.605139  8920 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.606588  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.607409  9219 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.607933  9219 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:52.608850  9219 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.605252  9115 raft_consensus.cc:385] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.609912  9115 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.610630  9115 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.612299  9115 ts_tablet_manager.cc:1434] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:52.613186  9115 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.601666  9000 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.605469  9119 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:52.623574  9340 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.627414  9416 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.632202  9141 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.638470  9114 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:52.638909  9114 ts_tablet_manager.cc:1403] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.131s	user 0.023s	sys 0.015s
I20260709 12:12:52.641958  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.642650  8996 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.649551  8996 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.650662  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:52.651337  9433 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.651827  9433 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:52.651646  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:52.652478  9416 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.652698  9433 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.656699  9119 tablet_bootstrap.cc:654] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.666124  9115 tablet_bootstrap.cc:654] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.700496  9114 raft_consensus.cc:359] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.701377  9114 raft_consensus.cc:385] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.702548  9299 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.706089  9433 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.706756  9433 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.710302  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.711576  9298 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.713162  9114 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.714636  9433 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:52.716876  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.722083  9114 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.723527  8819 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:52.730772  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.729513  8920 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.748627  9152 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.750205  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.755549  9433 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.774590  9119 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:52.775888  9119 ts_tablet_manager.cc:1403] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.171s	user 0.023s	sys 0.003s
I20260709 12:12:52.775888  9340 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.798516  9115 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.805877  9340 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.806418  9115 ts_tablet_manager.cc:1403] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.012s
I20260709 12:12:52.808269  9298 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.808887  9298 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.799892  9141 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.813076  9141 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.814962  9141 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.810971  9298 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.815763  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.816481  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.814560  9340 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.817796  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.819077  9000 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
W20260709 12:12:52.819896  8888 leader_election.cc:343] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.812464  8820 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.821105  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.823884  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.824442  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.819085  9115 raft_consensus.cc:359] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.825744  9115 raft_consensus.cc:385] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.825943  9115 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
W20260709 12:12:52.827493  8889 leader_election.cc:343] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.827666  8966 leader_election.cc:343] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.829108  8964 leader_election.cc:343] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.829403  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.829890  9152 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.832981  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:12:52.833699  8889 leader_election.cc:343] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.834179  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:52.834734  9141 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.834618  9115 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.835942  9340 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.839570  9340 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.840205  9141 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.840700  9141 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.844493  9141 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.849712  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:52.850387  9299 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.850555  9000 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:52.850901  9299 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.851797  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:52.839943  9340 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.853029  9299 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.852857  9141 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.853993  9141 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.857910  9141 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.858299  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.860841  9115 ts_tablet_manager.cc:1434] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
W20260709 12:12:52.862403  8964 leader_election.cc:343] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.863152  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:52.867170  9115 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:52.871558  9119 raft_consensus.cc:359] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.872315  9119 raft_consensus.cc:385] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.872612  9119 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.872749  9141 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.873248  9119 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.875564  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.875501  9340 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.876242  9000 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.877038  8889 leader_election.cc:343] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.840373  8920 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:52.879506  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.877602  9340 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.875566  9119 ts_tablet_manager.cc:1434] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
W20260709 12:12:52.881244  8966 leader_election.cc:343] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.881664  8966 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.882113  9119 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:52.883668  9348 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.885510  9000 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:52.897308  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:52.906942  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:12:52.907909  8889 leader_election.cc:343] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.908772  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:52.909364  9000 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.911355  9270 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.916450  9270 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:52.917312  9270 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.908542  9433 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:52.919883  9068 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.921700  9114 ts_tablet_manager.cc:1434] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.282s	user 0.010s	sys 0.001s
I20260709 12:12:52.922648  9114 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:52.924856  9000 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:52.907595  9299 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.926476  9299 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.928617  9299 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.930258  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:52.930595  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:52.931753  9192 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.932184  9192 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:52.932862  9192 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:52.933423  9115 tablet_bootstrap.cc:654] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.934300  9141 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:52.954799  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:52.960263  8964 leader_election.cc:343] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.962013  9219 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:52.970525  8966 leader_election.cc:343] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.971686  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:52.973456  9348 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.985059  9115 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:52.985512  9115 ts_tablet_manager.cc:1403] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.006s
I20260709 12:12:52.984800  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:52.991788  8889 leader_election.cc:343] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.998009  9114 tablet_bootstrap.cc:654] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.006392  9119 tablet_bootstrap.cc:654] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.002115  8819 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.048206  9115 raft_consensus.cc:359] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.048949  9115 raft_consensus.cc:385] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.049216  9115 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.055392  9115 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.072005  9115 ts_tablet_manager.cc:1434] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.001s
I20260709 12:12:53.073102  9115 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:53.079809  8820 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.097965  9416 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.109683  9114 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.110388  9114 ts_tablet_manager.cc:1403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.038s
I20260709 12:12:53.114451  9115 tablet_bootstrap.cc:654] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.114836  9114 raft_consensus.cc:359] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.116158  9114 raft_consensus.cc:385] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.116519  9114 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.118727  9119 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.117288  9114 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.122424  9114 ts_tablet_manager.cc:1434] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:53.119164  9119 ts_tablet_manager.cc:1403] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.028s
I20260709 12:12:53.127529  9119 raft_consensus.cc:359] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.128207  9119 raft_consensus.cc:385] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.128477  9119 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.129099  9119 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.130321  9114 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.133616  9119 ts_tablet_manager.cc:1434] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:53.134927  9119 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.132475  9433 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:53.146416  9416 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.161163  9114 tablet_bootstrap.cc:654] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.163623  9115 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:53.164634  9115 ts_tablet_manager.cc:1403] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.000s
I20260709 12:12:53.167379  9115 raft_consensus.cc:359] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.168485  9115 raft_consensus.cc:385] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.168758  9115 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.169412  9115 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.171712  9115 ts_tablet_manager.cc:1434] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:53.172640  9115 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:53.176638  9119 tablet_bootstrap.cc:654] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.182358  9115 tablet_bootstrap.cc:654] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.186544  9219 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.190713  9119 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.191226  9119 ts_tablet_manager.cc:1403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.011s
I20260709 12:12:53.194026  9119 raft_consensus.cc:359] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.194777  9119 raft_consensus.cc:385] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.195044  9119 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.195696  9119 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.199126  9115 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:53.199640  9115 ts_tablet_manager.cc:1403] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:12:53.202142  9115 raft_consensus.cc:359] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.202802  9115 raft_consensus.cc:385] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.203078  9115 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.208738  9119 ts_tablet_manager.cc:1434] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:12:53.209335  9114 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.209784  9114 ts_tablet_manager.cc:1403] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.005s
I20260709 12:12:53.209403  9115 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.211524  9115 ts_tablet_manager.cc:1434] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:53.212296  9119 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.212893  9115 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Bootstrap starting.
I20260709 12:12:53.215503  9069 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.219434  9115 tablet_bootstrap.cc:654] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.220893  9119 tablet_bootstrap.cc:654] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.239970  9114 raft_consensus.cc:359] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.241122  9114 raft_consensus.cc:385] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.241520  9114 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.244772  9115 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: No bootstrap required, opened a new log
I20260709 12:12:53.245417  9115 ts_tablet_manager.cc:1403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.011s
I20260709 12:12:53.244732  9114 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.248054  9114 ts_tablet_manager.cc:1434] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 12:12:53.248020  9115 raft_consensus.cc:359] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.249828  9115 raft_consensus.cc:385] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.250114  9115 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.250774  9119 tablet_bootstrap.cc:492] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.251335  9119 ts_tablet_manager.cc:1403] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.039s	user 0.030s	sys 0.005s
I20260709 12:12:53.250895  9115 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.253836  9115 ts_tablet_manager.cc:1434] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:53.254737  9119 raft_consensus.cc:359] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.255585  9119 raft_consensus.cc:385] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.255950  9119 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.258040  9416 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:12:53.258595  9416 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.257550  9114 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.264231  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.266345  9114 tablet_bootstrap.cc:654] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.267287  9416 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.267184  9119 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.267946  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.269196  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:53.269513  9119 ts_tablet_manager.cc:1434] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:12:53.269917  9416 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:53.270437  9119 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.276618  9119 tablet_bootstrap.cc:654] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.278769  9416 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.279419  9416 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.281502  9114 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.281973  9114 ts_tablet_manager.cc:1403] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.005s
I20260709 12:12:53.284499  9114 raft_consensus.cc:359] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.285116  9114 raft_consensus.cc:385] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.285360  9114 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.286208  9114 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.286895  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.287657  9114 ts_tablet_manager.cc:1434] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:12:53.288515  9114 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.294250  9192 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.295017  9192 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.295809  9416 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.296902  9192 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.298547  9119 tablet_bootstrap.cc:492] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.299022  9119 ts_tablet_manager.cc:1403] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 12:12:53.299911  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.300519  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:53.301975  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.303206  8888 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.303378  9119 raft_consensus.cc:359] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.304092  9119 raft_consensus.cc:385] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.304374  9119 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.304576  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.305253  9068 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:53.305096  9119 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.294520  9114 tablet_bootstrap.cc:654] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.305734  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:53.306774  9416 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.306802  9339 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.309024  9339 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.309419  9339 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.310253  9119 ts_tablet_manager.cc:1434] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:12:53.311192  9119 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.316216  9339 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.317476  9119 tablet_bootstrap.cc:654] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.318313  9339 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.318912  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:53.319489  9000 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.320356  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:53.320963  9068 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.321771  9114 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.322225  9114 ts_tablet_manager.cc:1403] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:12:53.325412  9114 raft_consensus.cc:359] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.326092  9114 raft_consensus.cc:385] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.326406  9114 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.326998  9114 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.329109  9114 ts_tablet_manager.cc:1434] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:53.329984  9114 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.331984  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:53.334822  8888 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.337850  9192 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.338768  9192 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:53.339758  9192 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.346087  9114 tablet_bootstrap.cc:654] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.350347  9069 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.370378  9068 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:53.377943  9192 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.378461  9192 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.381246  9192 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.382633  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.383319  9068 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:53.383556  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.384203  8996 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:53.384589  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.385646  9192 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:53.385982  9192 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.386271  9192 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.390668  9119 tablet_bootstrap.cc:492] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.391145  9119 ts_tablet_manager.cc:1403] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.019s
I20260709 12:12:53.394042  9119 raft_consensus.cc:359] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.394690  9119 raft_consensus.cc:385] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.394960  9119 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.390864  9114 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.395731  9114 ts_tablet_manager.cc:1403] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.010s
I20260709 12:12:53.395618  9119 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.397680  9119 ts_tablet_manager.cc:1434] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:53.398550  9119 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.398676  9192 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.400396  9192 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.400170  9114 raft_consensus.cc:359] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.401108  9114 raft_consensus.cc:385] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.401459  9114 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.402184  9114 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.404469  9114 ts_tablet_manager.cc:1434] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:12:53.405182  9119 tablet_bootstrap.cc:654] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.405509  9114 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.410144  9119 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:53.410653  9119 ts_tablet_manager.cc:1403] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:12:53.454897  8820 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.503502  9114 tablet_bootstrap.cc:654] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.508761  9152 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.509729  9152 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.511518  9219 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.512499  9219 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.515215  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:53.516827  9069 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.525261  9219 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.536561  9339 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.537550  9339 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.553759  9349 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.554836  9349 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.560472  9299 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.561441  9299 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.562726  9219 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.563664  9219 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.567109  9219 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.551296  9119 raft_consensus.cc:359] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.570835  9339 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.570992  9152 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.571148  9119 raft_consensus.cc:385] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.572844  9119 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.583081  9119 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.591878  9348 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.593005  9348 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.596208  9299 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.596522  9348 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.599323  9068 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.616920  9339 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.617980  9339 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.634228  9339 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.644745  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:12:53.631348  9119 ts_tablet_manager.cc:1434] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.220s	user 0.012s	sys 0.003s
I20260709 12:12:53.645876  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:53.646765  8997 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.647781  9119 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:53.657377  9349 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.658993  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.660010  8999 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
W20260709 12:12:53.657433  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58086.3us
I20260709 12:12:53.664897  8997 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:12:53.677259  9479 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:53.677436  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.678543  8999 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:53.681286  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.670850  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.684271  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.684870  8997 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:53.688051  9114 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:53.688697  9114 ts_tablet_manager.cc:1403] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.283s	user 0.008s	sys 0.021s
I20260709 12:12:53.690624  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.692373  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.693164  8920 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:53.691905  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.688947  9069 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:53.700721  9119 tablet_bootstrap.cc:654] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.703830  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.703578  9480 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.711366  9476 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.711848  9476 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.712221  9476 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.712838  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.722030  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.722536  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.723014  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:53.722726  9073 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:53.720301  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:53.726740  8889 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.729458  9413 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.730013  9413 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.733712  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.733902  9413 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.734793  9413 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.735255  9413 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.735646  9413 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.739151  9339 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:53.739660  9339 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:53.740752  9339 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.738497  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:53.744740  9141 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.744418  9114 raft_consensus.cc:359] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.745226  9141 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.745532  9114 raft_consensus.cc:385] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.745587  9141 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.747749  9114 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.750432  9114 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.755430  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:53.756839  9219 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:53.763352  8889 leader_election.cc:343] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.772806  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.776077  9141 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.778415  9141 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.792711  9476 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.812731  9476 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.816215  9114 ts_tablet_manager.cc:1434] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.119s	user 0.005s	sys 0.003s
I20260709 12:12:53.825723  9134 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.825937  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:53.826596  8996 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.826354  9134 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:53.836903  8964 leader_election.cc:343] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.837471  8964 leader_election.cc:343] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.838184  8964 leader_election.cc:343] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.841384  9480 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.842092  9480 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.844683  9480 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.840607  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:12:53.846833  9134 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.853186  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.853853  9478 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.854105  8924 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:53.854264  9478 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.854640  9478 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.855578  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:53.858326  9413 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.861059  9114 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:53.860915  9479 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.882300  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:53.889922  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:53.891279  8922 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:53.877274  9479 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:53.875567  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:12:53.942766  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118671us
I20260709 12:12:54.130860  9479 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:53.916404  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:54.139119  8993 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:53.953433  9413 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:53.924289  9474 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.955353  9270 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.012507  9416 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:12:54.126571  9478 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.151724  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:53.954723  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.154738  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.152079  9270 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.156155  9119 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:54.156628  9119 ts_tablet_manager.cc:1403] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.509s	user 0.038s	sys 0.021s
I20260709 12:12:54.142167  9474 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.156016  9416 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.164606  8922 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:54.165125  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.151311  8996 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:54.165122  9270 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.169493  8921 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:54.171348  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.169154  8999 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:54.171988  8925 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:54.191084  9478 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.195055  9484 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.197389  9484 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.205717  9474 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.199697  9484 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.212412  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.213479  9070 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:12:54.214769  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.215559  8919 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 0.
I20260709 12:12:54.215767  9119 raft_consensus.cc:359] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.214840  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.216548  9065 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.216574  9119 raft_consensus.cc:385] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.217957  9119 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.218626  9037 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.218613  9119 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.220450  9119 ts_tablet_manager.cc:1434] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:12:54.222643  9416 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:12:54.224962  8964 leader_election.cc:343] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.235399  9492 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:54.243137  8964 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.245508  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.249663  9493 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.253558  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:54.254232  9475 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.255785  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:54.254794  9475 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.258687  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.258756  9494 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.260874  9114 tablet_bootstrap.cc:654] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.262797  9488 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:54.262036  9270 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.268729  9270 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:54.269668  9270 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.272452  8966 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.272933  9475 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.273773  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:54.274374  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.270833  9494 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.275421  9494 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.277789  9475 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.278220  9475 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.279026  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.279454  9475 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.265326  9478 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.291821  8964 leader_election.cc:343] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.295048  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.295665  9348 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.295969  8919 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:54.296128  9348 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.296602  9348 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.297863  9478 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.311321  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.311190  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.312721  9492 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:54.314189  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.324101  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:54.325583  8964 leader_election.cc:343] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.328471  8966 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.326891  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.329970  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.331058  9349 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.331530  9349 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.331910  9349 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.321544  9068 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.335434  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.336999  9478 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.321516  9494 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.336580  9066 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:54.345149  9119 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:54.336318  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.350787  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.353734  9494 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.338788  9475 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.358378  9478 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.359097  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.357926  9348 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.366532  9348 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.368695  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.361119  9119 tablet_bootstrap.cc:654] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.361756  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:54.370122  9067 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:12:54.371559  8964 leader_election.cc:343] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.371472  9478 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.372282  9478 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.372815  9478 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.374970  9067 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:54.366923  8821 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 2, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:54.377095  8966 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.377640  8966 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.379395  9348 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.379650  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:54.380316  8999 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:54.384476  9114 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:54.385159  9114 ts_tablet_manager.cc:1403] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.524s	user 0.039s	sys 0.043s
I20260709 12:12:54.392071  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:54.393316  8994 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:54.392513  8821 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.411646  9114 raft_consensus.cc:359] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:54.412089  8889 leader_election.cc:343] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.412384  9114 raft_consensus.cc:385] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.412665  9114 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.415623  9496 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:54.415853  9114 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.417124  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:12:54.419086  8889 leader_election.cc:343] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:54.422672  8889 leader_election.cc:343] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.400893  9349 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.437973  9114 ts_tablet_manager.cc:1434] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:12:54.423144  9494 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:12:54.440922  9114 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:54.427731  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:12:54.445024  8889 leader_election.cc:343] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.444870  9475 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.443130  9070 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.448412  9478 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.451817  9495 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.454068  8999 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:54.454344  9119 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:54.454880  9119 ts_tablet_manager.cc:1403] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.010s
I20260709 12:12:54.456033  9478 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.457703  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.459616  9119 raft_consensus.cc:359] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.460371  9119 raft_consensus.cc:385] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:54.460405  8964 leader_election.cc:343] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.460754  9119 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.463833  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.465533  9349 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:12:54.471773  8964 leader_election.cc:343] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.472770  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.477043  9119 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.481696  9119 ts_tablet_manager.cc:1434] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
W20260709 12:12:54.477751  9499 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.102s	user 0.005s	sys 0.000s
I20260709 12:12:54.518841  9114 tablet_bootstrap.cc:654] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.495621  8999 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:54.525405  9119 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:54.560724  9070 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:54.578534  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:54.583935  9494 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.589180  9494 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:54.590240  9494 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.586009  9495 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.592749  9495 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.598840  9495 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.602592  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:12:54.607007  8889 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.608012  9114 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:54.608598  9114 ts_tablet_manager.cc:1403] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.010s
I20260709 12:12:54.619438  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:54.620329  8999 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 1: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:12:54.632905  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.639705  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.636708  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.642693  9270 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.639642  9114 raft_consensus.cc:359] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.644055  9114 raft_consensus.cc:385] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.644320  9114 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.644433  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.645197  9141 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.634001  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:54.646718  9114 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.643220  9270 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.641822  9495 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.649444  9270 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.650643  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.652307  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.652838  8925 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.657781  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.642777  9474 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.661917  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.662173  9141 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.653486  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:54.668335  9114 ts_tablet_manager.cc:1434] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:12:54.671047  8994 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:54.667984  9339 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:12:54.696223  9119 tablet_bootstrap.cc:654] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.709264  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.711220  9477 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.711702  9477 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.712049  9477 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.704248  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:54.718899  8918 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.730158  8925 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:54.731127  8966 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.740303  9152 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:54.740638  8966 leader_election.cc:343] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.741074  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.745251  9152 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.739506  9495 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:54.795841  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52197.4us
I20260709 12:12:54.798147  9477 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.796738  9270 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.812570  9270 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.813551  8918 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:54.814985  8919 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 1: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:12:54.815835  8923 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:12:54.823983  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:54.824322  9065 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.846733  9114 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Bootstrap starting.
I20260709 12:12:54.851012  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.863474  8966 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.864764  9134 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.865314  9134 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:54.867321  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:54.864113  9524 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.871636  9119 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:54.871573  9524 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:54.866184  9134 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.872663  9524 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:54.876520  9119 ts_tablet_manager.cc:1403] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.378s	user 0.019s	sys 0.014s
I20260709 12:12:54.878983  9523 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.881913  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:54.881907  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:54.899426  8998 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.912704  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:54.916237  9152 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.916857  9152 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:12:54.937821  9152 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:54.969576  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57008.7us
I20260709 12:12:54.985989  9477 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:54.995128  9519 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.053630  9119 raft_consensus.cc:359] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.055130  9119 raft_consensus.cc:385] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.055562  9119 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.056363  9119 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.061605  9523 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:55.094714  8889 leader_election.cc:343] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.072782  8998 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:55.075589  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:55.083928  9495 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.100741  9495 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.062549  9114 tablet_bootstrap.cc:700] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Time spent opening tablet: real 0.171s	user 0.020s	sys 0.042s
I20260709 12:12:55.103803  9114 tablet_bootstrap.cc:654] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:55.104489  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.106477  9000 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:55.046847  8821 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.103055  9495 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:55.117220  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.117976  8994 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 0.
I20260709 12:12:55.125329  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:55.135035  9119 ts_tablet_manager.cc:1434] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.258s	user 0.013s	sys 0.002s
I20260709 12:12:55.135558  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:55.136366  9119 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.136533  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:12:55.139256  9474 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.139837  9114 tablet_bootstrap.cc:492] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: No bootstrap required, opened a new log
I20260709 12:12:55.139787  9474 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:55.140311  9114 ts_tablet_manager.cc:1403] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Time spent bootstrapping tablet: real 0.294s	user 0.036s	sys 0.044s
I20260709 12:12:55.140973  9495 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.141527  9495 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:55.140689  9477 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.143131  9477 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.142997  9114 raft_consensus.cc:359] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.143740  9114 raft_consensus.cc:385] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.143676  9477 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.144126  9114 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.144888  9474 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.145114  9114 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.142469  9495 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.149159  9114 ts_tablet_manager.cc:1434] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:12:55.150593  9270 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:55.159817  8889 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:55.169378  9119 tablet_bootstrap.cc:654] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:55.174986  8889 leader_election.cc:343] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.176838  8820 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.178968  8820 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.184935  8820 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.184010  9477 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.190780  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:55.192507  8998 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.200853  8998 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:12:55.203445  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:55.203667  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:12:55.204627  9474 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.205332  9474 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:12:55.206142  9493 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.206935  9477 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:12:55.206735  9493 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.206293  9474 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.209349  9493 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.210624  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.211112  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:55.211350  8998 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:55.212136  8923 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 0.
I20260709 12:12:55.213610  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:55.222533  9493 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.222978  9493 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.223567  9493 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.236534  9493 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.239923  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:55.240654  8923 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.249025  8923 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:55.250476  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:55.251493  9413 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.253335  9119 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.253865  9119 ts_tablet_manager.cc:1403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.118s	user 0.004s	sys 0.007s
I20260709 12:12:55.256996  9119 raft_consensus.cc:359] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.257704  9119 raft_consensus.cc:385] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.257988  9119 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.265003  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:12:55.270701  9119 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.279937  9413 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:55.281064  9477 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.280936  9413 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.284432  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:55.285058  8998 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:55.291208  8889 leader_election.cc:343] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.292464  9493 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.294867  8998 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
W20260709 12:12:55.305470  8889 leader_election.cc:343] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.307310  8820 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 1, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.311743  9119 ts_tablet_manager.cc:1434] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 12:12:55.312837  9119 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.318832  9119 tablet_bootstrap.cc:654] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.325901  9152 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.350045  8820 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.353873  9070 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.363407  9152 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.370996  9119 tablet_bootstrap.cc:492] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.371938  9119 ts_tablet_manager.cc:1403] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.034s
W20260709 12:12:55.373871  8964 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:55.373448  8820 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.374929  9119 raft_consensus.cc:359] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.376060  9119 raft_consensus.cc:385] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.376394  9119 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.377106  9119 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.378578  8820 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.379344  9119 ts_tablet_manager.cc:1434] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:55.380437  9119 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.385458  9540 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.386075  9540 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.390175  9540 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.397097  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:55.411883  9119 tablet_bootstrap.cc:654] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.419580  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.420704  9152 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.380355  9068 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.440464  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:55.442710  9541 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:55.462450  9119 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.462972  9119 ts_tablet_manager.cc:1403] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.012s
I20260709 12:12:55.470934  9119 raft_consensus.cc:359] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.473359  9119 raft_consensus.cc:385] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.474562  9119 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.476269  9119 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.478626  9119 ts_tablet_manager.cc:1434] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:55.479775  9119 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.482780  9522 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.491063  9119 tablet_bootstrap.cc:654] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.514431  9522 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.522190  9119 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.522820  9119 ts_tablet_manager.cc:1403] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:12:55.526175  9119 raft_consensus.cc:359] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.527042  9119 raft_consensus.cc:385] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.527401  9119 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.528225  9119 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.530881  9119 ts_tablet_manager.cc:1434] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:55.532107  9119 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.545744  9119 tablet_bootstrap.cc:654] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.572242  9495 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.599575  9119 tablet_bootstrap.cc:492] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.601461  9119 ts_tablet_manager.cc:1403] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.012s
I20260709 12:12:55.615065  9119 raft_consensus.cc:359] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:12:55.615461  8889 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:55.615840  9119 raft_consensus.cc:385] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.616199  9119 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.616977  9119 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.619401  9119 ts_tablet_manager.cc:1434] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:12:55.623041  9119 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.631459  9119 tablet_bootstrap.cc:654] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.642652  9119 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.644142  9119 ts_tablet_manager.cc:1403] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:12:55.646996  9119 raft_consensus.cc:359] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.647843  9119 raft_consensus.cc:385] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.648168  9119 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.648892  9119 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.651515  9119 ts_tablet_manager.cc:1434] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:55.652300  9119 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Bootstrap starting.
I20260709 12:12:55.658205  9119 tablet_bootstrap.cc:654] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.670204  9119 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: No bootstrap required, opened a new log
I20260709 12:12:55.670751  9119 ts_tablet_manager.cc:1403] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 12:12:55.670810  9477 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.676096  9119 raft_consensus.cc:359] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.677007  9119 raft_consensus.cc:385] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.677361  9119 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.678347  9119 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.684180  9119 ts_tablet_manager.cc:1434] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:12:55.699108  9141 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.700861  9068 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.709685  9340 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.728777  9065 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.729822  9541 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.730350  9541 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.733372  9541 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.745085  9413 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.737597  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.738550  9493 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.746589  9493 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.748672  9493 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.749846  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:55.755414  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:55.757848  9541 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.761538  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.762197  9541 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.764125  9541 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:55.768147  9541 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:55.769855  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:55.769873  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:55.772281  9040 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:55.773135  9493 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.773267  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:55.775084  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:12:55.776042  9493 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:55.778687  9477 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.793787  9541 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.826372  9068 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.846206  9070 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.996619  9068 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.150476  8871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:56.232888  9541 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.233464  9541 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:56.236204  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:12:56.236474  9541 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:56.236935  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:56.238006  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:56.240026  9541 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:56.240435  9541 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.240795  9541 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.239358  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:12:56.241739  8993 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:12:56.248302  9541 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:56.251230  9541 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:12:56.251153  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:12:56.251906  8924 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.258633  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:12:56.259660  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:12:56.260352  9541 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.261096  9541 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:12:56.261996  9541 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:12:56.251157  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:12:56.263935  8993 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.283821  8820 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 0 to 2, leader changed from <none> to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.283721  8993 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:12:56.778973  8924 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:56.780807  9541 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.781687  8994 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:56.783154  9541 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.995973  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:58.033905  9577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:58.033908  9578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:58.047081  9580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:58.051735  7716 server_base.cc:1061] running on GCE node
I20260709 12:12:58.055821  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:58.056149  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:58.056396  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599178056374 us; error 0 us; skew 500 ppm
I20260709 12:12:58.057235  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:58.067345  7716 webserver.cc:533] Webserver started at http://127.7.137.4:37139/ using document root <none> and password file <none>
I20260709 12:12:58.068626  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:58.068930  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:58.069330  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:58.071026  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-3-root/instance:
uuid: "4993160378a142a1bc21648120cbaebc"
format_stamp: "Formatted at 2026-07-09 12:12:58 on dist-test-slave-9kw9"
I20260709 12:12:58.085992  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.006s	sys 0.005s
I20260709 12:12:58.104157  9586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:58.107847  7716 fs_manager.cc:730] Time spent opening block manager: real 0.019s	user 0.003s	sys 0.010s
I20260709 12:12:58.108398  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
uuid: "4993160378a142a1bc21648120cbaebc"
format_stamp: "Formatted at 2026-07-09 12:12:58 on dist-test-slave-9kw9"
I20260709 12:12:58.108808  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:58.141163  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:58.143332  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:58.145949  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:58.149884  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:58.150216  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:58.150561  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:58.150859  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:58.316920  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.4:33071
I20260709 12:12:58.317077  9649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.4:33071 every 8 connection(s)
I20260709 12:12:58.321408  7716 auto_leader_rebalancer-test.cc:439] add a tserver: 4993160378a142a1bc21648120cbaebc
I20260709 12:12:58.349341  9650 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33577
I20260709 12:12:58.349890  9650 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:58.350708  9650 heartbeater.cc:507] Master 127.7.137.62:33577 requested a full tablet report, sending...
I20260709 12:12:58.352876  8820 ts_manager.cc:194] Registered new tserver with Master: 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:12:58.354882  8820 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52726
I20260709 12:12:59.358927  9650 heartbeater.cc:499] Master 127.7.137.62:33577 was elected leader, sending a full tablet report...
I20260709 12:12:59.535437  8916 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:12:59.545861  9070 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.548697  9659 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.548938  8993 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.550469  9641 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:59.564085  8888 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bbd74f835814289a7dddc3be9b40dbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.564282  9659 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.567531  8993 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.572810  9070 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.594429  8820 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:12:59.651892  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51880.4us
I20260709 12:12:59.697299  8998 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:12:59.707708  8923 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.720319  9070 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.722476  9573 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.727470  9661 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.780149  9523 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:12:59.791821  8963 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f774722c966e4c2b94851308244cbffd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.790956  9065 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.792744  8916 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.821022  8819 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.827625  8998 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:12:59.841481  9065 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:12:59.844385  8963 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bfeb6de89004568abc3f47eb68ee5bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.844635  9523 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.844385  8916 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.849217  9661 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.857522  9584 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.864852  9065 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.868707  8916 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.901387  8916 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:12:59.899271  8821 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:12:59.928231  8888 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c98b3fa87be744c6a1d2a811af614ebc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.929926  9065 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.930548  8994 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.932713  9656 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.934000  9495 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.959013  9659 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.970486  9068 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:12:59.976437  8994 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:00.004822  8820 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.008596  9686 ts_tablet_manager.cc:933] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:00.072481  9686 tablet_copy_client.cc:323] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:00.116004  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 6bbd74f835814289a7dddc3be9b40dbf from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:00.116685  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 6bbd74f835814289a7dddc3be9b40dbf from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-6bbd74f835814289a7dddc3be9b40dbf
I20260709 12:13:00.128086  8935 tablet_copy_source_session.cc:215] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.132907  9686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbd74f835814289a7dddc3be9b40dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.153146  9686 tablet_copy_client.cc:806] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.153842  9686 tablet_copy_client.cc:670] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.159174  9686 tablet_copy_client.cc:538] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:00.180446  9690 ts_tablet_manager.cc:933] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:00.180999  9686 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:00.230484  9690 tablet_copy_client.cc:323] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:00.262708  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet f774722c966e4c2b94851308244cbffd from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:00.263370  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet f774722c966e4c2b94851308244cbffd from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-f774722c966e4c2b94851308244cbffd
I20260709 12:13:00.270107  9686 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:00.272993  9686 tablet_bootstrap.cc:492] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:00.273721  9686 ts_tablet_manager.cc:1403] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.034s
I20260709 12:13:00.271497  9010 tablet_copy_source_session.cc:215] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.277135  9686 raft_consensus.cc:359] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:00.277803  9690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f774722c966e4c2b94851308244cbffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.278045  9686 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:00.279013  9686 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:00.364499  9696 ts_tablet_manager.cc:933] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:00.414084  9695 ts_tablet_manager.cc:933] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:00.415400  9696 tablet_copy_client.cc:323] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:00.417424  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet c98b3fa87be744c6a1d2a811af614ebc from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:00.418177  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet c98b3fa87be744c6a1d2a811af614ebc from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-c98b3fa87be744c6a1d2a811af614ebc
I20260709 12:13:00.437477  8935 tablet_copy_source_session.cc:215] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.451907  9695 tablet_copy_client.cc:323] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:00.453783  9696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b3fa87be744c6a1d2a811af614ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.454730  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 7bfeb6de89004568abc3f47eb68ee5bf from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:00.455333  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 7bfeb6de89004568abc3f47eb68ee5bf from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-7bfeb6de89004568abc3f47eb68ee5bf
I20260709 12:13:00.460523  9686 ts_tablet_manager.cc:1434] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.186s	user 0.056s	sys 0.060s
I20260709 12:13:00.452937  9690 tablet_copy_client.cc:806] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.592865  9690 tablet_copy_client.cc:670] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.603327  9010 tablet_copy_source_session.cc:215] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.640456  9624 raft_consensus.cc:1217] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.716498  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-6bbd74f835814289a7dddc3be9b40dbf received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:00.737228  9696 tablet_copy_client.cc:806] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.764531  9695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfeb6de89004568abc3f47eb68ee5bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:00.779268  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 92163.5us
I20260709 12:13:00.748082  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-6bbd74f835814289a7dddc3be9b40dbf on tablet 6bbd74f835814289a7dddc3be9b40dbf with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:00.760993  9696 tablet_copy_client.cc:670] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:00.865679  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 128394us
W20260709 12:13:00.864619  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 136189us
W20260709 12:13:00.928884  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49873.8us
W20260709 12:13:00.969777  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 85788.6us
W20260709 12:13:01.012012  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49620.6us
I20260709 12:13:01.050740  9696 tablet_copy_client.cc:538] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:01.061231  9695 tablet_copy_client.cc:806] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:01.065693  9696 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:01.061976  9695 tablet_copy_client.cc:670] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:01.122283  9690 tablet_copy_client.cc:538] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:01.131865  9690 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:01.170817  9695 tablet_copy_client.cc:538] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:01.178998  9700 raft_consensus.cc:1064] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:01.181921  9700 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:01.183868  9695 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:01.185765  9696 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.203464  9696 tablet_bootstrap.cc:492] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:01.204298  9696 ts_tablet_manager.cc:1403] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.008s
I20260709 12:13:01.216964  9696 raft_consensus.cc:359] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.221288  9624 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.226322  9065 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.234555  9714 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:01.229074  8994 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.237203  9673 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.244045  9713 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:01.250229  9696 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:01.261089  9696 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.263413  9719 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.270326  8994 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.284471  9690 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.286276  9690 tablet_bootstrap.cc:492] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:01.292168  9690 ts_tablet_manager.cc:1403] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.013s
I20260709 12:13:01.294440  8820 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.302408  9690 raft_consensus.cc:359] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.303511  9690 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:01.304340  9690 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.318703  9065 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.330381  9696 ts_tablet_manager.cc:1434] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.002s
I20260709 12:13:01.329051  9624 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.342276  9690 ts_tablet_manager.cc:1434] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.033s
I20260709 12:13:01.345921  9695 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.351168  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-c98b3fa87be744c6a1d2a811af614ebc received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:01.352435  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-c98b3fa87be744c6a1d2a811af614ebc on tablet c98b3fa87be744c6a1d2a811af614ebc with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:01.355268  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-f774722c966e4c2b94851308244cbffd received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:01.355721  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-f774722c966e4c2b94851308244cbffd on tablet f774722c966e4c2b94851308244cbffd with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:01.352562  9695 tablet_bootstrap.cc:492] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:01.358752  9695 ts_tablet_manager.cc:1403] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.175s	user 0.033s	sys 0.016s
I20260709 12:13:01.398486  9624 raft_consensus.cc:1217] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:01.396690  9695 raft_consensus.cc:359] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.408219  9695 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:01.409143  9695 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:01.412132  9695 ts_tablet_manager.cc:1434] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:13:01.416138  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-7bfeb6de89004568abc3f47eb68ee5bf received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:01.416705  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-7bfeb6de89004568abc3f47eb68ee5bf on tablet 7bfeb6de89004568abc3f47eb68ee5bf with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:01.488642  8916 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:01.502753  9069 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.504513  9624 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.511601  9713 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:01.519222  9713 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.522076  9712 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.535064  9624 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.539634  9069 raft_consensus.cc:2955] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.549116  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bbd74f835814289a7dddc3be9b40dbf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.556872  8821 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:01.576875  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bbd74f835814289a7dddc3be9b40dbf with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:01.592954  9737 tablet_replica.cc:333] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:01.600993  9737 raft_consensus.cc:2243] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.602053  9737 raft_consensus.cc:2272] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.606562  9737 ts_tablet_manager.cc:1916] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.616173  9624 raft_consensus.cc:1217] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:01.653544  9737 ts_tablet_manager.cc:1929] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.654202  9737 log.cc:1199] T 6bbd74f835814289a7dddc3be9b40dbf P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/6bbd74f835814289a7dddc3be9b40dbf
I20260709 12:13:01.656239  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 6bbd74f835814289a7dddc3be9b40dbf (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:01.955101  9624 raft_consensus.cc:1217] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:01.964246  9712 raft_consensus.cc:1064] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:01.966806  9712 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.011040  9624 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.012676  8995 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.014091  9708 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.020229  9708 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.040825  9708 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.049407  9065 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.067619  9700 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.075284  8994 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.094730  9065 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.108126  9624 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.111512  8822 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.240912  9722 raft_consensus.cc:1064] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:02.245877  9722 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.267874  9624 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.273918  9720 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:02.283151  8922 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.297116  9065 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.298530  9746 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:02.300493  9722 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.313635  9746 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.315704  8922 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.328774  9069 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.333678  9624 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.346954  8819 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.390573  8995 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.397527  9624 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.399188  9710 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:02.404956  8921 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.406471  9710 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:02.408592  9710 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.423749  8921 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.410326  9624 raft_consensus.cc:2955] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.459550  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f774722c966e4c2b94851308244cbffd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:02.467628  8820 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.480824  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet f774722c966e4c2b94851308244cbffd with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:02.483074  9751 tablet_replica.cc:333] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:02.485039  9751 raft_consensus.cc:2243] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.485977  9751 raft_consensus.cc:2272] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.490350  9751 ts_tablet_manager.cc:1916] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:02.515672  9751 ts_tablet_manager.cc:1929] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:02.516180  9751 log.cc:1199] T f774722c966e4c2b94851308244cbffd P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/f774722c966e4c2b94851308244cbffd
I20260709 12:13:02.518074  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet f774722c966e4c2b94851308244cbffd (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:02.577497  9710 raft_consensus.cc:1064] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:02.580283  9710 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.613783  9624 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.621879  9720 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.643764  9066 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.646564  8916 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:02.650323  9720 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:02.657572  9710 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:02.688694  8921 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.690438  8916 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.693640  9069 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.686336  9716 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.707211  9068 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.710613  9624 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.717988  9673 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:02.720705  8822 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.721792  9700 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:02.729251  9624 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.749631  9708 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.759685  8992 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:02.751452  9066 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:02.768636  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 52195.6us
I20260709 12:13:02.779610  9069 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.779898  9623 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:02.783661  9746 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:02.788918  9710 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:02.792415  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c98b3fa87be744c6a1d2a811af614ebc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:02.802726  9722 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.811580  9068 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.792086  9623 raft_consensus.cc:2955] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.836077  9624 raft_consensus.cc:2955] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.847898  8819 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:02.862174  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet c98b3fa87be744c6a1d2a811af614ebc with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:02.883534  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bfeb6de89004568abc3f47eb68ee5bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:02.895390  8821 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.903602  9757 tablet_replica.cc:333] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:02.916640  9757 raft_consensus.cc:2243] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.924242  9757 raft_consensus.cc:2272] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.928913  9757 ts_tablet_manager.cc:1916] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:02.959208  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfeb6de89004568abc3f47eb68ee5bf with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:02.967921  9757 ts_tablet_manager.cc:1929] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:02.969484  9757 log.cc:1199] T c98b3fa87be744c6a1d2a811af614ebc P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/c98b3fa87be744c6a1d2a811af614ebc
I20260709 12:13:02.974565  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet c98b3fa87be744c6a1d2a811af614ebc (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:02.980611  9758 tablet_replica.cc:333] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:02.981851  9758 raft_consensus.cc:2243] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.982788  9758 raft_consensus.cc:2272] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.986698  9758 ts_tablet_manager.cc:1916] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:03.006126  9758 ts_tablet_manager.cc:1929] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:03.006640  9758 log.cc:1199] T 7bfeb6de89004568abc3f47eb68ee5bf P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/7bfeb6de89004568abc3f47eb68ee5bf
I20260709 12:13:03.008411  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 7bfeb6de89004568abc3f47eb68ee5bf (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:04.053845  8995 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:04.067096  8963 consensus_peers.cc:597] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1d86a8f62c34e43b9b89b2a4a19cf2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.071772  8922 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.073683  9068 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.075546  9710 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:04.076898  9761 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:04.096158  9761 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.102013  9068 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.105922  8922 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.119688  8821 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.133859  8995 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:04.144764  8963 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4285e23e73840659806e00d6213792a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.146355  9066 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.148612  9710 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.152691  8922 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.155388  9761 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.172521  9761 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.175383  9066 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.195722  8923 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.201428  8922 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:04.215978  8888 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e24627c251054d5eb5c50b970605e2b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.217245  9066 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.223093  8992 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.230180  9764 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:04.238011  9756 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:04.271908  8822 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.278841  9068 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.276796  9756 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.293838  8992 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.300331  8819 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.320775  8992 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.328299  9068 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:04.330724  8922 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:04.330940  8963 consensus_peers.cc:597] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1231588583a41de9b59e17189e8545b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.331815  9761 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.332772  9762 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:04.351411  9710 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.358448  9068 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.359565  8922 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:04.379429  8822 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.554299  9783 ts_tablet_manager.cc:933] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:04.572300  9785 ts_tablet_manager.cc:933] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:04.578553  9783 tablet_copy_client.cc:323] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:04.581180  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:04.581914  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet c1d86a8f62c34e43b9b89b2a4a19cf2d from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-c1d86a8f62c34e43b9b89b2a4a19cf2d
I20260709 12:13:04.590464  9010 tablet_copy_source_session.cc:215] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:04.592355  9785 tablet_copy_client.cc:323] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:04.594480  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet a4285e23e73840659806e00d6213792a from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:04.595103  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet a4285e23e73840659806e00d6213792a from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-a4285e23e73840659806e00d6213792a
I20260709 12:13:04.595218  9783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.625379  9010 tablet_copy_source_session.cc:215] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:04.631769  9785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4285e23e73840659806e00d6213792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.654942  9783 tablet_copy_client.cc:806] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:04.655727  9783 tablet_copy_client.cc:670] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:04.661398  9783 tablet_copy_client.cc:538] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:04.680825  9783 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:04.688549  9785 tablet_copy_client.cc:806] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:04.689317  9785 tablet_copy_client.cc:670] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:04.693112  9785 tablet_copy_client.cc:538] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:04.704993  9785 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:04.720150  9783 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.723505  9783 tablet_bootstrap.cc:492] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:04.724354  9783 ts_tablet_manager.cc:1403] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.005s
I20260709 12:13:04.728626  9787 ts_tablet_manager.cc:933] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:04.731284  9783 raft_consensus.cc:359] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.743733  9787 tablet_copy_client.cc:323] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:04.732399  9783 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:04.749387  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet e24627c251054d5eb5c50b970605e2b5 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:04.750047  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet e24627c251054d5eb5c50b970605e2b5 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-e24627c251054d5eb5c50b970605e2b5
I20260709 12:13:04.756757  8935 tablet_copy_source_session.cc:215] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:04.760226  9787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24627c251054d5eb5c50b970605e2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.757704  9783 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.773890  9785 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.774883  9783 ts_tablet_manager.cc:1434] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.004s
I20260709 12:13:04.775092  9785 tablet_bootstrap.cc:492] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:04.776002  9785 ts_tablet_manager.cc:1403] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.005s
I20260709 12:13:04.777069  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-c1d86a8f62c34e43b9b89b2a4a19cf2d received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:04.777661  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-c1d86a8f62c34e43b9b89b2a4a19cf2d on tablet c1d86a8f62c34e43b9b89b2a4a19cf2d with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:04.778703  9787 tablet_copy_client.cc:806] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:04.780829  9787 tablet_copy_client.cc:670] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:04.780557  9785 raft_consensus.cc:359] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.781435  9785 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:04.782114  9785 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.784561  9785 ts_tablet_manager.cc:1434] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:04.794767  9787 tablet_copy_client.cc:538] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:04.804088  9792 ts_tablet_manager.cc:933] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:04.806195  9787 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:04.815436  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-a4285e23e73840659806e00d6213792a received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:04.816150  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-a4285e23e73840659806e00d6213792a on tablet a4285e23e73840659806e00d6213792a with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:04.876220  9792 tablet_copy_client.cc:323] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:04.883641  9787 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.885779  9787 tablet_bootstrap.cc:492] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:04.887697  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet d1231588583a41de9b59e17189e8545b from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:04.888345  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet d1231588583a41de9b59e17189e8545b from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-d1231588583a41de9b59e17189e8545b
I20260709 12:13:04.896467  9010 tablet_copy_source_session.cc:215] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:04.897138  9787 ts_tablet_manager.cc:1403] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.091s	user 0.030s	sys 0.031s
I20260709 12:13:04.900650  9792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1231588583a41de9b59e17189e8545b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.910763  9787 raft_consensus.cc:359] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.911849  9787 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:04.912576  9787 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.915378  9787 ts_tablet_manager.cc:1434] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:13:04.917623  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-e24627c251054d5eb5c50b970605e2b5 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:04.918071  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-e24627c251054d5eb5c50b970605e2b5 on tablet e24627c251054d5eb5c50b970605e2b5 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:04.923698  9792 tablet_copy_client.cc:806] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:04.924441  9792 tablet_copy_client.cc:670] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:04.928838  9792 tablet_copy_client.cc:538] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:04.940023  9792 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:04.963160  9792 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.964268  9792 tablet_bootstrap.cc:492] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:04.965092  9792 ts_tablet_manager.cc:1403] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.003s
I20260709 12:13:04.968387  9792 raft_consensus.cc:359] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.969316  9792 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:04.970165  9792 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:04.973215  9792 ts_tablet_manager.cc:1434] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:04.979213  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-d1231588583a41de9b59e17189e8545b received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:04.979712  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-d1231588583a41de9b59e17189e8545b on tablet d1231588583a41de9b59e17189e8545b with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:05.005800  9624 raft_consensus.cc:1217] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:05.133931  9624 raft_consensus.cc:1217] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:05.181321  9624 raft_consensus.cc:1217] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:13:05.402208  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114076us
I20260709 12:13:05.420271  9624 raft_consensus.cc:1217] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:05.503378  9722 raft_consensus.cc:1064] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:05.506402  9722 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:05.521173  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55225.7us
I20260709 12:13:05.527786  9624 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.528774  8921 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.529718  9722 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:05.531140  9761 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.552201  9068 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.554608  9761 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.556893  8923 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.560938  9710 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.569434  9624 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.577034  8822 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.588444  9065 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.638669  9722 raft_consensus.cc:1064] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:05.640712  9722 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:05.646937  8923 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.647145  9624 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.651422  9065 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.651422  9722 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:05.652550  9710 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.653322  9761 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.676651  9761 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.679214  8923 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.688210  9798 raft_consensus.cc:1064] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:05.686749  9065 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.690658  9798 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:05.728741  9624 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.745182  8820 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.803692  9624 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.805411  9802 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.806135  9068 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.807859  9802 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.823689  8995 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.825565  9803 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:05.828902  9801 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.835126  9066 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.845052  9624 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.874083  8819 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.882001  8995 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.906488  8992 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:05.915273  8922 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.916882  9761 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:05.918545  9624 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.926510  9722 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:05.926028  8923 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:05.929381  9761 raft_consensus.cc:1064] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:05.932914  9761 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:05.930111  9762 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.936233  9623 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.937510  9066 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.937992  8921 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.938964  9801 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:05.942065  9801 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:05.949474  9803 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.955850  9623 raft_consensus.cc:2955] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.959654  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4285e23e73840659806e00d6213792a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:05.965947  8819 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.967936  9624 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.975607  9066 raft_consensus.cc:2955] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:05.980377  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e24627c251054d5eb5c50b970605e2b5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:05.981659  8923 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.983361  9710 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.984249  9065 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.988145  9710 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.988826  9624 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.990899  9722 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.999011  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet a4285e23e73840659806e00d6213792a with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:06.010456  8819 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.014108  9822 tablet_replica.cc:333] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:06.015621  9822 raft_consensus.cc:2243] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.018990  9762 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.021639  9822 raft_consensus.cc:2272] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.029156  9822 ts_tablet_manager.cc:1916] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:06.040756  9623 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.045245  8923 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.050549  9066 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.064993  9822 ts_tablet_manager.cc:1929] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:06.065650  9822 log.cc:1199] T a4285e23e73840659806e00d6213792a P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/a4285e23e73840659806e00d6213792a
I20260709 12:13:06.071120  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet a4285e23e73840659806e00d6213792a (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:06.075536  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet e24627c251054d5eb5c50b970605e2b5 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:06.077216  8821 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.101732  8998 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:06.113551  9825 tablet_replica.cc:333] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:06.123819  8992 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:06.127941  9623 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:06.129541  9761 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:06.133383  9066 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:06.135159  9623 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:06.136548  9722 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:06.137883  9761 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:06.138676  9710 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.140363  9066 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:06.145891  9799 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:06.147814  9624 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.159862  9799 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.164852  9825 raft_consensus.cc:2243] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.164151  9065 raft_consensus.cc:2955] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.166019  9066 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.172173  9623 raft_consensus.cc:2955] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.177155  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1231588583a41de9b59e17189e8545b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:06.165752  9825 raft_consensus.cc:2272] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.195379  9825 ts_tablet_manager.cc:1916] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:06.197671  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:06.199332  8820 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.213758  9825 ts_tablet_manager.cc:1929] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:06.214404  9825 log.cc:1199] T e24627c251054d5eb5c50b970605e2b5 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/e24627c251054d5eb5c50b970605e2b5
I20260709 12:13:06.218588  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet e24627c251054d5eb5c50b970605e2b5 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:06.224663  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet d1231588583a41de9b59e17189e8545b with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:06.226756  9827 tablet_replica.cc:333] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:06.227967  9827 raft_consensus.cc:2243] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.231627  9827 raft_consensus.cc:2272] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.233634  8820 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:06.240244  9827 ts_tablet_manager.cc:1916] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:06.249169  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet c1d86a8f62c34e43b9b89b2a4a19cf2d with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:06.261603  9827 ts_tablet_manager.cc:1929] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:06.262068  9827 log.cc:1199] T d1231588583a41de9b59e17189e8545b P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/d1231588583a41de9b59e17189e8545b
I20260709 12:13:06.263926  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet d1231588583a41de9b59e17189e8545b (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:06.264106  9827 tablet_replica.cc:333] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:06.265050  9827 raft_consensus.cc:2243] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.265651  9827 raft_consensus.cc:2272] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.268689  9827 ts_tablet_manager.cc:1916] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:06.282310  9827 ts_tablet_manager.cc:1929] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:06.282820  9827 log.cc:1199] T c1d86a8f62c34e43b9b89b2a4a19cf2d P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/c1d86a8f62c34e43b9b89b2a4a19cf2d
I20260709 12:13:06.284511  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet c1d86a8f62c34e43b9b89b2a4a19cf2d (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:07.460466  8923 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:07.712947  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 285594us
W20260709 12:13:07.723829  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 310943us
W20260709 12:13:07.816174  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82339us
W20260709 12:13:07.824954  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 76372.4us
W20260709 12:13:07.890193  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47284.1us
W20260709 12:13:07.894408  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55462.1us
I20260709 12:13:07.914831  9070 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.939337  8991 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.961032  9846 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:07.988601  8888 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db8cdabd573f46e28a22e367d9de5201. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.993273  9847 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.999534  9846 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.001535  9065 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.026612  8921 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.026381  8819 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.049585  8997 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:08.066063  8888 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 023d28c087e64377a9e2790180949da6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.069765  9065 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.073179  8991 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.074426  9839 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:08.078019  9835 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.108736  9072 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.113387  8995 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.101949  9846 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.127887  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.135100  8995 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:08.155100  8963 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22ba05ad5deb4210a163e266631b3e67. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.156315  9065 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.158505  9841 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.160185  8923 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.163661  9722 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.175141  9830 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.181818  8923 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.182266  9072 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.194705  8924 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.197289  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.220774  8995 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:08.223393  8888 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 309f8de493054d15b198c2f7ddeb70b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.224896  9845 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.236922  9065 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:08.239975  9846 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.280560  9846 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.281978  9066 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.296921  9863 ts_tablet_manager.cc:933] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:08.308552  8997 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.328778  8821 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:08.342926  9863 tablet_copy_client.cc:323] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:08.344839  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet db8cdabd573f46e28a22e367d9de5201 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:08.345402  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet db8cdabd573f46e28a22e367d9de5201 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-db8cdabd573f46e28a22e367d9de5201
I20260709 12:13:08.353201  8935 tablet_copy_source_session.cc:215] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:08.358779  9863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8cdabd573f46e28a22e367d9de5201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.376436  9863 tablet_copy_client.cc:806] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:08.380132  9863 tablet_copy_client.cc:670] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:08.384277  9863 tablet_copy_client.cc:538] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:08.395987  9863 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:08.413136  9863 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.413865  9863 tablet_bootstrap.cc:492] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:08.414428  9863 ts_tablet_manager.cc:1403] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:13:08.416821  9863 raft_consensus.cc:359] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.417444  9863 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:08.417980  9863 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.422232  9863 ts_tablet_manager.cc:1434] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:13:08.424024  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-db8cdabd573f46e28a22e367d9de5201 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:08.424434  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-db8cdabd573f46e28a22e367d9de5201 on tablet db8cdabd573f46e28a22e367d9de5201 with peer 4993160378a142a1bc21648120cbaebc
W20260709 12:13:08.438269  9095 debug-util.cc:398] Leaking SignalData structure 0x7b0800125820 after lost signal to thread 7719
W20260709 12:13:08.439268  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5aa0 after lost signal to thread 8857
W20260709 12:13:08.440218  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08002f29c0 after lost signal to thread 8949
W20260709 12:13:08.441227  9095 debug-util.cc:398] Leaking SignalData structure 0x7b0800321100 after lost signal to thread 9024
W20260709 12:13:08.442226  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08002edee0 after lost signal to thread 9098
W20260709 12:13:08.443306  9095 debug-util.cc:398] Leaking SignalData structure 0x7b0800278060 after lost signal to thread 9649
I20260709 12:13:08.543308  9863 ts_tablet_manager.cc:933] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:08.552953  9863 tablet_copy_client.cc:323] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:08.564203  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 22ba05ad5deb4210a163e266631b3e67 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:08.564875  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 22ba05ad5deb4210a163e266631b3e67 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-22ba05ad5deb4210a163e266631b3e67
I20260709 12:13:08.576517  9010 tablet_copy_source_session.cc:215] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:08.584196  9863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ba05ad5deb4210a163e266631b3e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.607204  9863 tablet_copy_client.cc:806] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:08.608378  9863 tablet_copy_client.cc:670] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:08.612867  9863 tablet_copy_client.cc:538] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:08.620735  9868 ts_tablet_manager.cc:933] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
W20260709 12:13:08.622239  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002b4220 after lost signal to thread 7719
W20260709 12:13:08.623313  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800162080 after lost signal to thread 8857
W20260709 12:13:08.624446  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800313f80 after lost signal to thread 8949
W20260709 12:13:08.625486  9646 debug-util.cc:398] Leaking SignalData structure 0x7b080028e3c0 after lost signal to thread 9024
W20260709 12:13:08.626497  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002efe40 after lost signal to thread 9098
I20260709 12:13:08.626595  9863 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
W20260709 12:13:08.627700  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe220 after lost signal to thread 9649
I20260709 12:13:08.636047  9868 tablet_copy_client.cc:323] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:08.646574  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 023d28c087e64377a9e2790180949da6 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:08.647115  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 023d28c087e64377a9e2790180949da6 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-023d28c087e64377a9e2790180949da6
I20260709 12:13:08.654793  8935 tablet_copy_source_session.cc:215] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:08.662091  9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023d28c087e64377a9e2790180949da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.687378  9863 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.688443  9863 tablet_bootstrap.cc:492] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:08.689214  9863 ts_tablet_manager.cc:1403] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.008s
I20260709 12:13:08.692606  9863 raft_consensus.cc:359] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.693529  9863 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:08.694237  9863 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.702148  9868 tablet_copy_client.cc:806] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:08.704237  9871 ts_tablet_manager.cc:933] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:08.707075  9868 tablet_copy_client.cc:670] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:08.709807  9871 tablet_copy_client.cc:323] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:08.713075  9868 tablet_copy_client.cc:538] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:08.717085  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 309f8de493054d15b198c2f7ddeb70b4 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:08.717661  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 309f8de493054d15b198c2f7ddeb70b4 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-309f8de493054d15b198c2f7ddeb70b4
I20260709 12:13:08.725538  8935 tablet_copy_source_session.cc:215] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:08.726646  9863 ts_tablet_manager.cc:1434] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:13:08.731423  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8de493054d15b198c2f7ddeb70b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.732780  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-22ba05ad5deb4210a163e266631b3e67 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:08.733304  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-22ba05ad5deb4210a163e266631b3e67 on tablet 22ba05ad5deb4210a163e266631b3e67 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:08.728000  9868 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:08.779971  9623 raft_consensus.cc:1217] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:08.838853  9871 tablet_copy_client.cc:806] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:08.839576  9871 tablet_copy_client.cc:670] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:08.843684  9871 tablet_copy_client.cc:538] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:08.851135  9868 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.852488  9868 tablet_bootstrap.cc:492] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:08.853555  9868 ts_tablet_manager.cc:1403] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.013s
I20260709 12:13:08.856741  9868 raft_consensus.cc:359] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.863090  9868 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:08.863865  9868 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.879365  9868 ts_tablet_manager.cc:1434] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:13:08.882401  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-023d28c087e64377a9e2790180949da6 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:08.882880  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-023d28c087e64377a9e2790180949da6 on tablet 023d28c087e64377a9e2790180949da6 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:08.885481  9871 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:08.949436  9871 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.950440  9871 tablet_bootstrap.cc:492] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:08.951296  9871 ts_tablet_manager.cc:1403] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.000s
I20260709 12:13:08.954653  9871 raft_consensus.cc:359] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.957193  9871 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:08.957926  9871 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:08.969280  9871 ts_tablet_manager.cc:1434] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:09.000389  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-309f8de493054d15b198c2f7ddeb70b4 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:09.000909  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-309f8de493054d15b198c2f7ddeb70b4 on tablet 309f8de493054d15b198c2f7ddeb70b4 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:09.009820  9623 raft_consensus.cc:1217] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.091218  9623 raft_consensus.cc:1217] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.138724  9623 raft_consensus.cc:1217] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:09.369266  9845 raft_consensus.cc:1064] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:09.372437  9845 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.417711  8995 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.420303  9623 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.420213  9846 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.423671  9845 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:09.468106  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61608.5us
I20260709 12:13:09.469504  9830 raft_consensus.cc:1064] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:09.470194  9066 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.472704  9830 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.493714  9847 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:09.507561  9839 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.510193  9623 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.511667  9880 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.519021  8995 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.523136  9071 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.526736  9841 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:09.532773  9845 raft_consensus.cc:1064] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:09.537957  9845 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.540028  8923 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.542662  9880 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.561525  8820 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.583455  9623 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.585237  9845 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.585675  8995 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.590607  9846 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.603659  9830 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.606734  9622 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.608269  9071 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.630688  9066 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.636101  9624 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.624236  9839 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:13:09.673970  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:09.709554  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88378.5us
I20260709 12:13:09.724457  8997 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.733312  9893 raft_consensus.cc:1064] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
W20260709 12:13:09.736426  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.741739  8923 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:09.781481  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 61235.8us
I20260709 12:13:09.785914  9893 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:09.791740  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 99809.1us
I20260709 12:13:09.797577  9846 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.793385  9066 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.825323  8923 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.854732  9624 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.856745  9895 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.859655  8820 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:09.872201  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 110829us
I20260709 12:13:09.887373  9069 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.890451  9624 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.894856  9622 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.909373  9846 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.924227  8821 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.931778  8997 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.937508  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet db8cdabd573f46e28a22e367d9de5201 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:09.940124  9621 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.944655  9844 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:09.945684  9069 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.949177  9903 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:09.964174  9906 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.972082  8991 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.978631  9622 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.983273  8923 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:09.983899  9066 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.983462  9622 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:09.988046  9894 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:09.989674  9839 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:09.992813  9909 tablet_replica.cc:333] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:09.994024  9909 raft_consensus.cc:2243] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.994752  9909 raft_consensus.cc:2272] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.994033  9624 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.995916  9067 raft_consensus.cc:2955] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.014097  9069 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.004253  9839 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:13:10.033560  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db8cdabd573f46e28a22e367d9de5201 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.038784  9877 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:10.041477  8819 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.045825  9845 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.048834  9071 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.077615  9909 ts_tablet_manager.cc:1916] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.085466  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 22ba05ad5deb4210a163e266631b3e67 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:10.088577  8993 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:10.093448  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 023d28c087e64377a9e2790180949da6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.099834  9896 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.105778  9847 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.105088  9622 raft_consensus.cc:2955] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.111084  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.120029  9912 tablet_replica.cc:333] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:10.120622  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22ba05ad5deb4210a163e266631b3e67 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.136914  9072 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.139859  9912 raft_consensus.cc:2243] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.144953  9895 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:10.156695  9912 raft_consensus.cc:2272] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.162379  8821 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.164892  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 023d28c087e64377a9e2790180949da6 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:10.170509  9909 ts_tablet_manager.cc:1929] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.171006  9909 log.cc:1199] T db8cdabd573f46e28a22e367d9de5201 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/db8cdabd573f46e28a22e367d9de5201
I20260709 12:13:10.181571  8991 raft_consensus.cc:2955] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.179143  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet db8cdabd573f46e28a22e367d9de5201 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:10.196893  9913 tablet_replica.cc:333] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:10.201448  9622 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.199206  9912 ts_tablet_manager.cc:1916] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.229430  9913 raft_consensus.cc:2243] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.230260  9913 raft_consensus.cc:2272] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.230429  8995 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.233500  9913 ts_tablet_manager.cc:1916] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:10.267556  9912 ts_tablet_manager.cc:1929] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.269403  9912 log.cc:1199] T 22ba05ad5deb4210a163e266631b3e67 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/22ba05ad5deb4210a163e266631b3e67
I20260709 12:13:10.271215  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 22ba05ad5deb4210a163e266631b3e67 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:10.311364  9913 ts_tablet_manager.cc:1929] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:10.312054  9913 log.cc:1199] T 023d28c087e64377a9e2790180949da6 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/023d28c087e64377a9e2790180949da6
I20260709 12:13:10.314014  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 023d28c087e64377a9e2790180949da6 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:10.777595  8924 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:10.792806  9622 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.798441  8991 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:10.800861  9917 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.802930  9921 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:10.824458  9919 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.835659  8991 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.861466  9624 raft_consensus.cc:2955] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:10.877194  8819 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.910118  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 309f8de493054d15b198c2f7ddeb70b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:10.995299  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 309f8de493054d15b198c2f7ddeb70b4 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:11.006561  9926 tablet_replica.cc:333] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:11.007727  9926 raft_consensus.cc:2243] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.008540  9926 raft_consensus.cc:2272] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.018004  9926 ts_tablet_manager.cc:1916] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.037513  9926 ts_tablet_manager.cc:1929] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.037981  9926 log.cc:1199] T 309f8de493054d15b198c2f7ddeb70b4 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/309f8de493054d15b198c2f7ddeb70b4
I20260709 12:13:11.040689  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 309f8de493054d15b198c2f7ddeb70b4 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
W20260709 12:13:11.283864  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60149.4us
I20260709 12:13:12.202126  8991 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:12.225755  8963 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c47609ef9e5d4514945afe81e24e790d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.228103  9071 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.228482  8924 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.230376  9928 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:12.231554  9930 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:12.269556  9931 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.271466  8922 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.306113  9072 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.311626  8991 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:12.338321  8820 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:12.356734  8963 consensus_peers.cc:597] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae12ea4362164b50bece754b6f6bd834. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.359586  9072 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.359834  8924 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.360913  9931 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.361795  9928 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.408449  9904 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.436275  9067 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.440498  8922 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.471107  8924 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:12.486290  8821 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.522387  9067 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:12.524469  8888 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4eae6c679d7f4d4a9422d66f842d1d7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.526401  8991 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.527189  9896 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.530980  9921 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:12.547874  9896 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.549599  9069 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.569222  8991 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.573731  8821 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.594197  8922 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:12.618124  8888 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d1d6970fddb4442a12d0adcf1a1980b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.620754  9069 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.622973  9917 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.630746  8991 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.632603  9917 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:13:12.642215  9917 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.644672  9069 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.673867  8821 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.686817  8991 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:12.811990  9952 ts_tablet_manager.cc:933] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:12.831646  9952 tablet_copy_client.cc:323] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:12.833626  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet c47609ef9e5d4514945afe81e24e790d from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:12.834280  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet c47609ef9e5d4514945afe81e24e790d from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-c47609ef9e5d4514945afe81e24e790d
I20260709 12:13:12.866089  9954 ts_tablet_manager.cc:933] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:12.867834  9010 tablet_copy_source_session.cc:215] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.875425  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47609ef9e5d4514945afe81e24e790d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.883713  9954 tablet_copy_client.cc:323] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:12.897403  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet ae12ea4362164b50bece754b6f6bd834 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:12.898079  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet ae12ea4362164b50bece754b6f6bd834 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-ae12ea4362164b50bece754b6f6bd834
I20260709 12:13:12.955072  9010 tablet_copy_source_session.cc:215] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.046288  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae12ea4362164b50bece754b6f6bd834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.071029  9956 ts_tablet_manager.cc:933] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:13.075105  9952 tablet_copy_client.cc:806] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.079457  9952 tablet_copy_client.cc:670] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.083278  9952 tablet_copy_client.cc:538] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.089781  9956 tablet_copy_client.cc:323] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:13.097812  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 4eae6c679d7f4d4a9422d66f842d1d7d from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:13.098438  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 4eae6c679d7f4d4a9422d66f842d1d7d from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-4eae6c679d7f4d4a9422d66f842d1d7d
I20260709 12:13:13.106225  8935 tablet_copy_source_session.cc:215] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.128311  9956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eae6c679d7f4d4a9422d66f842d1d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.132144  9952 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:13.132941  9954 tablet_copy_client.cc:806] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.133574  9954 tablet_copy_client.cc:670] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.153179  9954 tablet_copy_client.cc:538] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.160701  9956 tablet_copy_client.cc:806] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.163650  9956 tablet_copy_client.cc:670] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.171859  9956 tablet_copy_client.cc:538] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.172645  9958 ts_tablet_manager.cc:933] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:13.191344  9952 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.191805  9956 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:13.192341  9952 tablet_bootstrap.cc:492] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:13.193153  9952 ts_tablet_manager.cc:1403] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.014s
I20260709 12:13:13.204658  9954 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:13.209021  9958 tablet_copy_client.cc:323] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:13.211651  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 2d1d6970fddb4442a12d0adcf1a1980b from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:13.212209  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 2d1d6970fddb4442a12d0adcf1a1980b from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-2d1d6970fddb4442a12d0adcf1a1980b
I20260709 12:13:13.223277  9952 raft_consensus.cc:359] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.224254  9952 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:13.224936  9952 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.228713  8935 tablet_copy_source_session.cc:215] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.241233  9958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d6970fddb4442a12d0adcf1a1980b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.260815  9952 ts_tablet_manager.cc:1434] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 12:13:13.266007  9956 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.266999  9956 tablet_bootstrap.cc:492] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:13.267735  9956 ts_tablet_manager.cc:1403] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.001s
I20260709 12:13:13.268416  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-c47609ef9e5d4514945afe81e24e790d received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:13.268874  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-c47609ef9e5d4514945afe81e24e790d on tablet c47609ef9e5d4514945afe81e24e790d with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:13.270704  9956 raft_consensus.cc:359] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.288558  9954 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.281682  9956 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:13.289580  9954 tablet_bootstrap.cc:492] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:13.290349  9954 ts_tablet_manager.cc:1403] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.005s
I20260709 12:13:13.291148  9958 tablet_copy_client.cc:806] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.291731  9958 tablet_copy_client.cc:670] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.293778  9954 raft_consensus.cc:359] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.294678  9954 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:13.295433  9954 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.289795  9956 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.300866  9956 ts_tablet_manager.cc:1434] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:13:13.304203  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-4eae6c679d7f4d4a9422d66f842d1d7d received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:13.304643  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-4eae6c679d7f4d4a9422d66f842d1d7d on tablet 4eae6c679d7f4d4a9422d66f842d1d7d with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:13.308074  9954 ts_tablet_manager.cc:1434] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 12:13:13.308450  9958 tablet_copy_client.cc:538] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.311583  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-ae12ea4362164b50bece754b6f6bd834 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:13.312109  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-ae12ea4362164b50bece754b6f6bd834 on tablet ae12ea4362164b50bece754b6f6bd834 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:13.327227  9958 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:13.363839  9622 raft_consensus.cc:1217] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.409533  9622 raft_consensus.cc:1217] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.524796  9958 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.525861  9958 tablet_bootstrap.cc:492] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:13.526645  9958 ts_tablet_manager.cc:1403] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.200s	user 0.061s	sys 0.043s
I20260709 12:13:13.536182  9958 raft_consensus.cc:359] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.537142  9958 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:13.537889  9958 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:13.541260  9958 ts_tablet_manager.cc:1434] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 12:13:13.545984  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-2d1d6970fddb4442a12d0adcf1a1980b received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:13.546418  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-2d1d6970fddb4442a12d0adcf1a1980b on tablet 2d1d6970fddb4442a12d0adcf1a1980b with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:13.616892  9622 raft_consensus.cc:1217] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.631845  9622 raft_consensus.cc:1217] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.816203  9930 raft_consensus.cc:1064] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:13.848023  9930 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:13.926092  9967 raft_consensus.cc:1064] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:13.927374  9622 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.934468  9904 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:13.952632  9069 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.957381  9904 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:13.988278  8922 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.992259  9967 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.043443  9942 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:14.101791  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58914.2us
W20260709 12:13:14.107887  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58350.8us
W20260709 12:13:14.124538  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82307.8us
I20260709 12:13:14.126822  9976 raft_consensus.cc:1064] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:14.137250  9622 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.141422  9976 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.143110  9928 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.179827  8922 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.183377  9930 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.198239  9069 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:13:14.225684  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77553.3us
I20260709 12:13:14.229408  9622 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.232901  8997 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.244881  9069 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.268631  9974 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.281756  9917 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.289499  9072 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.299695  9928 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.301424  9917 raft_consensus.cc:1064] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:14.304692  9917 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.312693  9896 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.340400  9624 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.348265  8924 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.355340  8821 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.364913  9896 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.397900  9072 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.416360  9969 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.420192  9942 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.424919  8922 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.462092  9623 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.464571  8993 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.484014  9917 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.491629  9977 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.497433  9067 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.501377  9976 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:14.506809  9623 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:14.511207  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71272.9us
I20260709 12:13:14.516515  9622 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.542562  8991 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.562063  9072 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.575197  9977 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.588516  9067 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.592142  8991 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.602602  9621 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.654922  8822 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.656688  8991 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.674345  9622 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.676868  9942 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.688457  8922 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.670892  8822 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.692191  9930 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.708523  9942 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.714730  9622 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.716609  8921 raft_consensus.cc:2955] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.721040  8820 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.751601  8823 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.759150  8921 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.770907  8922 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.777643  8991 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.779172  9896 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.779841  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet c47609ef9e5d4514945afe81e24e790d with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:14.784569  9621 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.788383  9067 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.788658  9896 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.791095  9622 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.790593  9977 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.793812  9917 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.795410  9969 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.798874  8991 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:14.803763  8997 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.808828  9623 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.798558  9896 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.814384  9069 raft_consensus.cc:2955] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.823161  9624 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.824957  9973 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:14.828275  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d1d6970fddb4442a12d0adcf1a1980b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.839800  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c47609ef9e5d4514945afe81e24e790d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.843204  9928 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.814412  9621 raft_consensus.cc:2955] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.856067  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4eae6c679d7f4d4a9422d66f842d1d7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.858803  8823 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.861240  8821 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.871201  9067 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.872736  9930 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:14.873852  9996 tablet_replica.cc:333] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:14.875082  9996 raft_consensus.cc:2243] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.875903  9996 raft_consensus.cc:2272] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.880366  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 4eae6c679d7f4d4a9422d66f842d1d7d with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:14.888715  9067 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.891515  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1d6970fddb4442a12d0adcf1a1980b with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:14.898314  9623 raft_consensus.cc:2955] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.912266  9997 tablet_replica.cc:333] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:14.913793  9997 raft_consensus.cc:2243] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.914642  9997 raft_consensus.cc:2272] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.931761  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae12ea4362164b50bece754b6f6bd834 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.946076  9997 ts_tablet_manager.cc:1916] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.947804  9996 ts_tablet_manager.cc:1916] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.961838  8820 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:14.991693  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet ae12ea4362164b50bece754b6f6bd834 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:14.998963  9997 ts_tablet_manager.cc:1929] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.999675  9997 log.cc:1199] T 4eae6c679d7f4d4a9422d66f842d1d7d P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/4eae6c679d7f4d4a9422d66f842d1d7d
I20260709 12:13:15.002517  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 4eae6c679d7f4d4a9422d66f842d1d7d (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:15.004997  9998 tablet_replica.cc:333] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:15.006512  9998 raft_consensus.cc:2243] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.007540  9998 raft_consensus.cc:2272] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.011296  9996 ts_tablet_manager.cc:1929] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.011798  9996 log.cc:1199] T c47609ef9e5d4514945afe81e24e790d P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/c47609ef9e5d4514945afe81e24e790d
I20260709 12:13:15.011942  9998 ts_tablet_manager.cc:1916] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.013921  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet c47609ef9e5d4514945afe81e24e790d (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:15.015102  9996 tablet_replica.cc:333] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:15.016841  9996 raft_consensus.cc:2243] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.017621  9996 raft_consensus.cc:2272] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.020892  9996 ts_tablet_manager.cc:1916] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.032015  9998 ts_tablet_manager.cc:1929] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.032680  9998 log.cc:1199] T ae12ea4362164b50bece754b6f6bd834 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/ae12ea4362164b50bece754b6f6bd834
I20260709 12:13:15.035758  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet ae12ea4362164b50bece754b6f6bd834 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:15.051033  9996 ts_tablet_manager.cc:1929] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.051595  9996 log.cc:1199] T 2d1d6970fddb4442a12d0adcf1a1980b P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/2d1d6970fddb4442a12d0adcf1a1980b
I20260709 12:13:15.053165  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 2d1d6970fddb4442a12d0adcf1a1980b (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:16.113991  8922 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:16.134861  9066 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.154145  8888 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f04df98e77b4f7a85750662c7bcaf22. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.164013  8997 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.169633  9976 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.174021  9921 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.225842  9977 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.255441  9067 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.257038  8997 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:16.262153  8991 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:16.291731  8963 consensus_peers.cc:597] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d8a12b09f964de2b0eb86fb75bdbfd0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.294025  9072 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.295708  8921 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.298808  9974 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.304495 10001 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:16.313071  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48185.6us
I20260709 12:13:16.338016  8819 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.376996  9928 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.382539  9069 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.391436  8922 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.453897  8820 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.489398  9067 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:16.500519  8922 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.502933  9951 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.518891  9988 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.521055  8924 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:16.547138  8821 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.762511  8924 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:16.805684  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 83916.6us
I20260709 12:13:16.845568  8995 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.859545  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75496.8us
I20260709 12:13:16.885857 10022 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:13:16.930123 10028 ts_tablet_manager.cc:933] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
W20260709 12:13:16.967164  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81948.3us
I20260709 12:13:16.974501 10028 tablet_copy_client.cc:323] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
W20260709 12:13:16.976974  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 85119.5us
I20260709 12:13:16.979749  8997 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.983222  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 3f04df98e77b4f7a85750662c7bcaf22 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:16.983881  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 3f04df98e77b4f7a85750662c7bcaf22 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-3f04df98e77b4f7a85750662c7bcaf22
I20260709 12:13:16.994735  9067 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.996018 10043 ts_tablet_manager.cc:933] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:17.002759 10020 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:17.004809  8935 tablet_copy_source_session.cc:215] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:17.012877  8888 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 030add77af8944519fa93baf328b3e4a. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:16.997604  9037 consensus_peers.cc:597] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8552a23b53d0499abefc4f4a5af10c93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.022763 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f04df98e77b4f7a85750662c7bcaf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.024624  8997 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:17.035115 10043 tablet_copy_client.cc:323] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:17.039182  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:17.040014  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-1d8a12b09f964de2b0eb86fb75bdbfd0
I20260709 12:13:17.039404 10041 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:13:17.054282 10028 tablet_copy_client.cc:806] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.054966 10028 tablet_copy_client.cc:670] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.059576 10039 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:17.061515  8997 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:17.064006  9010 tablet_copy_source_session.cc:215] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.068395 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.081884 10028 tablet_copy_client.cc:538] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.084908 10043 tablet_copy_client.cc:806] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.085493 10043 tablet_copy_client.cc:670] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.084367  8819 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:17.091673 10043 tablet_copy_client.cc:538] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.093189 10028 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:17.107378 10043 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:17.109236  9066 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:17.178318 10028 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.179307 10028 tablet_bootstrap.cc:492] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:17.180073 10028 ts_tablet_manager.cc:1403] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.002s
I20260709 12:13:17.185807 10028 raft_consensus.cc:359] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.186935 10028 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:17.187695 10028 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.199360 10043 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.206149 10043 tablet_bootstrap.cc:492] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:17.207258 10043 ts_tablet_manager.cc:1403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.010s
I20260709 12:13:17.211403 10043 raft_consensus.cc:359] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.215407 10028 ts_tablet_manager.cc:1434] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.010s
I20260709 12:13:17.213783 10043 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:17.216449 10043 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.219636 10043 ts_tablet_manager.cc:1434] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:17.220285  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-3f04df98e77b4f7a85750662c7bcaf22 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:17.221282  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-3f04df98e77b4f7a85750662c7bcaf22 on tablet 3f04df98e77b4f7a85750662c7bcaf22 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:17.222580  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-1d8a12b09f964de2b0eb86fb75bdbfd0 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:17.223043  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-1d8a12b09f964de2b0eb86fb75bdbfd0 on tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:17.455818 10028 ts_tablet_manager.cc:933] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:17.457581 10028 tablet_copy_client.cc:323] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:17.468863  9084 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 8552a23b53d0499abefc4f4a5af10c93 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:17.469403  9084 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 8552a23b53d0499abefc4f4a5af10c93 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-8552a23b53d0499abefc4f4a5af10c93
I20260709 12:13:17.479502  9084 tablet_copy_source_session.cc:215] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.482550 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8552a23b53d0499abefc4f4a5af10c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.497211 10028 tablet_copy_client.cc:806] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.497983 10028 tablet_copy_client.cc:670] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.502293 10028 tablet_copy_client.cc:538] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.511638 10028 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:17.534507  9621 raft_consensus.cc:1217] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.542181 10028 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.543318 10028 tablet_bootstrap.cc:492] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:17.544423 10028 ts_tablet_manager.cc:1403] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 12:13:17.545969 10043 ts_tablet_manager.cc:933] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:17.547958 10028 raft_consensus.cc:359] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.548930 10028 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:17.549638 10028 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.554548 10028 ts_tablet_manager.cc:1434] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:17.559192  9084 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-8552a23b53d0499abefc4f4a5af10c93 received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:17.559703  9084 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-8552a23b53d0499abefc4f4a5af10c93 on tablet 8552a23b53d0499abefc4f4a5af10c93 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:17.583016 10043 tablet_copy_client.cc:323] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:17.585419  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 030add77af8944519fa93baf328b3e4a from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:17.585979  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 030add77af8944519fa93baf328b3e4a from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-030add77af8944519fa93baf328b3e4a
I20260709 12:13:17.593669  8935 tablet_copy_source_session.cc:215] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.597203 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030add77af8944519fa93baf328b3e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.610535 10043 tablet_copy_client.cc:806] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.611151 10043 tablet_copy_client.cc:670] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.614743 10043 tablet_copy_client.cc:538] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.623785 10043 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:17.645289 10043 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.646085 10043 tablet_bootstrap.cc:492] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:17.646775 10043 ts_tablet_manager.cc:1403] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.009s
I20260709 12:13:17.649577 10043 raft_consensus.cc:359] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.650193 10043 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:17.650702 10043 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:17.654827 10043 ts_tablet_manager.cc:1434] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:13:17.656453  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-030add77af8944519fa93baf328b3e4a received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:17.656808  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-030add77af8944519fa93baf328b3e4a on tablet 030add77af8944519fa93baf328b3e4a with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:17.717770  9621 raft_consensus.cc:1217] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.982055  9621 raft_consensus.cc:1217] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:18.144369  9928 raft_consensus.cc:1064] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:18.146929  9928 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.160809  9621 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.161101  9067 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.165333 10060 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.166725  9621 raft_consensus.cc:1217] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:18.168627  8924 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.171627 10026 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.179324  9974 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.191895  9974 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.193480  9067 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.201190  8916 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.205394  9622 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.223040  8821 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.270418 10020 raft_consensus.cc:1064] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:18.273123 10020 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.277909  8997 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.291071  9067 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.292856  9622 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.294428  9974 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.296190  9974 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.303710 10058 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.307354  9621 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.308622  9067 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.309842  8997 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.312213 10039 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.314997 10039 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.317026  9621 raft_consensus.cc:2955] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.329026  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:13:18.332500  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44999.6us
I20260709 12:13:18.337383  9066 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.334915  8820 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.353339 10041 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.368140  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:18.436877 10075 tablet_replica.cc:333] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:18.440964 10039 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.445519 10075 raft_consensus.cc:2243] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.446516 10075 raft_consensus.cc:2272] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.449714  9623 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.455118 10075 ts_tablet_manager.cc:1916] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.464665  8991 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.465387  8823 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.493127  9066 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.507701  8923 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.511407 10075 ts_tablet_manager.cc:1929] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.511969 10075 log.cc:1199] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/1d8a12b09f964de2b0eb86fb75bdbfd0
I20260709 12:13:18.513972  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 1d8a12b09f964de2b0eb86fb75bdbfd0 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:18.517666  9622 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.518953  9066 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.519184 10039 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:18.521842 10039 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.528384 10041 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.537009  9066 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.540592  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f04df98e77b4f7a85750662c7bcaf22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.543588  9622 raft_consensus.cc:2955] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.548116  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.564162 10078 raft_consensus.cc:1064] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:18.568476  8819 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.569396 10078 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.590086  9622 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.590528  8991 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.592144 10078 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.592933  8923 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.595518 10057 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.597354 10078 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.600610  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f04df98e77b4f7a85750662c7bcaf22 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:18.623764 10082 tablet_replica.cc:333] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:18.625551 10082 raft_consensus.cc:2243] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.626890 10082 raft_consensus.cc:2272] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.627739 10057 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.629701  8923 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.631922  9622 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.641806 10082 ts_tablet_manager.cc:1916] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.657747  8820 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.676235  8991 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.704838 10082 ts_tablet_manager.cc:1929] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.705482 10082 log.cc:1199] T 3f04df98e77b4f7a85750662c7bcaf22 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/3f04df98e77b4f7a85750662c7bcaf22
I20260709 12:13:18.707376  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 3f04df98e77b4f7a85750662c7bcaf22 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:18.709784 10020 raft_consensus.cc:1064] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:18.713330 10020 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.721592  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:18.722312  8991 raft_consensus.cc:606] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:18.725620  9067 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.728948  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:18.729552  8991 raft_consensus.cc:606] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:18.731981  8997 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.733708  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:18.734228  8997 raft_consensus.cc:606] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:18.735414 10078 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.744427  9622 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.746170 10078 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.764206 10086 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.778138  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:18.778852  8991 raft_consensus.cc:606] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:18.777433  9622 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.785539  8991 raft_consensus.cc:2955] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.787535  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8552a23b53d0499abefc4f4a5af10c93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.801723  8819 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 3 to 4, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 1 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.818254  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8552a23b53d0499abefc4f4a5af10c93 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:18.820091 10075 tablet_replica.cc:333] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:18.821138 10075 raft_consensus.cc:2243] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.821894 10075 raft_consensus.cc:2272] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.839553 10075 ts_tablet_manager.cc:1916] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.841228  9066 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.843683  9622 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.846045 10070 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.847623 10071 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.855772  8997 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.857599 10020 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.877022 10075 ts_tablet_manager.cc:1929] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.883898 10075 log.cc:1199] T 8552a23b53d0499abefc4f4a5af10c93 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/8552a23b53d0499abefc4f4a5af10c93
I20260709 12:13:18.887871  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 8552a23b53d0499abefc4f4a5af10c93 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:18.892531  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:18.891916 10071 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.895274  9622 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.893187  8924 raft_consensus.cc:606] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:18.903731  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:18.904495  8997 raft_consensus.cc:606] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:18.904147  8995 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.905788  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:18.907471  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:18.925292  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.924914  8819 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.939378  9067 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:18.946228  9974 raft_consensus.cc:993] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:18.946743  9974 raft_consensus.cc:1081] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:18.951548  9974 raft_consensus.cc:993] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:18.951984  9974 raft_consensus.cc:1081] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:18.953577  9622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:18.954384  9622 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.954526  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:18.954736  9622 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.955060  9066 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.955431  9066 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.961499  9622 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.964263  9622 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:18.967916  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:18.968604  8997 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.968906  8997 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:18.969600  8997 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:18.970763  8997 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.970803  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:18.971467  9067 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.978477  8997 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:18.979328  9066 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:18.979791  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:18.992201 10050 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.992900  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:18.990285  9067 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:18.993520  8924 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.994995  9066 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:18.996073  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:18.996709  8997 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.997063  8997 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:18.997900  8997 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:18.998992  8997 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.000088  8923 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.001446  8924 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.002745  9040 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:19.004673 10078 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.005172 10078 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:19.005563  9623 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.006074 10078 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.007797 10071 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.010931  9928 raft_consensus.cc:993] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:19.011370 10058 raft_consensus.cc:1081] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:19.012405  9067 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.013064  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:19.013594  9623 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.013664 10071 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.014014  9623 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.019997  8997 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.020733 10039 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:19.023891  9067 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:19.038353 10050 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:19.045184 10050 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.049891  9621 raft_consensus.cc:2955] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:19.036540  9623 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.065248  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 030add77af8944519fa93baf328b3e4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.068581  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:19.069002  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:19.069223  8997 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.069255  9623 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:19.069633  9066 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.069649  8997 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:19.075155  8997 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.075012  8823 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.076558  8997 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.086429  9066 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:19.091833  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:19.092747 10095 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.090031  8997 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:19.107666  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 030add77af8944519fa93baf328b3e4a with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:19.043366  8819 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.112650 10082 tablet_replica.cc:333] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:19.116811 10095 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:19.117871 10095 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.119727  8823 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.120644 10082 raft_consensus.cc:2243] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.121423 10082 raft_consensus.cc:2272] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.127099 10082 ts_tablet_manager.cc:1916] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:19.140156  8820 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.147933 10020 raft_consensus.cc:993] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:19.148473 10020 raft_consensus.cc:1081] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:19.149961  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:19.150192 10082 ts_tablet_manager.cc:1929] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:19.150545  9066 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.150678 10082 log.cc:1199] T 030add77af8944519fa93baf328b3e4a P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/030add77af8944519fa93baf328b3e4a
I20260709 12:13:19.150986  9066 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.152346  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 030add77af8944519fa93baf328b3e4a (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:19.156296  9066 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.158246  9066 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:19.159657  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:19.160183  9974 raft_consensus.cc:993] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:19.160238  8995 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.160545  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:19.160669  9974 raft_consensus.cc:1081] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:19.161110  8923 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.161413  8923 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:19.162091  8923 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.163275  8923 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.163182  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:19.163911  9066 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.164273  9066 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.167655  8995 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.169195  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:19.170010 10078 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.170043  8923 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.170675 10078 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:19.170459  9066 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.171715 10078 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.172531  9066 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:19.173952  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:19.174670  8995 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.174753  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:19.175074  8995 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:19.175424  8924 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.176028  8995 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.177284  8995 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.183014  8924 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.184212  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:19.185110 10078 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.186088 10078 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:19.186966 10078 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:19.188246  8995 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:19.188380  8820 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.202952  8820 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.298758 10058 raft_consensus.cc:993] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:19.299235 10058 raft_consensus.cc:1081] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:19.300798  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:19.301319  9623 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.301652  9623 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.307788  9623 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.309865  9623 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:19.310963  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:19.310963  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:19.311828  8995 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.311902  8923 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.312124  8995 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:19.312912  8995 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.316838  8995 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.318367  8923 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:19.319523  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:19.320490 10095 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.320961 10095 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:19.321787 10095 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:19.324604  8995 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:19.329841  8820 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.424844  8995 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.426086  9066 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.426159 10078 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.427613 10095 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.439934  8923 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.442471 10078 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.452504  8995 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.456144 10098 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:19.584913  8995 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.586097 10098 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.595224  9066 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.596621 10050 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.603140  8995 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.606755 10078 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.625288  8995 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.627331 10086 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.628352  8923 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.629688 10086 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.649999  8924 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.651546 10078 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.748955  8923 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.750336 10050 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.759646  8993 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:19.764611 10098 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:20.092394  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.143966  8993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:20.144477  8993 raft_consensus.cc:606] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:20.146934  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:20.147469  8923 raft_consensus.cc:606] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:20.149991  8993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:20.150480  8993 raft_consensus.cc:606] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:20.153024  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:20.153539  8923 raft_consensus.cc:606] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:20.165083  8993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1231588583a41de9b59e17189e8545b"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:20.165778  8993 raft_consensus.cc:606] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:20.167012  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:20.168635  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.169329  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.198662 10039 raft_consensus.cc:993] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.199175 10068 raft_consensus.cc:1081] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.201395  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:20.201787 10058 raft_consensus.cc:993] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:20.201992  9066 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.202340 10058 raft_consensus.cc:1081] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:20.202401  9066 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.204193  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1231588583a41de9b59e17189e8545b"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:20.204768  9623 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.205121  9623 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.210687  8993 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:20.215328  9623 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.219081  9623 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:20.223976  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:20.224644  8995 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.224926  8995 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:20.225653  8995 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.226742  8995 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.227154  9065 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.231310  8923 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.232932 10058 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:20.233981  8963 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f56979e1608d4fcc873d5537e8345d33. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.235499 10058 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.237582  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:20.238231  9067 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.254360  9067 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:20.245414  8995 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:20.255690  9588 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:20.211043  9066 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.256965 10050 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.257601 10050 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:20.258550 10050 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.259696  9066 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:20.262840  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:20.263196  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:20.263607  8995 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.262614 10121 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.263906  8916 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.264266  8916 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:20.265036  8916 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.266386  8916 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.269026  8923 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.270499  8995 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.271905  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:20.274742 10078 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.275283 10078 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:20.276197 10078 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.281163  8916 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.278306  8819 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.294749  9071 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:20.301947  8871 auto_rebalancer.cc:629] Failed to schedule move for tablet b6874650616d4242a2b161a9a22a07ad: Remote error: Service unavailable: leader transfer in progress
I20260709 12:13:20.305737  8820 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.315390  8923 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:20.321782  8823 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:20.330891  8888 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9be656547ea464996d40fcd3eb6a653. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.337904  9071 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.337904  8995 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.344470 10068 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.349934 10020 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.365479  9066 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.368643  8993 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.364286 10039 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.386938  8819 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.395385  8923 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:20.403326  8993 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:20.403398  8888 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4be7ce502f794156a9be9d258ca1e04f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.404762 10039 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.406879  9066 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.413062 10068 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.416836  8993 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.417763 10039 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.425972 10121 raft_consensus.cc:993] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.426903  9974 raft_consensus.cc:1081] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.428457  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:20.428972  9066 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.429306  9066 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.442922  9066 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.432799  9071 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:20.445602  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:20.446159  8923 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.454902  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:20.455566  8995 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.455873  8995 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:20.456645  8995 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.457702  8995 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.454543  8821 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.492548  8923 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.493034  9066 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:20.494010  9040 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:20.495554 10078 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.496048 10078 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:20.496860 10078 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.499383  8995 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.513378  8819 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.556213 10020 raft_consensus.cc:993] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:20.556731 10134 raft_consensus.cc:1081] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:20.558290  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:13:20.558787  9623 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.559099  9623 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.563706  9623 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.565775  9623 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:20.566130  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:20.566738  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:20.566780  8923 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.567381  9066 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.567468  8923 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:20.568264  8923 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.569540  8923 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.573922  9066 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:20.575265  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:20.575773  8923 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:20.576073 10050 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.576625 10050 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:20.577481 10050 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:20.586179  8819 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.606755 10058 raft_consensus.cc:993] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.607299 10058 raft_consensus.cc:1081] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:20.608958  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:20.609477  9066 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.609799  9066 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.619064  9066 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.620647  9066 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:20.621464  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:20.621625  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:20.622082  8923 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.622151  8997 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.622527  8997 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:20.623390  8997 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.624647  8997 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.629056  8923 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.630412  9040 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:20.630740  8997 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:20.631346 10078 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.632359 10078 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:20.633311 10078 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:20.645438  8819 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.669140  8924 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.669399  8997 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.670706 10050 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.670758 10085 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.707453  8997 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.708786 10078 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.774292  9071 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.776300 10050 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:20.842738  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 98376.7us
I20260709 12:13:20.852764 10151 ts_tablet_manager.cc:933] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:20.859272 10153 ts_tablet_manager.cc:933] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:20.866285 10153 tablet_copy_client.cc:323] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:20.868844  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet b9be656547ea464996d40fcd3eb6a653 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:20.869539  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet b9be656547ea464996d40fcd3eb6a653 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-b9be656547ea464996d40fcd3eb6a653
I20260709 12:13:20.880263  8935 tablet_copy_source_session.cc:215] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.883623 10153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be656547ea464996d40fcd3eb6a653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.922801 10151 tablet_copy_client.cc:323] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:20.926091  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet f56979e1608d4fcc873d5537e8345d33 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:20.926644  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet f56979e1608d4fcc873d5537e8345d33 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-f56979e1608d4fcc873d5537e8345d33
I20260709 12:13:20.937868  9010 tablet_copy_source_session.cc:215] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:20.939182 10153 tablet_copy_client.cc:806] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.939810 10153 tablet_copy_client.cc:670] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.941049 10151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56979e1608d4fcc873d5537e8345d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:20.946127 10153 tablet_copy_client.cc:538] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.955338 10153 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:20.960274 10151 tablet_copy_client.cc:806] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:20.960980 10151 tablet_copy_client.cc:670] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:20.964979 10151 tablet_copy_client.cc:538] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:20.975315  8997 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.975545 10151 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:20.975561 10153 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.976684 10153 tablet_bootstrap.cc:492] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:20.976955 10149 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.977404 10153 ts_tablet_manager.cc:1403] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.022s	user 0.024s	sys 0.000s
I20260709 12:13:20.980633 10153 raft_consensus.cc:359] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:20.981519 10153 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:20.982223 10153 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:20.985006 10153 ts_tablet_manager.cc:1434] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:21.007289 10158 ts_tablet_manager.cc:933] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:21.032029 10151 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.032966 10151 tablet_bootstrap.cc:492] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:21.033663 10151 ts_tablet_manager.cc:1403] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.004s
I20260709 12:13:21.036763 10151 raft_consensus.cc:359] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.037693 10151 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:21.038465 10151 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.039523  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-b9be656547ea464996d40fcd3eb6a653 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:21.040138  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-b9be656547ea464996d40fcd3eb6a653 on tablet b9be656547ea464996d40fcd3eb6a653 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:21.040973 10151 ts_tablet_manager.cc:1434] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:21.042629  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-f56979e1608d4fcc873d5537e8345d33 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:21.043045  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-f56979e1608d4fcc873d5537e8345d33 on tablet f56979e1608d4fcc873d5537e8345d33 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:21.045147 10158 tablet_copy_client.cc:323] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:21.049592  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 4be7ce502f794156a9be9d258ca1e04f from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:21.050133  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 4be7ce502f794156a9be9d258ca1e04f from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-4be7ce502f794156a9be9d258ca1e04f
I20260709 12:13:21.052565  8923 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.054540 10085 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.060215  8935 tablet_copy_source_session.cc:215] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.064452 10158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be7ce502f794156a9be9d258ca1e04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.082510  8916 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.088186 10050 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.097060  8923 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.099325 10078 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.119959 10158 tablet_copy_client.cc:806] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.120621 10158 tablet_copy_client.cc:670] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.123780  9066 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.125320 10158 tablet_copy_client.cc:538] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.127575 10095 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:21.139230  8997 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.140935 10086 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.163210  9622 raft_consensus.cc:1217] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:21.183724 10158 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:21.221143 10158 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.222314 10158 tablet_bootstrap.cc:492] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:21.223042 10158 ts_tablet_manager.cc:1403] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.000s
I20260709 12:13:21.226111 10158 raft_consensus.cc:359] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.226960 10158 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:21.227674 10158 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.231051 10158 ts_tablet_manager.cc:1434] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:21.232695  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-4be7ce502f794156a9be9d258ca1e04f received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:21.233107  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-4be7ce502f794156a9be9d258ca1e04f on tablet 4be7ce502f794156a9be9d258ca1e04f with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:21.238257  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.291620  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:21.292156  8916 raft_consensus.cc:606] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:21.295357  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:21.295917  8916 raft_consensus.cc:606] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:21.299819  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:21.300307  8923 raft_consensus.cc:606] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:21.303692  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:21.304250  8916 raft_consensus.cc:606] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:21.306397  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:21.306811  8916 raft_consensus.cc:606] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:21.307811  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:21.309401  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.310197  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.335629 10134 raft_consensus.cc:993] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.336266 10134 raft_consensus.cc:1081] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.337880  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:21.338363  9066 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.338665  9066 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.345584  9066 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.348820  9066 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:21.350668  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:21.351322  8997 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.348620  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:21.354640  8916 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.356132  8916 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:21.356916  8916 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.359882  8916 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.364354  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:21.366868  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:21.367763 10086 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.368224 10086 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:21.369076 10086 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.378984  8916 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:21.384687  8823 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.398450  9622 raft_consensus.cc:1217] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:21.498041  9622 raft_consensus.cc:1217] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:21.504354 10171 raft_consensus.cc:993] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.507565 10171 raft_consensus.cc:1081] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.510569  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:21.511099  9066 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.511439  9066 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.512101 10171 raft_consensus.cc:993] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.513316 10134 raft_consensus.cc:1081] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:21.514773  9065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:21.515301  9065 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.515614  9065 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:21.518748  9066 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.521337  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:21.521869  8923 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.522135  8923 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:21.522334  9066 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:21.522512  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:21.523038  8997 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.523087  8923 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.522167  9065 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.524508  8923 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.525667  9065 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:21.526310  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:21.526826  8916 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:21.527110  8916 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:21.527814  8916 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.528816  8916 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:21.530951  8923 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:21.531051  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:21.531662  8994 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:21.532212  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:21.533000 10149 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.533524 10149 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:21.534335 10149 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:21.538057  8997 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:21.547061  8916 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:21.548234  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:21.549938 10086 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:21.550402 10086 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:21.551157  8994 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:21.551218 10086 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.555325  8819 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.575714  8819 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.631291  9974 raft_consensus.cc:1064] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:21.633540  9974 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:21.635417 10134 raft_consensus.cc:993] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:21.635912 10134 raft_consensus.cc:1081] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:21.638379  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:13:21.638880  8997 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.639272  8997 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.655942  9622 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.657364  9065 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.659564  8916 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:21.659669 10058 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.660737 10148 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.665928  9974 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.668912  8997 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.670852  8997 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:21.674839  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:21.675513  8916 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.675858  8916 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:21.677127  8916 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.677417  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:21.678108  9066 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.683939  8916 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.698179  8916 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:21.703807  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:21.705667 10058 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.706176 10058 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:21.708775  9066 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:21.712761 10058 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:21.716537 10148 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.725620 10020 raft_consensus.cc:993] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:21.726099 10020 raft_consensus.cc:1081] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:21.728259  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:13:21.728799  9623 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.729128  9623 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.733047  9622 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.736826  9623 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:21.746820  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:21.747452  8997 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.747596  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:21.748169  8924 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.748450  8924 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:21.749107  8924 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:21.750240  8924 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.754693  8997 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:21.756222  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:21.757084 10095 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.745705  9623 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:21.757591 10095 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:21.758452 10095 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:21.778599  8994 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.780385 10078 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.790050  8819 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.796399  8924 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:21.805151  9071 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.813019  8924 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.814776 10085 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.819722  8923 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.819892  8823 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.845614  8819 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.887734  8997 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:21.894307  9622 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.895956 10148 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:21.903772 10121 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.910339  9622 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.922147  8923 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:21.925539 10148 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:21.933252  8923 raft_consensus.cc:2955] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:21.937935  9623 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Advancing to term 2
I20260709 12:13:21.950485  9623 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:21.955547 10149 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.965405  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f56979e1608d4fcc873d5537e8345d33 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:21.965955 10085 raft_consensus.cc:1064] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
W20260709 12:13:21.966410 10085 raft_consensus.cc:1068] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Unable to promote non-voter 4993160378a142a1bc21648120cbaebc: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:21.982906  8924 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:21.986018 10086 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.986909  8924 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:21.991394 10149 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.991539  8819 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.019510  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet f56979e1608d4fcc873d5537e8345d33 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:22.021113  8994 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:22.022895 10078 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.039153 10020 raft_consensus.cc:1064] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:22.041577 10020 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.074092  8995 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:22.078768 10086 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.085964 10086 raft_consensus.cc:1064] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:22.088140 10086 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.100014  8916 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:22.101375 10086 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.101466  8997 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:22.105319 10085 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.106127  9622 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:22.112249 10078 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:22.125450 10190 tablet_replica.cc:333] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:22.129174 10085 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.137869  8994 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.138377  9623 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.143054 10171 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.150403  8993 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.151965 10171 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.151485  9622 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.168598  9067 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.173074 10172 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.174060  8916 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.175733 10095 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:22.185308 10190 raft_consensus.cc:2243] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.186228 10190 raft_consensus.cc:2272] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.186477  8916 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.189647 10190 ts_tablet_manager.cc:1916] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.217274 10171 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.220719 10190 ts_tablet_manager.cc:1929] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:22.221192 10190 log.cc:1199] T f56979e1608d4fcc873d5537e8345d33 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/f56979e1608d4fcc873d5537e8345d33
I20260709 12:13:22.221882  9621 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.224774  9067 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.223901  8997 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.229359  8821 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.241890 10095 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:22.248899  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet f56979e1608d4fcc873d5537e8345d33 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:22.260183  9070 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.259076  8997 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.263662 10058 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.274993  8924 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.278733 10121 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:22.285555  9069 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.290220  8821 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.311427  9622 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.314095 10197 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:22.318758  8916 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.325053 10149 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.326478  9621 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.340363 10078 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:22.352283  8923 raft_consensus.cc:2955] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.360385  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9be656547ea464996d40fcd3eb6a653 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.366532  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.397195  8823 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.411540  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet b9be656547ea464996d40fcd3eb6a653 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:22.430559  8923 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.448843 10202 tablet_replica.cc:333] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:22.450162 10202 raft_consensus.cc:2243] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.451011 10202 raft_consensus.cc:2272] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.456830 10202 ts_tablet_manager.cc:1916] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.459988  9621 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.461562 10020 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.466295  8997 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.469187 10134 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.471151 10134 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.485705  8997 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.491039 10202 ts_tablet_manager.cc:1929] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:22.510289  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4be7ce502f794156a9be9d258ca1e04f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.485747  9622 raft_consensus.cc:2955] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:22.510759 10202 log.cc:1199] T b9be656547ea464996d40fcd3eb6a653 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/b9be656547ea464996d40fcd3eb6a653
I20260709 12:13:22.519726  8821 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.520958  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet b9be656547ea464996d40fcd3eb6a653 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:22.540817  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 4be7ce502f794156a9be9d258ca1e04f with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:22.541750 10190 tablet_replica.cc:333] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:22.542666 10190 raft_consensus.cc:2243] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.543480 10190 raft_consensus.cc:2272] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.547041  9070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:22.547854  9070 raft_consensus.cc:606] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:22.555861  8993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:22.556497  8993 raft_consensus.cc:606] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:22.555871 10190 ts_tablet_manager.cc:1916] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.563437  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:22.564144  8923 raft_consensus.cc:606] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:22.567891  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:22.568389  8924 raft_consensus.cc:606] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:22.570853  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:22.571398  8924 raft_consensus.cc:606] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:22.572659  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:22.574144  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:22.574885  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.575845 10190 ts_tablet_manager.cc:1929] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:22.576313 10190 log.cc:1199] T 4be7ce502f794156a9be9d258ca1e04f P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/4be7ce502f794156a9be9d258ca1e04f
I20260709 12:13:22.577801  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 4be7ce502f794156a9be9d258ca1e04f (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:22.672006 10078 raft_consensus.cc:993] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:22.672582 10149 raft_consensus.cc:1081] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:22.674055  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:22.674504  8997 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.674744  8997 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.679230  8997 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.680750  8997 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:22.681676  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:22.682072  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:22.682294  9070 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:22.682650  8924 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.682706  9070 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:22.684351  9070 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.685485  9070 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:22.689953  8924 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:22.690733  9070 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:22.691200  8966 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:22.692078  9974 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:22.692476  9974 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:22.693240  9974 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.700117 10134 raft_consensus.cc:993] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:22.700593 10134 raft_consensus.cc:1081] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:22.702219  9070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:22.702661  9070 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.703023  9070 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.703684  8821 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.708384 10058 raft_consensus.cc:993] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:22.708873 10058 raft_consensus.cc:1081] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:22.709053  9070 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.711622  9622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:22.712127  9622 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.712188  9070 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:22.712553  9622 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.713572  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:22.713881  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:22.715086  8924 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.715318  9621 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.715451  8924 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:22.716292  8924 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.717430  8924 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.719568  9621 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:22.719319  9622 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.720690  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:22.721577  9622 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:22.721653 10149 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.722249 10149 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:22.722666  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:22.723062  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:22.723284  8997 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.723640  9070 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.723142 10149 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.723659  8997 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:22.729728  8997 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.730947  8997 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.732776  9070 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:22.723901  8924 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:22.734025  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:22.734997 10098 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.735553 10098 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:22.736362 10098 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:22.739060  8997 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:22.743077  8821 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.761868  8821 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.954088 10020 raft_consensus.cc:993] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:22.954579 10020 raft_consensus.cc:1081] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:22.956328  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:13:22.956800  8997 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.957116  8997 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.963019  8997 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.964922  8997 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:22.965838  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:22.966432  8923 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.966734  8923 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:22.967561  8923 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.968034  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:22.968606  9070 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.968616  8923 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.974670  9070 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:22.975893  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:22.975941  8923 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:22.976619 10058 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.977109 10058 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:22.977837 10058 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:22.988204  8821 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.057410 10134 raft_consensus.cc:993] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:23.057912 10020 raft_consensus.cc:1081] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:23.059718  9069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:23.060319  9069 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.060707  9069 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.067301  9069 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.068771  9069 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:23.069509  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:23.069751  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:23.070190  8924 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.070343  8993 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.070642  8924 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:23.071609  8924 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.072569  8924 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.075068  8993 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:23.076210  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:23.076975 10086 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.077422 10086 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:23.077510  8924 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:23.078233 10086 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.090888  8821 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.103871  8924 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.104971 10086 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.107062  8924 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:23.108363 10058 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:23.127548  9621 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.128822 10086 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.138118  9069 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.139858 10208 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.187386  8993 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:23.189005 10207 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:23.190773  9069 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:23.192816 10058 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.442287  8923 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.443607 10058 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.455013  9070 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.456864 10058 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.546939  8997 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.550029 10149 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.570400  8924 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.571973 10216 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.610677  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.634863  8993 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:23.640431  8924 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:13:23.641579  8963 consensus_peers.cc:597] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1681ffac65ee495d8dd8530b021d3307. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.641781 10121 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.642980  9070 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:23.648313 10121 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.650873  9974 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.652475  8923 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.658404  9069 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.669948  9067 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:23.674548  8819 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.675534  9070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:23.676151  9070 raft_consensus.cc:606] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:23.678663  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:23.679188  8997 raft_consensus.cc:606] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:23.681998  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:23.682708  8924 raft_consensus.cc:606] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:23.688545  8923 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.690063 10149 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.690511  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:23.692368  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.693149  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:23.694572  9037 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7ad3d29ddad476c8f02ee13b8dbe1b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.702981  8993 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.704566 10216 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.714537 10086 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.723855  8997 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.743599  8924 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:23.748715  8821 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.753544  8923 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.766983  9069 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:23.767031  8888 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e996a3dae284298bc7fecf1e8fdc675. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.769062  8997 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:23.769691 10020 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.771188 10134 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.784085 10134 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.789140  9069 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.792778  8997 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.814163  8820 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.826032  9069 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:23.832939 10149 raft_consensus.cc:993] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:23.833436 10216 raft_consensus.cc:1081] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
W20260709 12:13:23.834215  9037 consensus_peers.cc:597] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e25b484158d4e599cd55c7f9a740e11. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.835507  8994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:23.836318  8994 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.836679  8994 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.837478  8923 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.838672 10234 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.842707  8994 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.844513  8994 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:23.844997  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:23.845582  8924 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.846381  8997 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.848178  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:23.848680  9070 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.848376 10234 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.848879  9070 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:23.849449  9070 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.850414  9070 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.852056  8924 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:23.853240  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:23.853943  9974 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.854383  9974 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:23.855100  9974 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:23.858778  9070 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:23.949316 10234 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:23.973500  8997 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:24.016639 10020 raft_consensus.cc:993] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:24.017342 10020 raft_consensus.cc:1081] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:24.030580  9067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:24.052536  9067 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.053184  9067 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.041781  8923 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:24.072402  8821 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.110162 10121 raft_consensus.cc:993] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:24.111131 10121 raft_consensus.cc:1081] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:24.160568  9067 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.175936  9067 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:24.176986  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:24.188992  8921 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.189335  8921 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:24.200055  8821 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:24.206403  8921 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.210256  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:24.211773  9624 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.212491  8921 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.247792  9624 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:24.249766  9622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:24.250432  9622 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.250871  9622 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.254158  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:24.258309 10249 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.259013 10249 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:24.260164 10249 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.265880  9622 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.276181 10250 ts_tablet_manager.cc:933] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:24.280462  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:24.249141  8921 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:24.281296  8997 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:24.281792  8997 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:24.282934  8997 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.285018  8997 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.275559 10251 ts_tablet_manager.cc:933] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:24.276099  8923 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.294930  9974 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:24.295980 10250 tablet_copy_client.cc:323] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:24.298712  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 1681ffac65ee495d8dd8530b021d3307 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:24.299379  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 1681ffac65ee495d8dd8530b021d3307 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-1681ffac65ee495d8dd8530b021d3307
I20260709 12:13:24.309208  9010 tablet_copy_source_session.cc:215] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:24.317824  9622 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:24.318897 10250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681ffac65ee495d8dd8530b021d3307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.319010  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:24.319774  9066 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.327562  8997 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:24.336290  9066 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:24.372267 10251 tablet_copy_client.cc:323] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:24.372519  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:24.374317 10095 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:24.374812 10095 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:24.375787 10095 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:24.420061 10257 ts_tablet_manager.cc:933] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:24.420254 10259 ts_tablet_manager.cc:933] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:24.428661  9067 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.432221  9084 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:24.448066 10121 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.448757  9084 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-e7ad3d29ddad476c8f02ee13b8dbe1b5
I20260709 12:13:24.430503  8819 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.486439  8821 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.495741 10257 tablet_copy_client.cc:323] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:24.487108  9084 tablet_copy_source_session.cc:215] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:24.498095  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 8e25b484158d4e599cd55c7f9a740e11 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:24.498706  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 8e25b484158d4e599cd55c7f9a740e11 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-8e25b484158d4e599cd55c7f9a740e11
I20260709 12:13:24.499696 10259 tablet_copy_client.cc:323] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:24.504279  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 9e996a3dae284298bc7fecf1e8fdc675 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:24.504907  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 9e996a3dae284298bc7fecf1e8fdc675 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-9e996a3dae284298bc7fecf1e8fdc675
I20260709 12:13:24.511185 10251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.520907  8935 tablet_copy_source_session.cc:215] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:24.522802 10250 tablet_copy_client.cc:806] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:24.523701 10250 tablet_copy_client.cc:670] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:24.528283 10250 tablet_copy_client.cc:538] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:24.529495 10259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e996a3dae284298bc7fecf1e8fdc675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.540030 10250 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:24.550879  9083 tablet_copy_source_session.cc:215] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:24.562284 10257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e25b484158d4e599cd55c7f9a740e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.580359 10251 tablet_copy_client.cc:806] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:24.581064 10251 tablet_copy_client.cc:670] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:24.582752 10259 tablet_copy_client.cc:806] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:24.583401 10259 tablet_copy_client.cc:670] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:24.587370 10259 tablet_copy_client.cc:538] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:24.588910 10251 tablet_copy_client.cc:538] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:24.597148 10250 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.599586 10257 tablet_copy_client.cc:806] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:24.600366 10257 tablet_copy_client.cc:670] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:24.608183 10251 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:24.609481 10257 tablet_copy_client.cc:538] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:24.609879 10259 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:24.615782 10250 tablet_bootstrap.cc:492] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:24.616815 10250 ts_tablet_manager.cc:1403] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.005s
I20260709 12:13:24.628199 10250 raft_consensus.cc:359] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.629276 10250 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:24.632071 10250 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.631386 10257 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:24.647460 10250 ts_tablet_manager.cc:1434] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:13:24.657470  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-1681ffac65ee495d8dd8530b021d3307 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:24.658028  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-1681ffac65ee495d8dd8530b021d3307 on tablet 1681ffac65ee495d8dd8530b021d3307 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:24.693269 10259 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.694343 10259 tablet_bootstrap.cc:492] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:24.695284 10259 ts_tablet_manager.cc:1403] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.009s
I20260709 12:13:24.700814  9623 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.702644 10246 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.714798 10251 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.716040 10251 tablet_bootstrap.cc:492] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:24.716147 10257 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.716861 10251 ts_tablet_manager.cc:1403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.005s
I20260709 12:13:24.717341 10257 tablet_bootstrap.cc:492] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:24.718127 10257 ts_tablet_manager.cc:1403] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.010s
I20260709 12:13:24.722759  8924 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.723577 10259 raft_consensus.cc:359] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.724354 10246 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.725669 10259 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:24.725852 10257 raft_consensus.cc:359] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.726776 10257 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:24.726454 10259 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.727540 10257 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.721143 10251 raft_consensus.cc:359] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.731938 10251 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:24.733023 10251 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:24.735508 10251 ts_tablet_manager.cc:1434] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:13:24.737200 10257 ts_tablet_manager.cc:1434] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:13:24.739466 10259 ts_tablet_manager.cc:1434] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:13:24.741546  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-e7ad3d29ddad476c8f02ee13b8dbe1b5 received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:24.742064  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-e7ad3d29ddad476c8f02ee13b8dbe1b5 on tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:24.745596  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-8e25b484158d4e599cd55c7f9a740e11 received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:24.746129  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-8e25b484158d4e599cd55c7f9a740e11 on tablet 8e25b484158d4e599cd55c7f9a740e11 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:24.746634  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-9e996a3dae284298bc7fecf1e8fdc675 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:24.747107  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-9e996a3dae284298bc7fecf1e8fdc675 on tablet 9e996a3dae284298bc7fecf1e8fdc675 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:24.756884  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.803649  8991 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.807112 10098 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:24.837064  9067 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:24.842141 10095 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.893162  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023d28c087e64377a9e2790180949da6"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:24.893754  8924 raft_consensus.cc:606] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:24.897467  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:24.898015  8991 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:24.900765  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:24.901315  9067 raft_consensus.cc:606] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:24.902560  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:24.903847  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:24.904620  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.917569  9623 raft_consensus.cc:1217] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:24.939143  9623 raft_consensus.cc:1217] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:24.946367  9623 raft_consensus.cc:1217] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:25.127225  9623 raft_consensus.cc:1217] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:13:25.213222 10121 raft_consensus.cc:993] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:25.213733  9974 raft_consensus.cc:1081] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:25.215070  8924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:25.215655  8924 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.216007  8924 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.222456  8924 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:25.224748  8924 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:25.225724  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:25.227437  9066 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.237515  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:25.238174  8991 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.238474  8991 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:25.239287  8991 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:25.240387  8991 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.243978  9066 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:25.245393  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:25.246430 10134 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.246862 10134 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:25.247627 10134 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:25.250281  8991 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:25.262753  8821 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.280915 10240 raft_consensus.cc:993] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:25.281441 10134 raft_consensus.cc:1081] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:25.282936  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "023d28c087e64377a9e2790180949da6"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:25.283414  9066 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.283758  9066 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.288334  9066 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.289830  9066 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:25.290722  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:25.290733  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:25.291440  8923 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.291522  9623 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.291851  8923 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:25.292654  8923 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.293744  8923 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.300725  8923 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:25.301882  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:25.302783 10246 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.303326 10246 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:25.303144  9623 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:25.304159 10246 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.316335  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.331375 10249 raft_consensus.cc:993] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:25.331887 10249 raft_consensus.cc:1081] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:25.333559  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:25.334103  8991 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.334508  8991 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.341284  8991 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:25.343477  8991 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:25.345615  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:25.345839  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:25.346421  9067 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:25.346733  9067 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:25.346820  8923 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.347600  9067 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:25.349162  9067 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.360882  9067 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:25.361671  8923 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:25.362838  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:25.364001 10121 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.364703 10121 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:25.365741 10121 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:25.387372  8821 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.496062 10134 raft_consensus.cc:1064] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:25.499800 10134 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.502235 10234 raft_consensus.cc:1064] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:25.505520 10234 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.519099  9623 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.527498  9067 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.528599  8924 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:25.530114 10246 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.530450 10240 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:25.532244  8995 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:25.532351 10240 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:25.537516  9623 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:25.540012 10236 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:25.543965  8991 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:25.591198 10249 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:25.619381 10236 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.624465  9622 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.631573  9974 raft_consensus.cc:1064] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:25.634053  9067 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.636516  9974 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.639149 10234 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.641132  8821 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.645597  8991 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.681255  9622 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:25.686405  8923 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:25.674501 10249 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.691999  9974 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:25.694186  8923 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:25.698722  9623 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.700937 10287 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:25.718242  9067 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:25.720841  8995 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.721117  8991 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.721117  9624 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:25.727190 10134 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.727469  9974 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:25.729182  9621 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:25.761415  8821 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.786371  8923 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:25.788321  9974 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:25.770102 10236 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:13:25.790551 10240 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.790943 10249 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:25.809362  9974 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.821241  8923 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.831962  9069 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.846043  9624 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:25.840696  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 92479.6us
W20260709 12:13:25.898947  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49561.1us
I20260709 12:13:25.904830  8921 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:25.942191  9621 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Advancing to term 3
I20260709 12:13:25.953806  9621 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:25.961205  8923 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:25.964840 10248 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:25.996322  8991 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.995874  8995 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.001879  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e996a3dae284298bc7fecf1e8fdc675 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:26.005817  9067 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:26.008466  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.002357  9620 raft_consensus.cc:2955] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.017769 10287 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:26.023368 10240 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.037014  9070 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:26.037876  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70023.6us
I20260709 12:13:26.050452 10297 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.052232  9066 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:26.053056 10300 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:26.065857 10299 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:26.072211  8923 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:26.079174  9623 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:25.994621  8820 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.105201 10295 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:26.133152 10295 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:26.154979  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57937.5us
I20260709 12:13:26.156178 10246 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:26.199496  8995 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:26.207041  9624 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.221504  9622 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:26.198083  8916 raft_consensus.cc:2955] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.215636  8822 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 4, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.223416 10121 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:26.245319  9974 raft_consensus.cc:1064] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
W20260709 12:13:26.248232 10308 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:13:26.251281  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:26.256505  9623 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.254531 10287 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.254499  9974 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:26.283407  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e996a3dae284298bc7fecf1e8fdc675 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58540
W20260709 12:13:26.287788  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58903.8us
I20260709 12:13:26.288985  9067 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:26.300067  8924 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:26.313337  8822 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.309196  9623 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:26.325953 10317 tablet_replica.cc:333] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:26.333593 10315 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:26.330411 10248 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:26.335206 10317 raft_consensus.cc:2243] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.335628  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1681ffac65ee495d8dd8530b021d3307 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:26.337546 10317 raft_consensus.cc:2272] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.337638 10315 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:26.346586  8995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:26.347155  8995 raft_consensus.cc:606] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:26.352082 10317 ts_tablet_manager.cc:1916] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:26.351207  9624 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.356629 10314 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.360283  9067 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:26.358283  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1681ffac65ee495d8dd8530b021d3307 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:26.378100 10318 tablet_replica.cc:333] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:26.379135 10248 raft_consensus.cc:993] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:26.379509 10318 raft_consensus.cc:2243] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.379733 10248 raft_consensus.cc:1081] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:26.380523 10318 raft_consensus.cc:2272] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.382893  8822 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 4 to 5, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.385393  8916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:26.385968  8916 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.386299  8916 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.387935 10318 ts_tablet_manager.cc:1916] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:26.393183  9069 raft_consensus.cc:2955] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.402657 10315 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:26.405766  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:26.406399  9067 raft_consensus.cc:606] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:26.409512  9066 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.413349  8924 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.423405  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:26.424021  8921 raft_consensus.cc:606] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:26.426779  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:26.428496  8819 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:26.427597  8921 raft_consensus.cc:606] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:26.430912 10317 ts_tablet_manager.cc:1929] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:26.431249  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:26.433486  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.434267  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.431691 10318 ts_tablet_manager.cc:1929] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:26.436199 10318 log.cc:1199] T 1681ffac65ee495d8dd8530b021d3307 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/1681ffac65ee495d8dd8530b021d3307
I20260709 12:13:26.438512  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 1681ffac65ee495d8dd8530b021d3307 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:26.441946  8916 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.442945 10317 log.cc:1199] T 9e996a3dae284298bc7fecf1e8fdc675 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/9e996a3dae284298bc7fecf1e8fdc675
I20260709 12:13:26.444787  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 9e996a3dae284298bc7fecf1e8fdc675 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:26.445729  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1681ffac65ee495d8dd8530b021d3307 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:26.452661  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 1681ffac65ee495d8dd8530b021d3307 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:26.454910  8916 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:26.455984  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:26.456602  9069 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.456693  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:26.457892  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:26.458458  8995 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.458738  8995 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:26.459506  8995 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.460701  8995 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.468122  8995 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:26.472437  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:26.473443 10236 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.475342 10319 tablet_replica.cc:333] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:26.475569 10236 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:26.477807 10236 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.482823 10319 raft_consensus.cc:2243] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.482999 10298 raft_consensus.cc:993] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:26.487907 10298 raft_consensus.cc:1081] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:26.489652  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:26.490370  9066 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.490875  9066 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.485188  9069 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:26.493090 10319 raft_consensus.cc:2272] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.520004 10319 ts_tablet_manager.cc:1916] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:26.535509  9066 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.538738  9066 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:26.538861  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:26.539515  8991 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.540812  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:26.541375  8916 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.541676  8916 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:26.542426  8916 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.544123  8916 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.549546  8991 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:26.550228 10319 ts_tablet_manager.cc:1929] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:26.560159 10319 log.cc:1199] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/e7ad3d29ddad476c8f02ee13b8dbe1b5
I20260709 12:13:26.564643  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet e7ad3d29ddad476c8f02ee13b8dbe1b5 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:26.564678  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:26.566603 10246 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.567090 10246 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:26.554368  8916 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:26.568167 10246 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.573283  8819 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.586781  8821 catalog_manager.cc:5697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.662905 10246 raft_consensus.cc:993] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:26.663471 10246 raft_consensus.cc:1081] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:26.665344  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:26.665863  8991 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.666188  8991 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.673735  8991 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.676682  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:26.676918  8991 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:26.677259  8916 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.678987  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:26.679620  9069 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:26.679910  9069 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:26.680626  9069 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.681860  9069 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:26.684446  8916 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:26.687050  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:26.688090 10314 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:26.688555 10314 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:26.689409 10314 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:26.689875  9069 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:26.701617  8821 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.979591 10236 raft_consensus.cc:993] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:26.980094 10240 raft_consensus.cc:1081] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:26.981629  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:13:26.982100  9623 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.982390  9623 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.988837  9623 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:26.992183  9623 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:26.992118  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:26.992790  8924 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.993108  8924 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:26.993707  8924 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:26.994563  8924 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.002889  8924 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:27.005260  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:27.007660  8995 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.017465  8995 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:27.018778  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:27.022545 10098 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.023118 10098 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:27.024948 10098 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:27.026665  8995 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.034279  8995 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:27.034924 10240 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.035465  8819 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.043905  9623 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:27.047977 10314 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:27.048533  8991 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.054927 10246 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.061667 10287 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:27.065517  9066 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:27.073654  9066 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.075896 10240 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.076710  9624 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:27.103825  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e25b484158d4e599cd55c7f9a740e11 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:27.109946 10287 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:27.116225  8821 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:27.118278  9066 raft_consensus.cc:2955] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:27.137109  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e25b484158d4e599cd55c7f9a740e11 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:27.141959  9067 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.144850 10287 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:27.173857 10332 tablet_replica.cc:333] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:27.178506  8924 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.181099 10332 raft_consensus.cc:2243] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:27.182415 10332 raft_consensus.cc:2272] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:27.183857 10246 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.207120 10332 ts_tablet_manager.cc:1916] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:27.214859  8916 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:27.216609 10328 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.234293 10332 ts_tablet_manager.cc:1929] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:27.234898 10332 log.cc:1199] T 8e25b484158d4e599cd55c7f9a740e11 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/8e25b484158d4e599cd55c7f9a740e11
I20260709 12:13:27.237794  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 8e25b484158d4e599cd55c7f9a740e11 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:27.431666  8921 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.433144 10273 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.446450  8991 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.448030 10098 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.566205  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.605329  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:27.605865  8921 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:27.610666  9069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566f7a1027e341e88b14a77db605c154"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:27.611363  9069 raft_consensus.cc:606] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:27.616628  8995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:27.617300  8995 raft_consensus.cc:606] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:27.618780  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:27.620457  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:27.621295  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.855563 10326 raft_consensus.cc:993] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:27.856052 10240 raft_consensus.cc:1081] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:27.857610  9067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:27.858237  9067 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.858640  9067 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.864387  9067 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.866840  9067 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:27.866870  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:27.867148  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:27.867682  8921 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.867854  8994 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.868018  8921 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:27.868856  8921 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.870054  8921 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.876667  8921 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:27.877589  8994 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:27.877966  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:27.878787 10300 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.879276 10300 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:27.880127 10300 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.891963  8822 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.894563 10327 raft_consensus.cc:993] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:27.895224 10314 raft_consensus.cc:1081] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:27.899029  8921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:27.900022  8921 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.900352  8921 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.905968  8921 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.908524  8921 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:27.916339  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:27.916965  9067 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.917096  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:27.917821  8994 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.918103  8994 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:27.918835  8994 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.920032  8994 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.926970  9067 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:27.927564  8994 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:27.928465  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:27.929706 10326 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.930188 10326 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:27.930990 10326 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.942459  8822 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.956715 10300 raft_consensus.cc:993] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:27.957232 10300 raft_consensus.cc:1081] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:27.958714  8994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566f7a1027e341e88b14a77db605c154"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:27.959136  8994 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.959523  8994 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.964862  8994 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.966307  8994 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:27.967132  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:27.967470  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:27.967737  8921 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.967993  9067 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.968313  9067 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:27.968900  9067 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.969755  9067 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.972817  8921 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:27.974097  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:27.975601 10327 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.976065 10327 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:27.976943 10327 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:27.978149  9067 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:27.988368  8822 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.218690  9067 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.224820  8995 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:28.225690  8921 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:28.226503 10246 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.227586 10300 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:28.230037  9037 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 447f05dcf4904c71bfa27d72667dc990. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.236234 10300 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.238183  8921 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.239949  8995 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.252404  8994 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.258551  8822 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:28.271888  8963 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 422d007cdc2c44f4b486ca22b87c8dd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.272992  8916 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:28.273993  9066 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:28.275909 10314 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.282439 10327 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:28.289920  8924 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:28.292243 10293 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.296378 10314 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.297079  8924 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.321264  9066 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.325726  9067 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.362771  8819 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 4, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.378105  8995 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:28.378278  9037 consensus_peers.cc:597] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6874650616d4242a2b161a9a22a07ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.379092  8994 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:28.379612 10246 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.380597  8924 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:28.382864 10293 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.395480 10300 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.431488 10300 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.440090  8994 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:28.438537  8916 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.441624 10358 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.450552  8995 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.457379  8924 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.465432  8819 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:13:28.477840  8888 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8a9c1b9c42c4bd88c49949bf6c32d9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.478776  8994 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:28.480695  9072 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:28.480881  9069 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.482795  9067 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:28.483373 10314 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.484244 10326 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.485328 10240 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.494356 10358 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.519408 10358 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.521034  8994 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.530480  8924 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.535316 10354 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:28.535316  9067 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:28.552701  8822 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.630713 10373 ts_tablet_manager.cc:933] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:28.633667 10373 tablet_copy_client.cc:323] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:28.635435  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 447f05dcf4904c71bfa27d72667dc990 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:28.635975  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 447f05dcf4904c71bfa27d72667dc990 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-447f05dcf4904c71bfa27d72667dc990
I20260709 12:13:28.643169  9083 tablet_copy_source_session.cc:215] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:28.646143 10373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447f05dcf4904c71bfa27d72667dc990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:28.662494 10373 tablet_copy_client.cc:806] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:28.663113 10373 tablet_copy_client.cc:670] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:28.665956  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.675557 10373 tablet_copy_client.cc:538] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:28.685401 10373 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:28.726197 10373 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:28.727155 10373 tablet_bootstrap.cc:492] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:28.728017 10373 ts_tablet_manager.cc:1403] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.016s
I20260709 12:13:28.731369 10373 raft_consensus.cc:359] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.732331 10373 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:28.733134 10373 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.735951 10373 ts_tablet_manager.cc:1434] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:28.743225  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-447f05dcf4904c71bfa27d72667dc990 received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:28.743757  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-447f05dcf4904c71bfa27d72667dc990 on tablet 447f05dcf4904c71bfa27d72667dc990 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:28.746531 10373 ts_tablet_manager.cc:933] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:28.763114 10373 tablet_copy_client.cc:323] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:28.763585  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023d28c087e64377a9e2790180949da6"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:28.764246  9074 raft_consensus.cc:606] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:28.765465  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 422d007cdc2c44f4b486ca22b87c8dd8 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:28.765967  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 422d007cdc2c44f4b486ca22b87c8dd8 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-422d007cdc2c44f4b486ca22b87c8dd8
I20260709 12:13:28.769102  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030add77af8944519fa93baf328b3e4a"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:28.769752  8916 raft_consensus.cc:606] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:28.771888  9010 tablet_copy_source_session.cc:215] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:28.772531  8994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:28.773581  8994 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:28.776301  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:28.776804  9074 raft_consensus.cc:606] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:28.777860 10373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422d007cdc2c44f4b486ca22b87c8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:28.777925  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:28.779670  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.780341  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.793283 10373 tablet_copy_client.cc:806] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:28.793910 10373 tablet_copy_client.cc:670] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:28.798520 10373 tablet_copy_client.cc:538] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:28.816233 10373 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:28.850307 10373 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:28.851372 10373 tablet_bootstrap.cc:492] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:28.852057 10373 ts_tablet_manager.cc:1403] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.010s
I20260709 12:13:28.856330 10373 raft_consensus.cc:359] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.857211 10373 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:28.857883 10373 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:28.862802 10373 ts_tablet_manager.cc:1434] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:13:28.870368  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-422d007cdc2c44f4b486ca22b87c8dd8 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:28.870823  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-422d007cdc2c44f4b486ca22b87c8dd8 on tablet 422d007cdc2c44f4b486ca22b87c8dd8 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:28.924222 10373 ts_tablet_manager.cc:933] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:28.925977 10373 tablet_copy_client.cc:323] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:28.927479  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet b6874650616d4242a2b161a9a22a07ad from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:28.928054  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet b6874650616d4242a2b161a9a22a07ad from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-b6874650616d4242a2b161a9a22a07ad
I20260709 12:13:28.935706 10375 ts_tablet_manager.cc:933] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:28.938530  9083 tablet_copy_source_session.cc:215] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:28.943815 10373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6874650616d4242a2b161a9a22a07ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:28.952607 10358 raft_consensus.cc:993] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:28.953117 10358 raft_consensus.cc:1081] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:28.965309  9067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030add77af8944519fa93baf328b3e4a"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:28.966055  9067 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.966528  9067 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.973313 10375 tablet_copy_client.cc:323] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:28.974722  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:28.975298  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet c8a9c1b9c42c4bd88c49949bf6c32d9f from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-c8a9c1b9c42c4bd88c49949bf6c32d9f
I20260709 12:13:28.979738  9067 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:28.987531  9067 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:28.994354  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:28.995370  8924 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.995687  8924 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:28.996574  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:28.998030  9623 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.998852 10373 tablet_copy_client.cc:806] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:28.999389 10373 tablet_copy_client.cc:670] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:28.999444  8924 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.002302  8935 tablet_copy_source_session.cc:215] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:29.003664 10373 tablet_copy_client.cc:538] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:29.003161  8924 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.010406  8924 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:29.012111 10373 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:29.014470 10375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:29.023702 10327 raft_consensus.cc:993] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:29.024297 10327 raft_consensus.cc:1081] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:29.016580  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:29.026942 10363 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.028930 10363 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:29.029862 10363 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.040859  9623 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:29.042490  8924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:29.043051  8924 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.043412  8924 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.046471 10373 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:29.047375 10373 tablet_bootstrap.cc:492] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:29.047982 10373 ts_tablet_manager.cc:1403] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.004s
I20260709 12:13:29.050568 10373 raft_consensus.cc:359] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:29.051409 10373 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:29.051975 10373 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:29.062306 10375 tablet_copy_client.cc:806] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:29.063481 10375 tablet_copy_client.cc:670] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:29.061982  8821 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.067328 10375 tablet_copy_client.cc:538] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:29.067481 10373 ts_tablet_manager.cc:1434] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:13:29.069169  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-b6874650616d4242a2b161a9a22a07ad received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:29.069595  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-b6874650616d4242a2b161a9a22a07ad on tablet b6874650616d4242a2b161a9a22a07ad with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:29.086102 10375 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:29.107762 10363 raft_consensus.cc:993] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:29.109247 10363 raft_consensus.cc:1081] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:29.113099  8994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:29.113735  8994 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.114229  8994 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.124461 10375 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:29.125566 10375 tablet_bootstrap.cc:492] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:29.126291 10375 ts_tablet_manager.cc:1403] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.008s
I20260709 12:13:29.129541 10375 raft_consensus.cc:359] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:29.130441 10375 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:29.135460 10375 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:29.141444 10375 ts_tablet_manager.cc:1434] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:13:29.143162  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-c8a9c1b9c42c4bd88c49949bf6c32d9f received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:29.143617  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-c8a9c1b9c42c4bd88c49949bf6c32d9f on tablet c8a9c1b9c42c4bd88c49949bf6c32d9f with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:29.161087  8994 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.155995  8924 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.165195  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:29.165762  8995 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.166054  8995 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:29.166802  8995 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.167968  8995 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.176684  8994 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:29.177242  8924 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:29.178191  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:29.178737  9067 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.179992  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:29.180120  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:29.180573  8916 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.181407  9074 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.181874  9074 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:29.185500  9067 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:29.186865  8916 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:29.187659  8995 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:29.187702  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:29.189329  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:29.190658  9623 raft_consensus.cc:1217] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:13:29.190834 10327 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.191354 10327 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:29.192196 10327 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.194789 10367 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.195361 10367 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:29.196174 10367 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.182940  9074 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:29.200675  9074 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.208402  9074 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:29.219017  8819 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.260699  9623 raft_consensus.cc:1217] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:13:29.265537  8821 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.316139 10300 raft_consensus.cc:993] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:29.316653 10363 raft_consensus.cc:1081] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:29.318571  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "023d28c087e64377a9e2790180949da6"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:42094
I20260709 12:13:29.319109  9623 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.320183  9623 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.329952  9623 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.335263  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:29.335603  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:29.336268  9074 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.336474  9623 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:29.336622  9074 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:29.335848  8916 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.337488  9074 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.338770  9074 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.344403  8916 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:29.345485  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:29.345966  9074 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:29.346354 10343 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.346905 10343 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:29.347736 10343 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.367451  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 3 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.413378  9623 raft_consensus.cc:1217] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:29.546092  9623 raft_consensus.cc:1217] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:29.554225  8924 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.556541 10246 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.560220  9623 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.561862 10246 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.604461  8916 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.605743 10327 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.618609  9067 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.621110 10390 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.636458  8995 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.639206 10367 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.670226  9067 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.671543 10240 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.699563 10390 raft_consensus.cc:1064] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:29.705088 10390 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.717850  9623 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:29.718561 10246 raft_consensus.cc:1064] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:29.720517 10314 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.720897 10246 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:29.738174  9067 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:29.739877  9624 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:29.741458  8916 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:29.741642  8924 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:29.742578 10390 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.743413 10300 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:29.743480 10354 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:29.749464  8995 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:29.758528 10246 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.759855 10300 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.765215  9067 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:29.767083 10343 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:29.800869 10246 raft_consensus.cc:1064] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:29.803364 10246 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:29.823554 10407 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:29.837504  8921 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.840526  9074 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.845929 10300 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.834343 10354 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.852427  8991 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:29.853888  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.856953 10363 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.856616  9623 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.859889  9624 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:29.860275  8916 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.863976  8924 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:13:29.880234 10410 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:13:29.889605 10363 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:29.892355 10363 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.930581  8923 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:29.953841  8822 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:29.958760  8821 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:30.005630  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44013.5us
I20260709 12:13:30.027221  8995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566f7a1027e341e88b14a77db605c154"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:30.028306  8995 raft_consensus.cc:606] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:30.000649 10419 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:13:30.053460  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:30.054067  8991 raft_consensus.cc:606] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:30.063079  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:30.063861  8923 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
W20260709 12:13:30.069943  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 116452us
I20260709 12:13:30.105181  9624 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:30.118969  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 210639us
I20260709 12:13:30.105429 10413 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.149825  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f24528c4e0f24715985149f6366da832"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:30.150496  9067 raft_consensus.cc:606] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:30.166850  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:30.168514  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.169314  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:30.211555  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46051.7us
I20260709 12:13:30.262269 10392 raft_consensus.cc:1064] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
W20260709 12:13:30.262936 10392 raft_consensus.cc:1068] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Unable to promote non-voter 4993160378a142a1bc21648120cbaebc: Service unavailable: leader transfer in progress
W20260709 12:13:30.238387 10420 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:13:30.291803  8994 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.291733  8995 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.299883  9621 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.328285 10432 raft_consensus.cc:993] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:30.328894 10432 raft_consensus.cc:1081] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:30.335539  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f24528c4e0f24715985149f6366da832"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:30.336140  8991 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.336493  8991 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.342777  8991 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.344506  8991 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:30.350344  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:30.350911  9066 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.351181  9066 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:30.351964  9066 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.352834  9066 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.357045  8921 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.366108  9066 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:30.372845  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:30.373677 10437 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.374362 10437 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:30.375173 10437 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.412333  8821 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.439394  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:30.440210  8916 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.448671 10441 raft_consensus.cc:993] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:30.451036 10441 raft_consensus.cc:1081] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:30.449622 10437 raft_consensus.cc:993] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:30.452064 10437 raft_consensus.cc:1081] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:30.455508  9074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:30.456161  9074 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.456591  9074 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.460423 10437 raft_consensus.cc:993] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:30.460898 10327 raft_consensus.cc:1081] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:30.461364  8997 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:30.468279  9621 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:30.469743  8916 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:30.470053 10327 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:30.460744  8819 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.482101  9074 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.482199  9067 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:30.483788  8923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566f7a1027e341e88b14a77db605c154"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:30.484407  9074 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:30.484760  8921 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:30.487104  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:30.487408  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:30.487756  8924 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.488013  8991 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.488368  8991 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:30.490703 10437 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.492540  9621 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.484436  8923 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.499768  8923 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.492697  9066 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:30.489090  8991 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.507328  8991 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.515316  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 422d007cdc2c44f4b486ca22b87c8dd8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:30.515317  8921 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:30.517373  8823 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 5 to 6, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.487134  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:13:30.519867  8997 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.519903 10413 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:30.515527 10433 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:13:30.520358  8997 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.527774  8923 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.530696  8991 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:30.566017  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:30.566843 10413 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.567935 10413 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:30.568982  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:30.569547  8991 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:30.569818  8991 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:30.570487  8991 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.537437 10432 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.572147  8997 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:30.572674  8991 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.578955  8997 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:30.544391  8995 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:30.556192  8924 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:30.552218  9621 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:30.575657 10413 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.542747  8921 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.544545  9624 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:30.580830  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:30.585070  9066 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.546905  8925 raft_consensus.cc:2955] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.589860  8991 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:30.591032  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:30.545058 10392 raft_consensus.cc:1064] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:30.528088  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 422d007cdc2c44f4b486ca22b87c8dd8 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:30.595944  8923 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:30.596824  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:30.597462  9067 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:30.600792  9066 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:30.601768  8964 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:30.603590 10448 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:30.604063 10448 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:30.604071 10437 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.604733 10437 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:30.604770  9067 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:30.591882  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:30.597009 10392 raft_consensus.cc:1068] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Unable to promote non-voter 4993160378a142a1bc21648120cbaebc: Service unavailable: leader transfer in progress
I20260709 12:13:30.593557 10425 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:13:30.605202 10448 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:30.617769  8920 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.607160 10437 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:30.599618 10431 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:13:30.629752  8920 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:30.650924 10439 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:30.647585  8920 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:30.673049  8920 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.696882  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 447f05dcf4904c71bfa27d72667dc990 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:30.699724  9624 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.698441 10413 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.716672  8821 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.721009  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6874650616d4242a2b161a9a22a07ad with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:30.718428  9621 raft_consensus.cc:2955] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.725275 10449 tablet_replica.cc:333] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:13:30.736544 10449 raft_consensus.cc:2243] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.734311  8819 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.739537  8823 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 3 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.739720  8991 raft_consensus.cc:2955] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.739526 10449 raft_consensus.cc:2272] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.753763  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:30.754380  8997 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:30.754074  8821 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:30.761498  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:30.762032  8997 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:30.761533  8822 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:30.764432  8807 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c8a9c1b9c42c4bd88c49949bf6c32d9f already in progress [suppressed 3 similar messages]
I20260709 12:13:30.775970  8920 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:30.788519 10449 ts_tablet_manager.cc:1916] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.797904  9067 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.799686 10437 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.801770  8997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:30.802547  8997 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:30.801903  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 447f05dcf4904c71bfa27d72667dc990 with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:30.809772  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet b6874650616d4242a2b161a9a22a07ad with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47306
W20260709 12:13:30.810671  8871 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:13:30.811151  8871 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c8a9c1b9c42c4bd88c49949bf6c32d9f already in progress
W20260709 12:13:30.819965  8871 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c8a9c1b9c42c4bd88c49949bf6c32d9f already in progress
I20260709 12:13:30.849506 10449 ts_tablet_manager.cc:1929] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:30.850059 10449 log.cc:1199] T 422d007cdc2c44f4b486ca22b87c8dd8 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/422d007cdc2c44f4b486ca22b87c8dd8
I20260709 12:13:30.855376 10455 tablet_replica.cc:333] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:13:30.856074 10454 tablet_replica.cc:333] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:30.856855 10455 raft_consensus.cc:2243] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.857280 10454 raft_consensus.cc:2243] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.857808 10455 raft_consensus.cc:2272] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.858287 10454 raft_consensus.cc:2272] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.862749 10454 ts_tablet_manager.cc:1916] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.864454  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 422d007cdc2c44f4b486ca22b87c8dd8 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:30.862754 10455 ts_tablet_manager.cc:1916] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.894495 10454 ts_tablet_manager.cc:1929] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:13:30.895054 10454 log.cc:1199] T 447f05dcf4904c71bfa27d72667dc990 P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/447f05dcf4904c71bfa27d72667dc990
I20260709 12:13:30.905112  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 447f05dcf4904c71bfa27d72667dc990 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:30.915226  8920 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.917508 10427 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.934922 10455 ts_tablet_manager.cc:1929] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:30.935580 10455 log.cc:1199] T b6874650616d4242a2b161a9a22a07ad P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/b6874650616d4242a2b161a9a22a07ad
I20260709 12:13:30.937721  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet b6874650616d4242a2b161a9a22a07ad (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:31.041344  8923 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.042884 10427 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.048851  8925 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.050328 10432 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.064901  8997 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.066780 10425 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.076838 10437 raft_consensus.cc:993] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:31.077391 10437 raft_consensus.cc:1081] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:31.083205  9067 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.086046  9624 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Advancing to term 2
I20260709 12:13:31.088318 10429 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:31.103766  8925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:31.104610  8925 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.105150  8925 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.111303  9624 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.113837 10429 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.113677  8925 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:31.118953  8925 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:31.122236  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:31.122970  8997 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.123374  8997 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:31.124321  8997 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:31.125907  8997 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.127599  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:31.128244  9067 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.137955  8997 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:31.139221  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:31.140056  8991 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:31.140610 10392 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.143658 10392 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:31.144608 10392 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:31.144984  9067 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:31.156894 10392 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:31.163362  8822 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.167882  9067 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:31.169571 10392 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.533533  9074 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:31.534900 10448 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:31.542833  9621 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Advancing to term 3
I20260709 12:13:31.545331  8991 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:31.549876 10448 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:31.557307  9621 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:31.559229 10441 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:31.577729 10448 raft_consensus.cc:1064] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:31.580139  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.581313 10448 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:31.589277  9621 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:31.590492  8991 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:31.590818  9074 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:31.591751 10392 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.593153 10448 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.594096 10441 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.607743  9074 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.608585  8991 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.605325 10392 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.633513  8823 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.649852  9621 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.674739  8923 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:31.680311  9621 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:31.680416  9074 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:31.681706 10470 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:31.682945 10441 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:31.684809  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:31.685425  8923 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:31.690225  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:31.690878  8991 raft_consensus.cc:606] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:31.691057 10469 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.692679  9624 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.697312  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:31.698122  9074 raft_consensus.cc:2955] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.699424  8923 raft_consensus.cc:606] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:31.701471  8810 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:31.708163  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:31.708786  9067 raft_consensus.cc:606] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:31.708479  8823 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 5 to 6, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:31.710038  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:31.711440  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.712224  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.718533  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet c8a9c1b9c42c4bd88c49949bf6c32d9f with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49080
I20260709 12:13:31.726364 10471 tablet_replica.cc:333] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:13:31.727475 10471 raft_consensus.cc:2243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:31.728343 10471 raft_consensus.cc:2272] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:31.732765 10471 ts_tablet_manager.cc:1916] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:31.758255 10471 ts_tablet_manager.cc:1929] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:31.758602 10471 log.cc:1199] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/c8a9c1b9c42c4bd88c49949bf6c32d9f
I20260709 12:13:31.760363  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet c8a9c1b9c42c4bd88c49949bf6c32d9f (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:31.765885 10470 raft_consensus.cc:993] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:31.766467 10392 raft_consensus.cc:1081] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:31.768080  9074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:13:31.768590  9074 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.768894  9074 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.773361  9074 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:31.775417  9074 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:31.776114  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:31.776399  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:31.776773  8923 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.777056  8991 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.777117  8923 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:31.777910  8923 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:31.779038  8923 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.783643  8991 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:31.785002  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:31.785321  8923 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:31.786093 10425 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.786582 10425 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:31.787487 10425 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:31.797602  8823 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.804862 10437 raft_consensus.cc:993] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:31.805451 10437 raft_consensus.cc:1081] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:31.807160  9067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:31.807780  9067 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.808180  9067 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.814272  9067 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:31.816381  9067 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:31.817098  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:31.817219  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:31.817852  9624 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.817826  8991 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:31.818382  8991 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:31.819056  8991 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:31.820577  8991 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:31.825168  9624 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:31.826525  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:31.827443 10425 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:31.827929 10425 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:31.828684  8991 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:31.828692 10425 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:31.841364  8823 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.900353  8995 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:31.908172  8923 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:13:31.908250  8963 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f9e57d64a28430bb24c6a130105d58e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:31.908176  9067 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.909905 10429 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.910845 10437 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.919528 10429 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.921029  8920 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.930919  9067 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.933975  9074 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:13:31.946296  9037 consensus_peers.cc:597] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b9ee0b0b4df4d3abfdf4c57b26939a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:31.946148  8823 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.947384  8991 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.947877  8923 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:31.948727 10425 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.949577 10432 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.958585 10425 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.961478  8991 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.972705  8925 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:31.981289  8921 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:31.987671  8822 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 3, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.027715  8995 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:32.028558  8888 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 123584ad57374d41b689f4592fe92d4d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.030632  9074 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:32.033303 10425 raft_consensus.cc:993] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:32.033784 10425 raft_consensus.cc:1081] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:32.035852 10392 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.037422 10448 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.047761  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:32.048337  8991 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.048689  8991 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.054103  8991 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.056931  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:32.057519  9067 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.057822  9067 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:32.060186  9067 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.060017 10392 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.061503  9067 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.064795  9074 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.066560  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:32.067203  9624 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.068434  9067 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:32.069600  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:32.070317 10437 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.070786 10437 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:32.071718 10437 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.074218  9624 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:32.075724  8991 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:32.086354  8991 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.090731  8821 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.093888  8997 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.095162  8822 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:32.105648  8963 consensus_peers.cc:597] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 747c26453321457087376c5a57b2b7bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.106451  8925 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:32.108274 10427 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.106832  9074 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:32.116853 10427 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.118680 10429 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.121683  8925 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.128921 10441 raft_consensus.cc:993] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:32.129554 10441 raft_consensus.cc:1081] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:32.134786  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:13:32.135432  8991 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.135793  8991 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.142634  8991 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.145305  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:32.145876  8925 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.146149  8925 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:32.146453  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:32.147020  9624 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.146854  8925 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.148027  8925 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.151671  8822 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.155501  8925 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:32.157636  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:32.158941 10427 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.159452 10427 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:32.160259 10427 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.168099  9624 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:32.151798  9074 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:13:32.175361  8991 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:32.192879  8822 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.252693  8925 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.254101 10439 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.277055  8991 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.279048 10425 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.333206  9624 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:32.335943 10439 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:32.344157  8991 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:32.355084 10425 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:32.371944 10496 ts_tablet_manager.cc:933] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:32.374861 10496 tablet_copy_client.cc:323] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:13:32.376611  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:13:32.377166  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-6b9ee0b0b4df4d3abfdf4c57b26939a5
I20260709 12:13:32.401684  9083 tablet_copy_source_session.cc:215] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.424927 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.434391 10499 ts_tablet_manager.cc:933] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:32.451049 10499 tablet_copy_client.cc:323] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:32.452802  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 2f9e57d64a28430bb24c6a130105d58e from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:32.453356  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 2f9e57d64a28430bb24c6a130105d58e from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-2f9e57d64a28430bb24c6a130105d58e
I20260709 12:13:32.460217 10496 tablet_copy_client.cc:806] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.460892 10496 tablet_copy_client.cc:670] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.462725  9010 tablet_copy_source_session.cc:215] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.465008 10496 tablet_copy_client.cc:538] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.472991 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9e57d64a28430bb24c6a130105d58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.476568 10496 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:32.481624  9074 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:32.483176 10487 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:32.522857  9621 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:32.524788 10429 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:32.502336 10499 tablet_copy_client.cc:806] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.542047 10499 tablet_copy_client.cc:670] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.549000 10499 tablet_copy_client.cc:538] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.570933 10499 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:32.583456 10496 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.584704 10496 tablet_bootstrap.cc:492] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:32.585427 10496 ts_tablet_manager.cc:1403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.109s	user 0.034s	sys 0.023s
I20260709 12:13:32.588883 10496 raft_consensus.cc:359] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.590111 10496 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:32.590875 10496 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.593863 10496 ts_tablet_manager.cc:1434] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:32.597877  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-6b9ee0b0b4df4d3abfdf4c57b26939a5 received from {username='slave'} at 127.0.0.1:59490
I20260709 12:13:32.598326  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-6b9ee0b0b4df4d3abfdf4c57b26939a5 on tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:32.607359 10496 ts_tablet_manager.cc:933] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:13:32.614313 10496 tablet_copy_client.cc:323] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:13:32.616345  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 123584ad57374d41b689f4592fe92d4d from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:13:32.616920  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 123584ad57374d41b689f4592fe92d4d from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-123584ad57374d41b689f4592fe92d4d
I20260709 12:13:32.617884 10499 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.618628 10499 tablet_bootstrap.cc:492] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:32.619141 10499 ts_tablet_manager.cc:1403] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.007s
I20260709 12:13:32.622092 10499 raft_consensus.cc:359] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.622924 10499 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:32.623641 10499 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.624856  8935 tablet_copy_source_session.cc:215] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.626149 10499 ts_tablet_manager.cc:1434] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:32.628762 10496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123584ad57374d41b689f4592fe92d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.634140  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-2f9e57d64a28430bb24c6a130105d58e received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:32.634649  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-2f9e57d64a28430bb24c6a130105d58e on tablet 2f9e57d64a28430bb24c6a130105d58e with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:32.647805  8925 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.648499 10496 tablet_copy_client.cc:806] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.649003 10427 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.649147 10496 tablet_copy_client.cc:670] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.653021 10496 tablet_copy_client.cc:538] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.656353 10499 ts_tablet_manager.cc:933] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:32.671754  9621 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.673518 10487 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.680987 10499 tablet_copy_client.cc:323] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:13:32.683389  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 747c26453321457087376c5a57b2b7bb from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:13:32.683933  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 747c26453321457087376c5a57b2b7bb from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-747c26453321457087376c5a57b2b7bb
I20260709 12:13:32.684769 10496 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:32.691193  9010 tablet_copy_source_session.cc:215] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:32.710589 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747c26453321457087376c5a57b2b7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:32.730232 10496 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.731595 10496 tablet_bootstrap.cc:492] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:32.732415 10496 ts_tablet_manager.cc:1403] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.010s
I20260709 12:13:32.735656 10499 tablet_copy_client.cc:806] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:32.735509 10496 raft_consensus.cc:359] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.736310 10499 tablet_copy_client.cc:670] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:32.736565 10496 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:32.737970 10496 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.739899 10496 ts_tablet_manager.cc:1434] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:32.741954 10499 tablet_copy_client.cc:538] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:32.744661  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-123584ad57374d41b689f4592fe92d4d received from {username='slave'} at 127.0.0.1:45518
I20260709 12:13:32.745097  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-123584ad57374d41b689f4592fe92d4d on tablet 123584ad57374d41b689f4592fe92d4d with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:32.754491 10499 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:13:32.767859  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.782902 10499 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.783984 10499 tablet_bootstrap.cc:492] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:13:32.785254 10499 ts_tablet_manager.cc:1403] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 12:13:32.788611 10499 raft_consensus.cc:359] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.789580 10499 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:13:32.790299 10499 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:32.793042 10499 ts_tablet_manager.cc:1434] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:32.796007  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-747c26453321457087376c5a57b2b7bb received from {username='slave'} at 127.0.0.1:60214
I20260709 12:13:32.796416  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-747c26453321457087376c5a57b2b7bb on tablet 747c26453321457087376c5a57b2b7bb with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:13:32.801532  9621 raft_consensus.cc:1217] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:32.828236  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030add77af8944519fa93baf328b3e4a"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:32.828835  9074 raft_consensus.cc:606] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:32.833652  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:32.834180  9074 raft_consensus.cc:606] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:32.840334  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:32.840909  8991 raft_consensus.cc:606] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:13:32.841492 10439 raft_consensus.cc:993] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:32.841962 10439 raft_consensus.cc:1081] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:32.843652  8925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030add77af8944519fa93baf328b3e4a"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47330
I20260709 12:13:32.844170  8925 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.844549  8925 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.850246  9621 raft_consensus.cc:1217] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:32.850554  8925 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.843652  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:32.861400  8991 raft_consensus.cc:606] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:13:32.862763  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:32.864491  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.865245  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.869793  8925 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:32.871822  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:32.872766  9074 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.873397  9074 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:32.875869  9074 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.877260  9074 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.882941  9074 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:32.890808  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:32.891491  9621 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.904338 10429 raft_consensus.cc:993] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:32.904925 10429 raft_consensus.cc:1081] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer 4993160378a142a1bc21648120cbaebc to start an election
I20260709 12:13:32.919108  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:32.920949  9621 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:32.922508 10392 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.923051 10392 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:32.925019  9624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:34344
I20260709 12:13:32.931541  9624 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.932574  9624 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.924003 10392 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.963955  9624 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.966316  9624 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:32.966933  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:32.968140  9074 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.968881  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:32.969702  8991 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.969993  8991 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:32.970862  8991 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:32.972153  8991 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.975626  8821 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.980338  9074 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:32.981690  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:32.982746 10098 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.983356 10098 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:32.984210 10098 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:33.001060  8991 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:33.002151  8823 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.139076  9621 raft_consensus.cc:1217] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:33.208496  9621 raft_consensus.cc:1217] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:33.229030 10427 raft_consensus.cc:993] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:33.229738 10487 raft_consensus.cc:1081] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:13:33.231328  8925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47314
I20260709 12:13:33.231827  8925 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.232179  8925 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.238080  8925 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:33.240365  8925 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:33.241180 10432 raft_consensus.cc:1064] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:33.241631  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:33.242203  8995 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.242578  8995 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:33.242106  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:33.243094  9074 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.243350  8995 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:33.244561  8995 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.245868 10432 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:33.249725  9074 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:33.251263  8889 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:33.252087 10392 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.253170 10392 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:33.253917 10392 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:33.255291  8995 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:33.263903  8995 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.267172  9621 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.267112 10439 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:33.270141  8823 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.280124 10425 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:33.292124  8925 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:33.294068 10432 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:33.341318 10425 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:33.344719  8925 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:33.351707  8991 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:33.366132  9621 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:33.368778  8823 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.392838 10425 raft_consensus.cc:993] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:33.393450 10425 raft_consensus.cc:1081] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:33.396555  8995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:33.397080  8995 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.397434  8995 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.410570 10427 raft_consensus.cc:1064] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:33.413611 10427 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:33.435822  9621 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:33.447110 10470 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:33.450088  8997 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.451746 10518 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:33.652655  9067 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.843809 10098 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:33.922111  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 58956us
W20260709 12:13:34.176216  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 50958.1us
I20260709 12:13:34.277251  9074 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:13:34.327303  8995 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.929s	user 0.027s	sys 0.027s
I20260709 12:13:34.327975  8995 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.343958  8995 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:34.548048  8995 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:34.549292 10541 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.550305 10541 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:34.553344 10541 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:34.602186 10439 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:34.603147 10439 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:34.606424 10439 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.655228 10425 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.656177 10425 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.622877 10439 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.664222 10439 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.696142 10536 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:34.697187 10536 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.700176 10536 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.702483 10541 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.703325 10541 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:34.706190 10541 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:34.658900 10425 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.759760 10533 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.760743 10533 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.763862 10533 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:34.764601 10533 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.765300 10533 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.767954 10533 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:34.768574 10533 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.769333 10533 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.829727 10541 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.830796 10541 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:34.839089  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 1.38241e+06us
I20260709 12:13:34.230182  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.893966 10536 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.895030 10536 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.898000 10536 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.898705 10536 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.899499 10536 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:34.902215 10536 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:34.928992  8994 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.005s
W20260709 12:13:34.947188  8994 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.005s
I20260709 12:13:34.940779 10544 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:34.941306 10549 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.943377 10530 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:13:34.943704  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 170238us
I20260709 12:13:34.898005  8823 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 315) took 1532 ms. Trace:
I20260709 12:13:34.952937 10536 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.951318 10544 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.962777 10549 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.963137 10536 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.965395 10536 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.981805 10530 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.985144 10533 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:34.987826 10551 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:34.988687 10551 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:34.991914 10530 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:34.995945 10550 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:34.953506  8823 rpcz_store.cc:276] 0709 12:13:33.365480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.365626 (+   146us) service_pool.cc:224] Handling call
0709 12:13:33.636739 (+271113us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.636785 (+    46us) write_op.cc:454] Released schema lock
0709 12:13:34.897723 (+1260938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:33.480490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:33.481064 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:33.481099 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:13:33.481123 (+    24us) tablet.cc:662] Decoding operations
0709 12:13:33.481530 (+   407us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:33.481613 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:33.481648 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:33.481831 (+   183us) tablet.cc:701] Row locks acquired
0709 12:13:33.481848 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:33.482015 (+   167us) write_op.cc:270] Start()
0709 12:13:33.482152 (+   137us) write_op.cc:276] Timestamp: P: 1783599213481963 usec, L: 0
0709 12:13:33.482178 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:33.482908 (+   730us) log.cc:844] Serialized 591 byte log entry
0709 12:13:33.484866 (+  1958us) op_driver.cc:464] REPLICATION: finished
0709 12:13:33.485304 (+   438us) write_op.cc:301] APPLY: starting
0709 12:13:33.485378 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:33.485539 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:33.485661 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:33.485916 (+   255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:33.486123 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:33.486184 (+    61us) write_op.cc:312] APPLY: finished
0709 12:13:33.486359 (+   175us) log.cc:844] Serialized 23 byte log entry
0709 12:13:33.486637 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:33.486735 (+    98us) write_op.cc:454] Released schema lock
0709 12:13:33.486783 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":5,"reported_tablets":1,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":1755,"apply.run_wall_time_us":1754,"num_ops":1,"prepare.queue_time_us":1569,"prepare.run_cpu_time_us":2666,"prepare.run_wall_time_us":2666,"replication_time_us":2571}]]}
I20260709 12:13:34.998122 10551 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.029973 10555 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.035346 10555 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.020463 10551 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.036782 10551 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.026714 10533 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.040814 10548 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.041590 10548 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.045092 10551 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.046322 10555 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.046602 10548 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.053475 10545 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.054165 10392 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.055485 10546 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.056106 10546 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.061126 10546 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.046885 10557 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.046633 10533 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.055153 10392 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.065764 10533 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.066521 10392 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.069314 10555 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.069171 10542 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.071463 10555 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.069140 10554 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.071749 10542 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:34.667021 10439 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.072933 10529 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.054250 10545 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.074615 10549 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.077740 10529 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.083719 10529 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.084136 10555 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.083757 10545 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.085549 10561 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.085791 10542 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.062754 10557 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.072436 10533 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.081148 10554 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.086611 10561 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.126181 10561 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.119451 10533 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.131490 10546 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.134490 10546 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.138911 10556 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.132139 10561 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.154450 10557 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.154829 10546 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.155109 10547 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.155890 10545 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.166293 10545 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.169210 10545 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.169988 10562 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.139665 10556 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.165225 10533 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.172961 10541 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.174046 10556 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.165512 10554 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.180090 10561 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.170920 10562 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.186334 10544 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.192304 10547 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.183207 10561 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.214902 10565 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.212875 10556 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.220233 10567 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.220345 10564 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.216116 10548 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.227383 10392 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.228101 10392 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.223454 10561 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.231194 10545 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.240584 10548 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.240761 10545 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:35.243794 10439 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.244168 10518 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.244537 10439 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.229452 10568 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.221045 10567 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.238000  9074 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:35.239092  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.239393  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.230656  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.234807 10547 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.228945  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.242908 10548 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.248410  8995 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:35.225337 10556 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.254207 10532 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.244845 10518 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.221202 10564 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.242919 10545 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.258558 10570 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.259886  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.249527 10536 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.257134  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.269243 10567 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.247690 10565 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.274181 10392 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.262264 10557 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.254846 10532 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.266978 10561 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.284627 10569 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.284735 10546 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.285475 10546 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.288439 10563 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.286549 10571 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.292516 10557 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.293342 10547 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.293474 10556 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.281164 10562 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.292915 10441 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.279433 10570 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.297079 10439 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.280908 10536 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.285410 10569 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.284756 10423 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.300648 10561 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.297097 10557 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.304553 10564 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.301071 10565 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.304180  9068 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:35.347476  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 49298.9us
I20260709 12:13:35.302178 10548 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.294044 10547 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.300897 10563 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.360433  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.347424 10556 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.391646 10572 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.360564 10562 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.368983  8920 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:35.394925  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.392297 10572 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.393977 10441 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.389814 10554 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.399901 10554 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.401067 10518 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.400784  9066 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.401928 10554 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.404028  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.404107 10532 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.397133 10439 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.405834 10439 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.368343 10566 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.364283 10530 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.392664 10536 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.346642 10423 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.293557 10571 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:35.423693  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.430054 10574 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.430298  8819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 300) took 2012 ms. Trace:
I20260709 12:13:35.425974 10570 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.416913 10548 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.423527 10545 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.439613 10545 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.289543 10568 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:35.434656  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.443300  9068 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:35.432101  8819 rpcz_store.cc:276] 0709 12:13:33.412159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.412302 (+   143us) service_pool.cc:224] Handling call
0709 12:13:33.431260 (+ 18958us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400260110. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b17640 00007f398b9ee846 00007f398baf890e 00007f3989fb92a4 00007f3989fb9232 00007f3989fb9161 00007f3989fb90dc 00007f3989fb8392 00007f3983f7648c 00007f3983f758c6
0709 12:13:35.419772 (+1988512us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75065,"reported_tablets":1,"spinlock_wait_cycles":34361600}
I20260709 12:13:35.415977 10556 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.433776 10530 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.431896 10574 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.456692 10568 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.456911  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.457473 10575 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.446625 10562 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.457772 10548 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.459332 10439 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.461109 10563 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.461215 10569 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.457722  8916 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:35.464466 10571 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.431468 10566 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.458909 10575 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.475783  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:35.475414 10439 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.496208 10439 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.497692 10545 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.499182 10575 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.478403  8916 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.503283 10574 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.499006 10439 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.530552  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.530670  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.531085  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.531498  8993 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:35.532059  8994 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:35.538648  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.545758  8998 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:35.546164 10556 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.519533 10575 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.475389 10577 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.604020 10576 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.754303 10576 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.754505 10578 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.755216 10578 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:35.755982  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800163800 after lost signal to thread 7719
I20260709 12:13:35.547111  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.683452  8916 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:35.758186  8991 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
W20260709 12:13:35.757210  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800163ee0 after lost signal to thread 8857
I20260709 12:13:35.547554  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.762054  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.835121  8916 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:35.635782 10098 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.834729  8992 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:35.847205 10577 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.830482 10575 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.759438 10530 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.849393 10098 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.849731 10577 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.741037 10532 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:35.850816  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.834178  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.850885 10532 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.851819  9622 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:35.849797 10575 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.853008 10532 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.852896  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.854486  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.856060  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.692533 10574 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.868139  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:35.868518 10579 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.868350 10574 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.573892 10563 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.856783 10098 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.700533 10566 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.659253 10518 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.871717  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.872567  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.868343 10562 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.870314 10554 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.869158 10579 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.885701  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.873054 10544 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.889487  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.890527  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.891220  8821 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 326) took 2513 ms. Trace:
I20260709 12:13:35.891582  8821 rpcz_store.cc:276] 0709 12:13:33.377752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.377881 (+   129us) service_pool.cc:224] Handling call
0709 12:13:35.891021 (+2513140us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:13:35.893247 10427 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:35.893772 10427 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.895262  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.895889 10427 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.896423 10427 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.896813 10574 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.896934 10427 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.899384  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:35.900022  9070 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.900398  9070 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:35.901345  9070 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.902107 10546 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.899926  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.902531 10518 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.903419  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.903687  9620 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:35.904485  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.904734 10518 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:35.905661  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.905627  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:35.906301  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:35.906682  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.906786  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.907330 10581 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.907980 10581 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.907337 10574 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:35.909031 10574 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:35.910123 10581 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.910668 10554 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.911578 10574 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.912712 10554 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.913210 10554 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:35.913753 10554 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.886876 10578 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.879693 10563 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:35.918439 10563 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.919523  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.919956  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.920701  9072 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:35.922120  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.922456  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.923019  9072 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:35.923286  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.923687  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.923862  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.924461  9072 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:35.924918  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.926061  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.926625  9074 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:13:35.928187 10562 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:35.928800  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.929718  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.930428  9619 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:35.931789  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.932898  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.880108 10576 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:35.933465  9624 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:35.934691 10579 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.936122  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.936388 10544 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:35.936818  9619 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:35.938429 10544 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:35.887310  9622 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:35.939815  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:35.896425  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.941211  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.942219  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.942724  8924 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:35.902225  9070 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.945638  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.898994 10427 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:35.947489  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.949808 10556 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:35.950567  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.950897  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.951179  9622 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:35.951588  9624 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:35.952805  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:35.954716  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.968384  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.050623 10544 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.211866 10439 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:36.212026  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.212368 10439 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.212172 10544 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.212827 10439 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.173453  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:36.213548  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800370fa0 after lost signal to thread 8949
I20260709 12:13:36.118049  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:36.214530  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 96662.5us
I20260709 12:13:35.993548  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.050309  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.071025  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:36.214875  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 246581us
I20260709 12:13:36.158041  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:35.994766  9070 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:36.141939  8822 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 204) took 2741 ms. Trace:
I20260709 12:13:36.096618  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.242516  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.132154  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.239147  8822 rpcz_store.cc:276] 0709 12:13:33.400620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.400772 (+   152us) service_pool.cc:224] Handling call
0709 12:13:36.141728 (+2740956us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":23296}
I20260709 12:13:36.214557 10544 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.254194  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.252601  9623 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:36.254437  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:35.993140 10554 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.170974 10423 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.179375 10441 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.035416 10427 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.050601 10578 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.255860  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.255925  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.278374  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.279482  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.280524  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.281069  8924 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:36.256222  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.282770  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.137102  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.214666 10563 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.283825  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.284062 10563 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.284384  9067 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:36.258229  9622 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:36.136404  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.286298  9040 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.096892 10576 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.117700  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.262357  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.262727  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.263592  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.262349  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.135140  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.272253  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.096966 10574 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.284497 10563 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.274638  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.254491 10571 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.276366  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.315762  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.343182  8924 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:13:36.343698  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.344208  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.287092  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.317574  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:36.266319  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1d20 after lost signal to thread 9024
I20260709 12:13:36.341903  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.347959  8925 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:36.349994  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.350188  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.315861 10581 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.359743  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.290652 10554 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.321266  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.289294 10547 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:36.382579  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 99559.4us
W20260709 12:13:36.350016  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800335b60 after lost signal to thread 9025
W20260709 12:13:36.383536 10585 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:13:36.384290  9021 debug-util.cc:398] Leaking SignalData structure 0x7b080029cf40 after lost signal to thread 9098
W20260709 12:13:36.385475  9021 debug-util.cc:398] Leaking SignalData structure 0x7b080033c360 after lost signal to thread 9649
I20260709 12:13:36.385710  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:36.385761  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3fa0 after lost signal to thread 9650
I20260709 12:13:36.387486 10577 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.387905 10577 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.388101  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.388906  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.390604  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.345083 10423 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.321893 10439 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.392005  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.351037 10584 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.365626 10576 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.394717 10584 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.395699 10423 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.397024 10584 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.397445 10576 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.397710 10423 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.365124  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:36.398588  8889 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.398808 10547 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.273705 10583 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.367831 10554 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.349781  8917 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:36.322440  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.370679  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:36.358289 10571 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.411415 10571 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.373602 10572 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.413331 10554 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.414829 10439 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.345911 10427 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.415670  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.416242 10590 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.416730 10556 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.417055 10427 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.416796 10590 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.399217 10547 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.419556 10545 raft_consensus.cc:1064] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:36.419612 10547 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.422042 10545 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.362823 10581 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.423430 10581 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.423368 10583 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.425733 10583 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.388294 10577 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.375478  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.391193  9071 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:36.366463  9622 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:13:36.399430  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 167916us
I20260709 12:13:36.390897  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.271567 10544 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.401983  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:36.364069  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.417270 10556 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.437076 10556 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.400027  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.409469  8923 raft_consensus.cc:606] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:36.320263 10578 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.441421 10578 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:36.443936  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 52467.3us
I20260709 12:13:36.444561 10536 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.444701  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.444976 10536 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.445349 10536 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.445847  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.446650 10425 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.446991 10425 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.447184 10575 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.447381 10425 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.447656 10575 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.447798 10427 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.448115 10575 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.448331 10427 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.314090 10582 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.345804 10574 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.436177 10544 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.447000  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.419027 10590 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.472800  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.464381 10589 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:13:36.471149  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.428874 10584 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.475284  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.475633 10584 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.476291 10544 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.458519 10427 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.459024 10572 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.479369 10572 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.479857 10572 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.468037  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.481498 10427 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:36.481997 10427 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:36.459710  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57805us
I20260709 12:13:36.482982 10427 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.484844  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.487353 10574 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.488816  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.489705  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.490513  9074 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 2: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:36.491412 10530 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.491887 10530 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.492266 10530 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.491439  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.497248  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.468600  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.503520  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.503779  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.503944  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.504149  8997 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:36.500362 10441 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.505043 10441 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.505420 10441 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.502043  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.507216  8991 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:36.509586  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.510198  8992 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:36.510826 10536 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.508541  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.518211  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.519027  8991 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:36.497426 10584 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.523972  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.524245  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.497567 10574 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:36.526294  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.527614  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.527778 10589 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.520788 10590 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.528196  8991 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:36.533222  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.528003 10563 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.522234 10546 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.537631 10546 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.537385 10556 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.538084 10546 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.520905 10577 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.534451 10589 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.535199 10590 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.544435  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:36.544726  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.496189 10582 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.546555  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.549335  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.549233 10425 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.545639 10590 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.551594  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.552541  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.555462  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.560245  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.560922  8997 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:36.543512 10567 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.589241 10425 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:36.596630  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50151.9us
I20260709 12:13:36.591162 10536 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.589186 10567 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.614442  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.599502  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.629011  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.632059  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.632604  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.602398 10574 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.635530  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.639192  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.640744  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.643805  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.643790  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.645658  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:36.645776  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.647001  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.628774 10567 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.647914  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.648231  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.648320  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.648763  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.652276  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.684813 10425 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.685318 10425 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.685690 10425 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.650004  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.626016 10592 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.686600  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.636138 10556 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.646219  9074 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:36.695861  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:36.650550 10591 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:36.647539 10562 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.650391 10544 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:36.650527 10584 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:36.698318  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:36.704638  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.719818  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:36.691021 10592 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.707295  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:36.724066  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 129066us
I20260709 12:13:36.701524 10536 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.709780  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.711930  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.705029 10562 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.640808 10581 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.729081 10425 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.748456  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:36.732335  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 96920.1us
I20260709 12:13:36.738914  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.742055  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.735551 10439 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.704067 10544 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.661494 10547 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.648739 10574 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.652405 10575 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.779727  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:36.743831  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 129537us
I20260709 12:13:36.780870  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.781504  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.782061  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.722515 10582 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:36.722915 10579 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.737818 10536 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.744861 10576 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.790576  9065 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:36.736569 10592 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.783627  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.701192 10441 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.784325  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.785223  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.796030  9070 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:36.749472 10562 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.785828  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.800940  8994 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:36.785828  9074 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:36.783658  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.786775 10425 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.801882  9065 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:36.802718  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.787595  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.700572 10596 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:36.751116 10439 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.807608 10439 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.765429 10544 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.787720 10598 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:36.794548  9619 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:36.794745  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.744376 10594 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.795271  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:36.754386 10563 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.796715  8925 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:36.815667  8992 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:36.788911 10579 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.790827 10576 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:36.803807  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.804492 10584 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:36.784598 10571 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:36.806569 10554 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.806550  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.805099 10596 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.812676 10575 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.791108 10536 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.818635  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.818722  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:36.799659  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:36.823061 10576 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.755573 10578 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.813095 10599 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.808374 10574 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.827641  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.805449 10589 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.831082  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:36.831724  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 279233us
I20260709 12:13:36.832858  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.791986 10572 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.834010  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.821084 10579 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.837783  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.839726  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:36.822306  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.829011 10583 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:36.852381  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:36.823774  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.825644 10554 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.843905 10593 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:36.836007 10596 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.847661 10599 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.848552  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.856491  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.844559 10441 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.831276 10594 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:36.859536  8922 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:36.859634  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.860960 10589 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:36.854848  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.903923  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.908514  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.907454  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:36.857658 10554 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:36.907415  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73022.3us
I20260709 12:13:36.860884 10556 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:36.921687  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60535.4us
I20260709 12:13:36.925912  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.865087 10599 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.926541  8992 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:36.860802  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.901461 10427 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:36.865859 10584 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:36.934401  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:36.906273 10441 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:36.944054  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 95589.9us
I20260709 12:13:36.944309 10608 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:36.944777 10612 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:36.945056  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:36.945458 10608 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:36.945858 10608 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:36.945891 10612 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:36.946491 10612 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:36.947953  9073 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:36.920725 10581 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:36.922955 10556 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.933935 10584 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:36.931613 10547 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.953352 10556 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:36.954778 10605 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:36.905975 10562 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:36.956938  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 75206.5us
I20260709 12:13:36.938946 10567 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:36.957690  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95090.9us
I20260709 12:13:36.959966  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:36.938853 10590 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.962829 10614 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:36.957350  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 204492us
I20260709 12:13:36.964901 10616 raft_consensus.cc:1064] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:13:36.975299  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.962828  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:36.965790 10572 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:36.965713  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:36.941262 10441 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:13:36.959077  9588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.523s (SENT)
I20260709 12:13:36.968693  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.953735 10597 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:36.982709 10597 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:36.983266 10597 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:36.971053  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.956058 10584 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.949234  9616 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:36.947551 10612 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.976442  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.980249  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:36.981410 10441 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:36.980945  8992 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:36.982052 10578 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.005553  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.012223  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.013265 10425 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:36.946883 10608 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:36.979099 10581 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.017601  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.022979  8994 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:37.016389  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109932us
I20260709 12:13:37.023825  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.029667  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.030742 10609 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.032419  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.034332 10544 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.036934 10599 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.037081 10554 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.016011 10574 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.048255  8922 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:37.054234  8925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:37.056746  8925 raft_consensus.cc:606] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.053148  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:37.057760  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 86779.8us
I20260709 12:13:37.058498  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:36.974382 10605 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.061599 10605 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.063544  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.071710 10610 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:37.073102 10610 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:37.073596 10610 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:37.074693 10610 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.076335 10610 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:37.081159  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 99936.7us
I20260709 12:13:37.062913 10612 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.084096 10594 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:37.086213  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.063931 10582 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.067520 10608 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.091174  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.067989 10577 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.059140 10572 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:37.062808 10609 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:37.095129  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:37.102375  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:37.102291 10572 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:37.102811 10572 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:37.093096 10611 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:37.103636  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.120293 10611 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:37.097396 10554 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:37.123333  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.123870  8991 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:37.101228 10609 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.111157 10590 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:37.120488 10618 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.135308  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.120862 10611 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:37.131825 10530 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.008s
I20260709 12:13:37.138890  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.140959  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:37.121726 10439 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.140107  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.149121 10619 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.151283  9000 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.154142 10439 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:37.154788  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.156661  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 93194.5us
I20260709 12:13:37.142264 10530 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.159930 10597 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.156661  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.140869 10572 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.163406  9000 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 2: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.165611  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.162360 10599 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:37.168546  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.169227  8999 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:37.171824  8994 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:37.172758  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.166823 10579 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.184885  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.189947 10597 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.193608  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.174576 10594 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.184753 10572 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.200147 10536 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.201399  9072 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:37.162477 10592 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:37.207875 10546 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.009s
I20260709 12:13:37.208367 10546 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.210803 10546 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.215396  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.216048  8992 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.216377  8994 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.216991  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:37.217231  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128301us
I20260709 12:13:37.218137  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.219027  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:37.219827  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49600.1us
I20260709 12:13:37.219202  9590 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:37.222640  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.225011  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.234896  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.236945  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.238083 10536 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.221975 10590 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.219697 10563 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.242830  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.243093  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.247587  8994 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.232443 10577 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.246646  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.250420 10615 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.230132 10574 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:13:37.252701  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.254417 10620 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:37.254889 10620 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:37.255306 10620 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.245208 10441 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.259871 10556 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.260507  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.260993  8919 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:37.261119  8997 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:37.261773  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.262036  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.262502  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.262933  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.263489  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.264219  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.264690  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.262524  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.265523 10592 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.263723  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.250875 10621 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.270282  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.270932  8994 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:37.273272  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.247562 10530 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.261946  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.285522  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.262048 10556 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.284368  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.257927 10590 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.286845  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.287158  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.288410  8998 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:37.290143  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.291280  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.292068  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.293103  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.295903  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.296821  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.301244  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.272526 10584 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.305790  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.304881 10618 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.305063  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.303985  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.304878 10623 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.247396 10616 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.307163  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.300304 10596 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:37.374938  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.396924  9071 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.291141 10554 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.369153  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.370683  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.291213 10599 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:37.370062 10603 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.574s	user 0.005s	sys 0.003s
W20260709 12:13:37.405033  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 101172us
I20260709 12:13:37.406061  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.411334  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.394317  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.414803 10545 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.415077 10556 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.398790  9616 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:37.303679 10579 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.415472 10592 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.421272 10544 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:37.423102  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 177909us
I20260709 12:13:37.424887  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:37.426851  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.428639  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:37.429912  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:37.430735 10562 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.431203  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.431391  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.431540  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.432503  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.432932  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.433696  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.434108  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.434257  8997 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:37.436527  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:37.437042 10609 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.438068  8995 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.439087 10609 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:37.439695  9070 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.428655 10584 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.449836  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.451778  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.441962  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.309505 10576 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:37.454828  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.415349 10628 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:37.457019  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:37.458549  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 165503us
I20260709 12:13:37.459831  8922 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:37.460091  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.458699  9074 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.461555  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.461591  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.461499  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:37.462874  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.463657  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.466307  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.452694 10625 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:37.468145  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.469098  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.469843  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.469929  8997 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:37.471052  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.471832 10594 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.472146 10579 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:37.476058  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.455384 10530 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:37.484650  8920 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.486377  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.486636  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.487344  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.488427  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.462215 10584 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.472499 10594 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.490149  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.483685  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.492208  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.494418  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:37.495424  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.489763  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.500787  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.501951  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.502764  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.503762  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.453303 10611 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.481113 10618 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.504647  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.505064  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.472569 10579 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:37.513604  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.507833  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:37.510334  9073 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.498111 10607 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:13:37.508482  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53486.4us
I20260709 12:13:37.536717  8920 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.535770 10615 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:13:37.544575  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.505131 10605 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:13:37.536504 10581 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:13:37.592509 10615 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.592921 10615 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:37.593175  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.593752 10615 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.594784 10612 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.596716  8999 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:37.597513  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.597548  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.546576 10631 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.536193 10579 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.512065  8997 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:37.564913  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.566992  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.574478  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.565553  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.496774 10530 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.567005  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.606701 10605 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.607136  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.607779 10530 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.608109  8996 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:37.608355 10530 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.608706 10530 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:37.609555 10530 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.513168 10574 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.611492  8995 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 2: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.530827 10618 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:37.589654 10633 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:37.591020 10546 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:37.591301 10597 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:37.594935 10615 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.601095  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.614705  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.583050 10596 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:37.617300  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76429.2us
I20260709 12:13:37.613564  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.619918 10597 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.620266 10633 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:37.620551 10601 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.620708 10633 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:37.620772 10597 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.619874  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.621256 10597 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:37.621665 10633 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.622061 10597 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.602739 10562 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.622964 10633 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.619325  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.628646 10592 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.628569  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.629093 10592 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:37.607144 10605 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:37.629920 10592 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.630122 10605 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.628580 10608 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.631498 10605 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.627583 10597 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.633363 10441 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.635272  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.637202  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.637359  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.648113  8924 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.645356  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.640198  8994 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.661129  8995 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 2: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.650249  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.664188  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.616312 10618 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.669979  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.691499  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:37.671365  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 229437us
I20260709 12:13:37.693660  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.678524  8966 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:37.716389  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 52268.8us
I20260709 12:13:37.716279  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:37.719062  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50504.9us
I20260709 12:13:37.658741 10592 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.721210  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.727975 10632 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:37.639390 10441 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.640440 10547 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.656296 10567 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.723773  9074 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.638270 10530 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.746551  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.722347  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:37.730300  9073 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.748773  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.647341 10612 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.721002 10423 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:37.721865  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.679435 10615 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:13:37.739353  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.755707  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.667533  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.642694 10611 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:37.638551 10625 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.679054 10595 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.742255  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.718789 10572 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.761225  8920 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:37.715315  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:37.732982  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:37.721987 10601 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.721022 10590 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.587600 10607 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.739409 10598 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.755208  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.764259  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.766032 10640 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.739478 10635 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:37.753645 10582 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:37.770164  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.770279  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.773092  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.772478 10601 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:37.772502 10572 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.776386 10640 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.777300  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.646791 10620 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.754045 10423 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.758056 10547 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.782874  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.799146  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.800477  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.760969 10563 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.766855 10632 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:13:37.808830  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 87681.6us
I20260709 12:13:37.796499  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.796855 10566 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.797163  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:37.783216  8996 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:37.769433 10544 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.807843  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.763458 10567 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:13:37.824873  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.644942 10554 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:37.767949 10590 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.788829 10545 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.821368  8916 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:37.828186  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.806653 10423 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:37.819178 10441 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.808701 10597 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:37.839598  8992 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.843458 10597 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.843927 10597 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.806785 10547 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.844544 10582 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.848313 10582 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.793467 10640 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.812034 10611 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.860536  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.868077  9000 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:37.806392 10579 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.834537 10590 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.871068  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:37.874008  9617 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:37.877215 10581 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:37.898516 10581 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:37.898928 10581 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:37.878865  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.835734  9618 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:37.877871 10629 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:13:37.849596 10547 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.845981 10595 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.844652 10635 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:13:37.914238 10607 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.910463 10611 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.916184 10629 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.901890  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.919370  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.832543 10572 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.925174  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.920454  8888 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:37.899806 10581 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:37.839986 10545 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:37.851698 10556 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:13:37.930924  8923 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.932027  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.929689 10601 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:37.933211 10615 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:37.943859  8920 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:37.945178  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.948263  9623 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.916584 10629 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:13:37.951973  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.953696  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:37.924235 10567 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.928284 10611 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:37.959550  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.944774 10608 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.962165  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.935840 10563 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.964673  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:37.797191 10574 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:37.959141  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:37.959815 10556 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:37.960647 10581 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:37.936342 10545 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.980792  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:37.987223  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123860us
W20260709 12:13:37.995501  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 246799us
W20260709 12:13:37.996150  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67412.8us
I20260709 12:13:38.000555  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.001021  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.002290  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.002635  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.002883  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.003903  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.005119  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.965864 10546 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.974090 10567 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.971660 10608 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:38.008021  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:37.899644 10632 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.009755  9073 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.971490 10563 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:37.990088 10596 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.982435 10556 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:38.014218  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:37.970619 10607 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:13:38.044308  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.025986  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.024842  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.007624  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.047530  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.048496  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.006320 10584 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:13:38.043991  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.053139 10644 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.049428  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.056201  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.056035  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.069862  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.023154 10608 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.053817 10536 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.058925 10576 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:38.055099 10544 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.059979 10556 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.064018 10579 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:38.047230 10596 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.085961 10596 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.018707 10628 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:13:38.075285  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.104118 10637 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.077315 10619 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.080416 10598 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:38.118942  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 43771.2us
I20260709 12:13:38.122342  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.043385 10629 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.078794 10605 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:13:38.128108 10589 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.114333 10556 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.129988 10427 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:38.135532 10566 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:38.153644 10441 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.154114 10441 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:38.129254 10544 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.155009 10441 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.181365 10547 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.182677  8923 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.185542 10572 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.138016 10618 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.191048 10597 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.191824 10642 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:38.191713  9621 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:38.195333 10547 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.201324 10439 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.110622 10563 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.267454  8992 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.268424  8916 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:38.269622  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 225669us
I20260709 12:13:38.225195 10545 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.275869 10637 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.276994 10637 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.277370 10637 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.278290 10637 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.280215 10545 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.280488 10577 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:38.282301 10637 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.192762 10590 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.228084 10601 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:38.285938 10601 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.286809 10601 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.288260 10601 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.302836 10590 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:38.304409  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.177740 10423 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.260746 10439 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:38.253463  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 178086us
I20260709 12:13:38.253688  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.216573 10579 raft_consensus.cc:993] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:38.189281 10582 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.328912  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.327437  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 514) took 1049 ms. Trace:
I20260709 12:13:38.336920  9617 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:38.337460 10579 raft_consensus.cc:1081] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:38.339668  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:38.342181  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 297578us
I20260709 12:13:38.344148  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.346026  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.352545  8925 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.353175  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.229909 10608 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.311738 10640 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.345237 10605 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:38.363505  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.350317 10536 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.332052  9618 rpcz_store.cc:276] 0709 12:13:37.278457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.278655 (+   198us) service_pool.cc:224] Handling call
0709 12:13:37.279075 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.913298 (+634223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.319476 (+406178us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400770e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:38.320887 (+  1411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242882816}
I20260709 12:13:38.356704 10530 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:13:38.350270 10615 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.268059 10642 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.394352  8925 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:38.348523 10545 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:13:38.396159 10579 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.397020 10423 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.397233 10596 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.400432  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.427392 10596 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:38.424126  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.428380  9074 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:38.429340 10640 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:38.430250  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.431434  9615 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.431479  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.432118  8925 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.348847 10577 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.409114  9623 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.410733  8924 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.439639  8920 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:38.433662  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.350981 10597 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.416162  8922 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:38.447723  8925 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:38.416862 10530 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.419050 10642 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.419874 10545 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.420877  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.425127 10536 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:38.478605  8925 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.414271  8919 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.408542 10605 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.433761  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:38.448298  8923 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.449959  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:38.486755  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53067.4us
I20260709 12:13:38.480293 10554 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:38.442050 10441 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.436841 10582 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.493258  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.480258 10530 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.479280 10545 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:38.483963  8925 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:38.435127 10620 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:38.486304  8920 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:38.504678  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 54846.4us
I20260709 12:13:38.494550  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.494716  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.498250  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.498327  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.499220  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.499790  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.500777 10642 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.501480  9067 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.501606 10608 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:38.493850  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.513868  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.492825 10632 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.432749 10574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58540 (request call id 74) took 3027 ms. Trace:
I20260709 12:13:38.538882 10614 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:13:38.510488 10536 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.551594 10536 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.527190 10632 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:38.552567 10536 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.553269 10632 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.510618 10577 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:38.511113 10651 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.555150  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.507064  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.514700  8923 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:38.502795 10655 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:38.519699 10605 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.559204 10594 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.561439 10614 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:38.561694 10605 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.508422 10554 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.524283 10545 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.525691 10439 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.526669  8918 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.530226  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 240) took 1081 ms. Trace:
I20260709 12:13:38.530871  9073 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.566498 10545 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.512228 10616 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:38.531594 10618 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:38.535035  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 181955us
I20260709 12:13:38.567744 10544 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.568130 10544 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.568789 10577 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:38.569058 10544 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.570303 10544 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.535494  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.540042 10563 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.572198 10584 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.577980 10584 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.509680  8991 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:38.578784 10584 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.524813 10530 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.579854 10584 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.580183 10530 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.549043  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.549247  8920 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.565941  9616 rpcz_store.cc:276] 0709 12:13:37.448968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.453198 (+  4230us) service_pool.cc:224] Handling call
0709 12:13:37.914983 (+461785us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:38.190417 (+275434us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16e9c 00007f3982b16a5b 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:38.190643 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.421689 (+231046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.421727 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.424991 (+  3264us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:38.425054 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.529982 (+104928us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540069f354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:38.530034 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.530167 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543652480}
I20260709 12:13:38.550464  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.550465  9618 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.558692  8993 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:38.559262  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52266.8us
I20260709 12:13:38.555712 10651 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.562376  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.562367  9072 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:38.591010 10651 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.592209  8821 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.594825 10618 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:38.594620  8821 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.595363 10618 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.587091  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.547274 10574 rpcz_store.cc:276] 0709 12:13:35.387630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.390711 (+  3081us) service_pool.cc:224] Handling call
0709 12:13:35.412665 (+ 21954us) log.cc:844] Serialized 487 byte log entry
0709 12:13:36.168483 (+755818us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54003843a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb4142 00007f3985b94eaa 00007f3985b9bd53 00007f3985b9bcd9 00007f3985b9bc69 00007f3985b9bc31 00007f3985b9adfd 0000000000388634 0000000000388479 00007f3982b4e475
0709 12:13:36.171316 (+  2833us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4c0040c000. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3983f07a20 00007f3983f18a29 00007f3983f1913f 00007f3983edd2ab 00007f3983f0af3c 00007f3983f0b3fe 00007f398419850b 00007f3985b97381 00007f3985b9526b 00007f3985b9bd53 00007f3985b9bcd9
0709 12:13:38.413410 (+2242094us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34095,"raft.queue_time_us":44301,"raft.run_cpu_time_us":75727,"raft.run_wall_time_us":1095366,"spinlock_wait_cycles":65535616,"thread_start_us":166764,"threads_started":1,"wal-append.queue_time_us":332703,"wal-append.run_cpu_time_us":1916,"wal-append.run_wall_time_us":1026648}
I20260709 12:13:38.574684 10554 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:38.607288 10439 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.576319 10629 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.582454  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.534750 10642 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:13:38.559062 10648 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.561856 10614 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:38.572731 10599 consensus_queue.cc:1175] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4993160378a142a1bc21648120cbaebc" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:13:38.588346  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:38.588403 10589 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:38.588974 10590 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.603790  8916 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:38.619922 10639 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.620311 10639 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:38.621143 10639 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.622539 10639 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.612048  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.628345  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.600191 10618 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.614998 10658 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.632182 10657 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.632779 10658 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.633818 10590 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.634183 10590 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.635098 10590 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.613176 10594 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:38.629451  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.640645  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.641947  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.614452 10648 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.642906  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:38.643724  8916 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:38.644550  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.617055  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.636266 10590 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.651038  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.649174 10658 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.658623  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.659411 10601 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.660166 10642 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.660888  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.662199  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.648579 10536 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.674398  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.664043  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:38.664278 10618 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.664582  8919 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:38.675307  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 62266.6us
I20260709 12:13:38.665376 10598 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.662883 10601 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.667807 10655 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.649804 10637 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.623615 10554 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:13:38.648022 10574 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.677982  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.651834 10594 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.684827  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.661937 10616 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:38.687072  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.695613  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.678182 10618 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.679512 10577 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.683414 10655 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:13:38.710026  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.711119  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.713004  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.713816  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:38.714425  9072 raft_consensus.cc:606] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:38.690218 10651 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.695731 10536 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.720294  8991 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:38.715615  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.716805  8822 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 2 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.688105 10441 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.699980 10628 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.722052  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.697798 10545 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:38.723067  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.699528 10637 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.706306 10574 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.730841  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.725404 10649 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.740309  9072 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:38.740414  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 90917us
I20260709 12:13:38.741597  8966 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.724478 10536 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:38.743436  9070 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.743830 10536 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.743891  8889 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:38.671837 10614 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.745579  9070 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:38.720719 10547 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.735836  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.725019  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:13:38.747668  8997 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.748028  8997 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.749097  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.749905  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.750512  9066 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:38.703006 10616 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.727411 10567 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.752707  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:38.727612  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.754837  9066 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:38.727041 10577 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:13:38.744300 10536 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.726300 10628 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.760713 10589 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.755761 10597 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.741632 10608 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.749331 10594 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.764295 10562 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.781023 10562 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:38.780915 10628 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.781966 10628 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.782124 10562 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.764557  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:38.772389  9066 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:38.718508 10648 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.723874 10651 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.735428 10441 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.787544  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.762990 10554 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.749650 10584 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:13:38.794009  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:38.794832  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:38.753813 10599 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:13:38.791407  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.791934  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.802424  9072 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:38.783828 10536 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.785818 10574 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:38.795594  8919 raft_consensus.cc:606] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:38.785593 10608 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.799834 10605 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.785874 10655 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.819695 10648 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.807574 10574 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.831760 10605 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.832253 10655 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.832883 10574 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.833982 10605 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:38.834219 10574 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:38.754235 10618 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.823339  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:38.835711  8919 raft_consensus.cc:606] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.835829 10618 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.836000  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:38.836386  8919 raft_consensus.cc:614] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:38.836820  8916 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:38.838021  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:38.816762 10616 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.839632  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:38.828490  9618 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.841208  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:38.826001 10441 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.842154 10605 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.842566 10605 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.842909 10605 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.841212  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:38.815686 10651 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:38.813855  9074 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:38.789882  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:38.848187  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58403.7us
I20260709 12:13:38.848326  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.849002  9066 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
W20260709 12:13:38.849432  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 100415us
I20260709 12:13:38.851622  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.853425  8916 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:38.853611  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.855027 10577 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:13:38.856132 10577 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.856508 10577 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:38.855688  8919 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:38.847388 10554 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.858814 10554 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.852370  9066 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:38.863544  8997 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:38.864498  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:38.820500 10659 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:38.876740  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.879315 10545 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:38.879693 10563 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:38.864990 10651 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.831297 10608 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.810565 10657 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:13:38.922147 10566 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:38.928870 10608 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.889716 10544 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.929432 10544 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.857396 10577 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.893460 10584 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:38.894465 10637 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.895828 10614 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.896183  8996 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.896426  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.896773  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.874931 10567 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.897643  9616 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:38.898291  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.898579  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.878111  8889 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:38.937525  8994 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
W20260709 12:13:38.937630  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59619.6us
I20260709 12:13:38.898305  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:38.938303  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.938655  8998 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:38.899199  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.899219  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:38.906040 10605 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.916635  8997 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:38.921453  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44803.7us
I20260709 12:13:38.940234  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:38.939685  9000 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:38.938503  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:38.824487 10632 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.941604  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.948415  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:38.934429 10545 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:38.954185  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 157914us
I20260709 12:13:38.935333 10544 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.945276 10662 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.964632  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.965747  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:38.942039 10648 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:38.946646 10629 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.942181 10547 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.948428 10566 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.950881 10562 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.954408 10598 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.955011 10655 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.989557  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:38.989415 10598 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.989894  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:38.966192 10423 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:13:38.971287 10662 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.990667  8994 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.990837 10662 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.988595  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:38.936831 10584 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.019587 10584 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.020519 10423 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.983667 10544 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.020955 10423 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:39.021909 10423 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.982729 10616 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:13:39.024693  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.025288 10616 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.025581  8917 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.025686 10616 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:38.941200 10637 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:38.941578 10567 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.002897 10661 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:39.033782 10567 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.011030 10545 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.031152  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:38.992002 10664 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:13:38.992512 10562 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.984259 10648 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:38.964572 10594 consensus_queue.cc:1175] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4993160378a142a1bc21648120cbaebc" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:13:38.992707 10577 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.006724  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.025277  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.031610  8992 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:39.043531  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:39.047093  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59872.9us
I20260709 12:13:39.026604 10616 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.090830  9067 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:39.002142 10605 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.001145 10632 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.095423  9066 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.048537 10562 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.093727  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.092816  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.099367  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.099825  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:39.103554  9074 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:39.103641  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.091163  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.105690  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.091872 10423 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.105193  8925 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.104614  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:39.092502 10590 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.111804  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.115152  8920 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:39.006925 10608 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.122092  8925 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:39.094935 10669 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:39.100849 10637 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.109486 10597 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.127301  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:39.124679 10582 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.115022 10640 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.108747 10672 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.134207  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:39.122694 10589 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.114876 10590 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:39.182334  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.205852  9066 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:39.206199 10677 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.206737 10677 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:39.205936  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 71830.5us
I20260709 12:13:39.128137 10597 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.199061 10601 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.198179 10530 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.208530 10644 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.208899 10563 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.212366 10640 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:39.235332 10629 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:39.256083 10665 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 12:13:39.237711 10597 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.127275 10669 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.246912 10672 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.246660 10671 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.198554 10582 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:39.284937 10668 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:13:39.286711 10582 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.286362 10640 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.263437 10601 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.288823 10601 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.288595  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.289546  9066 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:39.291298  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:39.284209 10671 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.293390 10582 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.293879 10582 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.294332 10582 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.297298  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.297664  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:39.298246  8919 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.269897 10657 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:39.309449  9000 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:39.268273 10530 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.273733 10563 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.271613 10644 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.312199 10651 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.278791 10629 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.321532 10648 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.274353 10590 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.322219 10675 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.348805 10608 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.358915  8922 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.267813 10677 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.369526 10590 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.372561 10644 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.373525  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.376940  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.377135  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.377580  9071 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.377638  9067 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.378230  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.378791  9072 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.356480  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.308964 10672 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.405248  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.412844  9072 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.413113  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.315775 10657 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:39.358330 10683 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.354755 10651 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.418388  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:39.422806  8992 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.362831 10671 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.427630 10671 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.428087 10671 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.428510 10671 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.435420 10662 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.436264 10545 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.436657 10545 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.437016 10545 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.437582 10662 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.438179 10662 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.438601 10662 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.440738 10530 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.412055 10589 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:39.443866 10673 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:13:39.417258  9616 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:39.411846 10632 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:39.446493 10632 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.447896 10672 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.449107 10632 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.449853  8917 raft_consensus.cc:2368] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:39.458352  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.459197  9072 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:39.459928  8992 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.463225  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.467557  8916 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.467644  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.476819  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.477592  8916 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.477576  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:39.478286  8994 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.479156 10563 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.482975  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.364025 10675 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:39.493199  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.486618 10685 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:39.492882  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.479426 10684 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.461185 10683 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:39.502640 10667 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.487s	user 0.000s	sys 0.012s
I20260709 12:13:39.505872 10597 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.512288  8994 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.460280 10562 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.517345  8923 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:39.523380 10605 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.524449 10597 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.508849  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.525604  8919 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:39.516332 10678 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.508020 10683 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.532781  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:39.511128 10536 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.533875  8991 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.515470 10684 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.537788  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.537221 10614 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:39.542215  8918 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:39.542142 10614 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.544252 10614 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.547868 10675 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.548995 10651 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.551779 10545 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.553831 10582 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.522138 10669 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.556115 10662 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.536345 10678 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.557142 10629 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.558455 10678 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.559625  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.560226  9066 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:39.535445 10672 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:39.561189 10672 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.564922  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:39.566084 10562 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.566552 10669 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:39.567049 10669 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.567431 10423 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:39.568485  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:39.569115 10669 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.555059 10657 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:39.569314 10423 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.569936 10423 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.570407 10423 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.568071 10639 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.569633 10545 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.580158  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.581044  8995 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.583099  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.586176  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.586476  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:39.587018  8994 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.591773  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.593087  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.594352  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.595789  8992 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:39.596218  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.596248  8992 pending_rounds.cc:85] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 1
I20260709 12:13:39.597576  8992 pending_rounds.cc:107] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:39.597891  8992 raft_consensus.cc:2889] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:39.600172  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.600915  9066 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:39.602463  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.603437  9074 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:39.605365  9074 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:39.606622  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.608137  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.589902  8923 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:39.608939  9074 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.591208  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.610242  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.610286  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.539740 10601 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.614825  9070 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:39.611191  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.611640  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.613768  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.613824  9072 raft_consensus.cc:2368] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:39.617336  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:39.614706  9071 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.614403  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:39.619315  9000 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.619659  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.620986 10690 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.621429 10690 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:39.621524 10657 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.621833 10690 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.611907 10662 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.625912 10662 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:39.626788 10662 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.629573 10614 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:39.630199 10547 raft_consensus.cc:993] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:39.630430  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.630671 10547 raft_consensus.cc:1081] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:13:39.623850 10562 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.632870 10562 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:39.630349 10628 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.636359  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.638494  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.637575  9040 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.598587 10620 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.633721 10616 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.641270 10670 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.655709  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.657828  9000 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:39.641925  9066 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:39.598932 10629 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.605412 10608 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.608429  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.649402  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.608573 10675 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:39.644758 10545 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.574244 10671 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.654570  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.660092  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.661954  9588 leader_election.cc:400] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:39.671337  8922 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.664413  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.671819  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.672266  9074 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.672467  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.671291  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.665809  8998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:13:39.674613  8998 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.676131  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.676710  9069 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.676594  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.677495  9068 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.675053  8998 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.673727  9065 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.670542  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.679659  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.671568  9588 leader_election.cc:403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.680305  8966 leader_election.cc:400] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:39.636230 10651 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.680645  8966 leader_election.cc:403] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.684085  8966 leader_election.cc:400] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:39.682185  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:39.680171  9070 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.638996 10657 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:13:39.684401  8966 leader_election.cc:403] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.686232  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.652779 10598 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:39.680655  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 43682.5us
I20260709 12:13:39.667739 10670 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.653012 10684 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.678894 10601 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.671370 10545 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.654088 10620 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.679786 10649 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.633728 10562 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.683012 10651 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.706070 10679 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.679451 10672 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.697708 10689 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:39.698491 10577 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.004s
I20260709 12:13:39.695151 10545 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.668234 10629 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.668169 10608 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.690346 10599 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:39.688841 10640 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.692423 10670 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.689894 10663 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:39.670426 10675 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.700309 10620 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.731268  8922 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:39.734319  9068 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:39.709334  8998 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.715900  9070 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.696476  9074 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.717461  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.741526  9000 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:39.697266 10582 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.708580 10651 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.707973 10684 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.703532 10649 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:39.743796  8991 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.709861  9616 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:39.745013  8916 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.706638 10679 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.665035 10614 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:39.755779  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.759168  8923 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.760625  8922 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:39.763175  9000 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.744699 10642 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:39.750164 10547 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.775956 10649 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.778710 10642 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.781853 10547 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.755487 10684 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.795791  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.796466  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.801950  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.802585  8994 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:39.802943  9000 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.799002 10679 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.805464 10608 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.806798 10423 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.808547  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.809167  8997 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:39.810401  9069 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:39.810696  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.811962  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.812153  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.812620  9618 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:39.812794  9615 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:39.813432 10629 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.796195 10670 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.814855 10671 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.815059  9623 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:39.815886 10670 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.817725  9073 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:13:39.821365  9615 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.797235  8992 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:39.823340  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:39.823978  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.824967  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.825722  8923 raft_consensus.cc:2368] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:39.831420  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.831921  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.831858  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.839617  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.840755  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.843820  8922 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.845721  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.848147  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.849112  9069 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:39.850898  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:39.842661 10684 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.855297 10572 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.853750 10679 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.859167  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.860440  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.861305  8917 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:39.862084 10672 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.868057  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.871716  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:39.868764  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:39.898905 10680 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.899371 10680 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.899739 10680 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.864982 10547 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.898720  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:39.899565  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:39.854672 10639 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.872475  9617 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:39.872359 10679 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:39.854382 10671 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:39.943439  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.944461  8920 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:39.945041 10670 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:39.950264  9074 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:39.843060 10567 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.842661 10675 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.853832 10629 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.854257 10608 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.837440  8924 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:39.918076  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1873) took 1139 ms. Trace:
I20260709 12:13:39.918491  8998 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:39.896420 10672 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:39.925746  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:39.919111 10536 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:39.928303 10423 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.928387  8918 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:39.936543  8966 leader_election.cc:400] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:39.938784  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:39.970536  8966 leader_election.cc:403] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.970742  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:39.939455  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:39.971473  9070 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.939879  9069 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.966415  8921 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.949174 10671 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.952423 10642 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:39.973484  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.986056  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.952772 10567 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.972497  8921 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:39.966717  9073 rpcz_store.cc:276] 0709 12:13:38.778466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.785067 (+  6601us) service_pool.cc:224] Handling call
0709 12:13:39.917842 (+1132775us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:39.917990 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350006144}
I20260709 12:13:39.989786  9070 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:39.996282 10547 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.996349 10599 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:39.996994 10547 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:39.958143 10605 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.000743  8821 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 328) took 1601 ms. Trace:
I20260709 12:13:39.954553 10629 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.966254 10608 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.004343  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:39.984146 10671 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:39.995733 10567 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.020133  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:39.976260 10536 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:39.976456 10675 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:40.030184  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.040083  8925 raft_consensus.cc:2368] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:40.030992  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:40.041746 10536 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.044391 10651 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.046242  9000 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.046662 10651 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.002544 10679 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.019428 10439 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:13:40.048164 10567 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.009356 10629 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.006222  8921 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:39.993840 10670 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.999109 10547 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.050724  8920 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.035333 10678 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.976120 10664 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:40.008217 10608 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.052769  8995 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:40.009194 10599 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:39.999854 10672 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.036299 10657 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.098057  8920 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:40.001122  8821 rpcz_store.cc:276] 0709 12:13:38.399599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.399748 (+   149us) service_pool.cc:224] Handling call
0709 12:13:40.000675 (+1600927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.757435 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:38.806638 (+ 49203us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:38.806694 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:13:38.806719 (+    25us) tablet.cc:662] Decoding operations
0709 12:13:38.807413 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:38.807512 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:38.807544 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:38.812013 (+  4469us) tablet.cc:701] Row locks acquired
0709 12:13:38.812068 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:13:38.812228 (+   160us) write_op.cc:270] Start()
0709 12:13:38.812393 (+   165us) write_op.cc:276] Timestamp: P: 1783599218812172 usec, L: 0
0709 12:13:38.812435 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:13:38.814290 (+  1855us) log.cc:844] Serialized 973 byte log entry
0709 12:13:39.519435 (+705145us) op_driver.cc:464] REPLICATION: finished
0709 12:13:39.596591 (+ 77156us) write_op.cc:301] APPLY: starting
0709 12:13:39.597556 (+   965us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:39.597699 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:39.597928 (+   229us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:39.607336 (+  9408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:39.607586 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:39.607647 (+    61us) write_op.cc:312] APPLY: finished
0709 12:13:39.607933 (+   286us) log.cc:844] Serialized 29 byte log entry
0709 12:13:39.608113 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.608194 (+    81us) write_op.cc:454] Released schema lock
0709 12:13:39.608249 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:39.668326 (+ 60077us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.670105 (+  1779us) write_op.cc:454] Released schema lock
0709 12:13:39.670852 (+   747us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.674297 (+  3445us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2459,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":76889,"apply.run_cpu_time_us":2643,"apply.run_wall_time_us":64908,"num_ops":2,"prepare.queue_time_us":86191,"prepare.run_cpu_time_us":31418,"prepare.run_wall_time_us":207843,"raft.queue_time_us":186895,"raft.run_cpu_time_us":24078,"raft.run_wall_time_us":163693,"replication_time_us":706829,"thread_start_us":285092,"threads_started":4,"wal-append.queue_time_us":170687}]]}
I20260709 12:13:40.057437 10684 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.058800 10547 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.132400 10616 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.152421 10637 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.053087 10675 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.151806 10567 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.100562 10439 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:40.163586 10684 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.217114  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.380373  9622 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:40.379918 10439 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.226202  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.381807 10684 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.155728 10599 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.382298 10439 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.382377  9070 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:40.383195 10687 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:40.219652  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.243038  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.186094 10547 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.387459  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.284147  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:40.209914  8919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.013s	sys 0.022s
I20260709 12:13:40.259402  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:40.436764  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.437377  9000 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.437688  9623 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:40.331560  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:40.439560  9624 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.203552 10536 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.167340 10657 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:40.306298 10701 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:13:40.261073  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:40.334861 10697 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.202s	user 0.004s	sys 0.000s
I20260709 12:13:40.324152 10601 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.229280 10616 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.341426 10629 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:40.328166 10690 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.005s
W20260709 12:13:40.306380 10702 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:13:40.508001 10690 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.257001  9615 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.336347  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.509405  9617 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.322654  9620 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:40.510370 10690 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.511056  9065 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:40.324627 10605 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.290424 10664 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.332770  8994 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.493852 10608 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:40.240924  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 252269us
I20260709 12:13:40.285358 10632 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.294521 10714 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.452944 10536 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.286859 10628 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.275794  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:40.530829  8998 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.532919 10608 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:40.329151 10698 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 12:13:40.328428 10675 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.257469 10640 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
W20260709 12:13:40.338157 10545 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.618s	user 0.003s	sys 0.005s
I20260709 12:13:40.538631 10545 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.522634 10599 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.522534 10664 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.540772  8997 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:40.541319 10545 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.541970 10664 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.518065 10605 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.544785 10605 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.326365 10680 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.530257 10714 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.548954 10680 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.269543  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:40.371366 10597 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.550673 10714 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.374495  8995 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:40.375131  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.551949 10628 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.264396  9590 leader_election.cc:400] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:40.554128 10628 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.554634  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:40.527539 10632 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.266043  9069 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.555392  8916 raft_consensus.cc:2368] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:40.267508  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:40.436148  8991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.002s	sys 0.016s
W20260709 12:13:40.556479  8991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.016s
I20260709 12:13:40.556707 10632 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.557271 10632 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.557408  8925 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.557722 10632 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.445459 10439 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:13:40.436568  8919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.013s	sys 0.024s
I20260709 12:13:40.559207 10689 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.385984 10566 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:40.559949 10566 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.440174  9618 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.520485  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:40.464392  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.456043 10642 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.469511 10616 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.470641 10598 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.472836  8921 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.475693 10644 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.478068  8822 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 205) took 1793 ms. Trace:
I20260709 12:13:40.478886  8819 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.152575  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.572700 10616 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:40.482424  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:40.481415 10713 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
W20260709 12:13:40.483515 10700 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.223s	user 0.010s	sys 0.002s
I20260709 12:13:40.578457  9621 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:40.485306 10712 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:13:40.465437 10601 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:40.497270 10704 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
I20260709 12:13:40.384752 10687 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.581737  9073 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:40.454068 10683 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.588673 10683 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.504954  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:40.589213 10687 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.590402  8999 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.590806  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.591521  8996 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:40.506697 10657 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.257301 10637 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:40.527518 10706 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.236s	user 0.002s	sys 0.002s
I20260709 12:13:40.527838  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.513684 10690 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.550299 10597 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.366266 10577 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.556313  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.559121 10439 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.450021  9000 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:40.615154  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.554153  9590 leader_election.cc:403] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:40.389986 10582 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.528313 10671 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 12:13:40.566512  8993 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
W20260709 12:13:40.568975  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48592.8us
I20260709 12:13:40.617923  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:40.570340 10692 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.570780 10642 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.572224  9040 leader_election.cc:400] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:40.628257  9040 leader_election.cc:403] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:13:40.628857  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 56782.9us
I20260709 12:13:40.573675  9070 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.483162 10676 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.578398  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.490844 10547 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.580600  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.581133  8998 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:40.580416 10644 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.647516 10657 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:40.648679 10637 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.570535 10566 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.582664  8819 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.586740 10598 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.587484  9624 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:40.573593 10680 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:40.660472  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.488430 10629 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.600773  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.625860 10671 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.661036 10651 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.664721 10536 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.666817 10651 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:40.663378 10718 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:40.667692 10683 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.601226  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:40.669245  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:40.669852  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 68746.6us
I20260709 12:13:40.669945  8991 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:40.603605  9071 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.670893  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.671404  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:40.671614  8991 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:40.672082  9071 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.626049 10582 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.674502 10566 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:40.625785 10608 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:13:40.675614 10671 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.604425  8963 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:40.664829  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.676376  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:40.676538 10642 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.571916  8822 rpcz_store.cc:276] 0709 12:13:38.684317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.684430 (+   113us) service_pool.cc:224] Handling call
0709 12:13:40.477981 (+1793551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.992578 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:39.015812 (+ 23234us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:39.015843 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:13:39.015868 (+    25us) tablet.cc:662] Decoding operations
0709 12:13:39.016239 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:39.016307 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:39.016354 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:39.016550 (+   196us) tablet.cc:701] Row locks acquired
0709 12:13:39.016568 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:39.016725 (+   157us) write_op.cc:270] Start()
0709 12:13:39.016839 (+   114us) write_op.cc:276] Timestamp: P: 1783599219016683 usec, L: 0
0709 12:13:39.016861 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:39.017466 (+   605us) log.cc:844] Serialized 530 byte log entry
0709 12:13:39.589260 (+571794us) op_driver.cc:464] REPLICATION: finished
0709 12:13:39.663508 (+ 74248us) write_op.cc:301] APPLY: starting
0709 12:13:39.663587 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:39.663679 (+    92us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:39.663816 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:39.664059 (+   243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:39.664220 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:39.664266 (+    46us) write_op.cc:312] APPLY: finished
0709 12:13:39.664452 (+   186us) log.cc:844] Serialized 23 byte log entry
0709 12:13:39.664601 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:39.664676 (+    75us) write_op.cc:454] Released schema lock
0709 12:13:39.664716 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":336853,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":74015,"apply.run_cpu_time_us":1505,"apply.run_wall_time_us":1508,"num_ops":1,"prepare.queue_time_us":236716,"prepare.run_cpu_time_us":2519,"prepare.run_wall_time_us":32986,"replication_time_us":556493,"thread_start_us":67389,"threads_started":1}]]}
I20260709 12:13:40.676926  8996 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:40.580729 10640 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:40.607815  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.669191 10651 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.677701 10640 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.610096  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.573369 10616 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:40.619190  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 375778us
W20260709 12:13:40.682854  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58870.6us
I20260709 12:13:40.616736  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:40.619932  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:40.686381  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69727.7us
I20260709 12:13:40.686486  9072 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.620537  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.633790  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.687623  8924 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.687834  9066 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.688499  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.689196  8924 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:40.582090 10709 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.635120  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.626821 10545 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:13:40.641901  8995 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:40.706372  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.613425 10690 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.645535 10439 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.645258 10692 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.713861  9624 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:40.714979 10692 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.715268  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:40.715483 10709 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:40.620931 10563 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:13:40.716086  9624 raft_consensus.cc:2368] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:40.716341 10563 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.716741 10563 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:40.716634 10709 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.717780 10563 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.614173  9618 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.650611  9068 raft_consensus.cc:2368] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:40.719172 10563 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.720327  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:40.720994  9068 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.678274  9617 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:13:40.611524 10577 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.652944  8999 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:40.653052  8918 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:40.654289 10676 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.653172 10717 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.621328  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.626437 10639 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:40.657785  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.649526 10644 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.661456  8993 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:40.630759 10684 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.666100 10597 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.678771  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:40.744352  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:40.676854  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 72512.7us
I20260709 12:13:40.680995  9070 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:40.688643  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.724874 10680 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.690057  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.754495  9000 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:40.674978 10566 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.690659  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 258) took 1011 ms. Trace:
I20260709 12:13:40.679356  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:13:40.756579  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77295.4us
I20260709 12:13:40.743636 10671 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.706373  8923 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.744397  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.709631  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.710210  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.711108  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:40.711160  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.658398 10657 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.635262 10632 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.664093  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 990) took 1131 ms. Trace:
I20260709 12:13:40.729957  9069 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.730165  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:40.852308  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 122262us
I20260709 12:13:40.853579  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:40.674979 10582 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:40.849663 10620 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.858841 10620 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:40.859470 10620 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.870062 10676 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.851696  8919 rpcz_store.cc:276] 0709 12:13:39.533131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.533517 (+   386us) service_pool.cc:224] Handling call
0709 12:13:39.570092 (+ 36575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:39.570440 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:39.570471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:39.605626 (+ 35155us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.496691 (+891065us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:40.559536 (+ 62845us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:40.559585 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.559660 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:40.650192 (+ 90532us) raft_consensus.cc:1685] finished
0709 12:13:40.654140 (+  3948us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:40.663979 (+  9839us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":4149504,"thread_start_us":914986,"threads_started":1,"wal-append.queue_time_us":584767}
W20260709 12:13:40.873386  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 259641us
I20260709 12:13:40.689639 10683 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:40.736205  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:40.750241  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 71532.5us
I20260709 12:13:40.604641  8921 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.880560  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:40.880816  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 144752us
I20260709 12:13:40.883298  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:40.751485  9074 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:40.751854  9066 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:40.751753  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:40.635550  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.752609  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:40.890187  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 137659us
I20260709 12:13:40.754976  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.757747  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:13:40.891319  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 133648us
I20260709 12:13:40.756266  9621 rpcz_store.cc:276] 0709 12:13:39.679737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.681881 (+  2144us) service_pool.cc:224] Handling call
0709 12:13:40.690495 (+1008614us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54006ab8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:40.690601 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970504064}
I20260709 12:13:40.733945  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.762847  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.748790 10722 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.694887  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.748981 10601 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.897516  9622 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:40.764945 10671 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.761232 10680 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:40.807901  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.753130 10669 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.758301 10566 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:40.776708  9068 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:40.759742 10690 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.876708  8996 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:40.756388 10684 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:40.752149  9616 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:40.848769  8997 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:40.755959 10597 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.760023  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:40.849653  9617 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:40.760946 10637 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.851529 10657 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:40.856808  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:40.874219  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:40.891426 10439 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:40.945122  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70993.9us
I20260709 12:13:40.892275  9071 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:40.889992  8922 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:40.946022  9588 leader_election.cc:400] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:40.946364  9588 leader_election.cc:403] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:40.707207  9072 raft_consensus.cc:2393] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:40.894850  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 143594us
I20260709 12:13:40.899098  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.947101  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:40.891460  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:40.903153  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.948057  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:40.948405  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57018us
W20260709 12:13:40.829041  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118045us
I20260709 12:13:40.879912 10678 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.949457  8963 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:40.970454  8997 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:40.906023  8924 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:40.877812 10599 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.969417  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:40.896477 10722 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:40.888746 10676 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:40.908659  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:40.894454 10639 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:40.912201  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:41.003876  9068 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:40.897293 10692 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.899981 10628 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:40.927114 10705 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.664s	user 0.000s	sys 0.010s
I20260709 12:13:40.928462 10577 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:40.909255 10601 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:13:40.897501 10723 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.017024 10723 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.017390 10723 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:41.017719 10723 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.020150  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2187) took 1154 ms. Trace:
I20260709 12:13:41.020591  8992 rpcz_store.cc:276] 0709 12:13:39.865655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.865794 (+   139us) service_pool.cc:224] Handling call
0709 12:13:39.866160 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:39.866543 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:39.866594 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:39.909039 (+ 42445us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.028539 (+119500us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:40.028595 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.028693 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:40.926425 (+897732us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:41.015203 (+ 88778us) raft_consensus.cc:1685] finished
0709 12:13:41.015223 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.020058 (+  4835us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":539,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":28570,"spinlock_wait_cycles":55998720,"thread_start_us":97541,"threads_started":1,"wal-append.queue_time_us":232646}
I20260709 12:13:40.898653 10632 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.023550 10632 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.025906 10632 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:40.942987 10637 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.925984 10684 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:40.948408  9070 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:40.877094 10664 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.957216  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:41.032936  9622 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.961212  8995 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.033428  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:13:40.960177  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:40.972635 10599 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.906881 10669 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:40.971628 10675 raft_consensus.cc:2764] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:40.880344 10683 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.972839  9072 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:40.944278  9618 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:40.999577  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.083668  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:41.001917  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 93353.7us
I20260709 12:13:41.010547 10692 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.005771 10649 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.081465 10680 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.088974 10649 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:41.011201  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.090948  9071 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.092023  9072 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.945286 10439 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.093820 10439 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.969957 10678 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.030730  8994 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:40.987567 10655 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:40.973295 10662 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.034657  8993 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.056830  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:41.003372 10699 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.849s	user 0.001s	sys 0.004s
I20260709 12:13:40.944923 10597 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:41.002561 10642 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.005146 10423 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.057484  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.057682  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2312) took 1379 ms. Trace:
I20260709 12:13:41.058753  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.012468 10616 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.119590  9065 rpcz_store.cc:276] 0709 12:13:39.677829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.679418 (+  1589us) service_pool.cc:224] Handling call
0709 12:13:41.057399 (+1377981us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002d46d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.057603 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910672256}
I20260709 12:13:41.007697  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.086951  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.104840 10678 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.027287  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.094458  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:41.091141  9066 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.027448 10637 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.087596  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:41.033772 10628 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:41.032820 10707 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.082410 10599 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.968719  8916 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 2: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:41.059599 10577 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.033411 10639 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:41.082448 10669 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.084292 10663 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.087287 10719 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.084841 10683 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.095793 10692 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.084597 10608 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:13:41.103904 10726 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:41.005926 10676 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.004237 10640 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.134578  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.109944 10662 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:41.143205  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48840.2us
I20260709 12:13:41.196223  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:41.193316 10719 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.135680  8995 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.109050 10690 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:41.144363  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:41.148237  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60761.6us
I20260709 12:13:41.134526  8998 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.114135 10655 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:41.123356  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:41.144311 10441 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.147025  8999 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.194737  9621 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:41.166079 10423 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:41.203766  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.184715 10577 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.190781 10663 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.188887 10720 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:41.201793 10640 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.170070 10649 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.222806  8995 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:41.198764 10662 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.329903  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.240370  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 1884) took 1620 ms. Trace:
I20260709 12:13:41.200328 10608 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.209177 10671 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:41.260968 10697 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:13:41.253666 10545 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.341430  8998 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:41.172466 10707 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:41.303283 10729 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:13:41.252950 10639 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.224155 10597 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:41.250294 10717 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:13:41.368748 10717 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:41.261147 10657 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.247962 10582 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:41.295849 10722 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.289254 10672 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.339433  9067 rpcz_store.cc:276] 0709 12:13:39.600106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.600215 (+   109us) service_pool.cc:224] Handling call
0709 12:13:39.600689 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:39.605722 (+  5033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:39.605747 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:39.636569 (+ 30822us) log.cc:844] Serialized 548 byte log entry
0709 12:13:39.955951 (+319382us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:39.956002 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.956094 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:40.972126 (+1016032us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b240020f6a8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8d09d 00007f39857bf10e 00007f39857d688c 00007f39857d5bb6 00007f39857d57d8 00007f39857df221
0709 12:13:41.209392 (+237266us) raft_consensus.cc:1685] finished
0709 12:13:41.209411 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.220307 (+ 10896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25787776,"thread_start_us":288028,"threads_started":1,"wal-append.queue_time_us":380563}
I20260709 12:13:41.202178 10716 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:41.363611 10439 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.288008 10719 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.248454 10628 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.290980 10566 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.340020  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.381374 10439 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.338212 10620 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.252455 10655 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.383095 10663 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.387128  9623 raft_consensus.cc:2368] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:13:41.339052 10640 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.209479 10690 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.286123  8999 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:41.354918 10545 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.249567 10423 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:41.377489  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.343191 10720 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.377154 10672 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.413313  9622 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
W20260709 12:13:41.414645 10728 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:13:41.414817  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:41.396745 10733 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 12:13:41.430061  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:41.380998 10582 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.408079 10545 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.395213  8996 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:41.457937 10740 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.458464 10740 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.458786 10740 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.428609 10672 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.461887  8993 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:41.415259 10620 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.381930 10716 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.428372 10719 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:41.433667 10566 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.412537 10683 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.477833 10582 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:41.479130  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 788176us
I20260709 12:13:41.463687 10676 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.467190 10620 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:41.498163 10731 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.597s	user 0.002s	sys 0.005s
I20260709 12:13:41.497630 10620 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.498775 10620 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.500511  9073 raft_consensus.cc:2368] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:13:41.469524 10720 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.497314 10577 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.474357 10719 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.500712 10640 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.505070  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.508526 10608 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:41.542253  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 408728us
W20260709 12:13:41.543931  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 347743us
I20260709 12:13:41.544773  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:41.545617 10608 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:41.546170 10608 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:41.545636  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 380955us
I20260709 12:13:41.548273  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:13:41.611286  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63924.7us
I20260709 12:13:41.507833 10678 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:41.615698  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67528.3us
I20260709 12:13:41.616909  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.617797  9622 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:41.619684  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.620324  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.621147  8991 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:41.622471  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.623311  8993 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:41.625910  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.626893  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.627120  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:41.628063  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 84440.5us
W20260709 12:13:41.629419 10614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.403s	user 0.028s	sys 0.004s
I20260709 12:13:41.634752  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.639914  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.643492  8997 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:41.644161  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.647858  8921 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.640048  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.649667  8998 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:41.651298 10439 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.651849 10439 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.628667 10739 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.654925  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:41.657192  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.659384  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.660032  8916 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
W20260709 12:13:41.644166 10614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.028s	sys 0.004s
I20260709 12:13:41.636493 10690 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.633220  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.664209 10439 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.665916  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.667145  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.666713  8924 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:41.669371  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.670406  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:41.671931  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:41.656001 10608 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.672734  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.640496 10601 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:41.673388  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.672891  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:41.687592  8998 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.689977  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:41.662137 10739 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.637224 10692 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.658325 10720 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:41.674433 10657 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.675328  8996 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:41.719992 10657 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.720600 10657 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.692705 10747 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:41.721629 10716 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.721755 10747 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.658560 10441 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:13:41.672955 10743 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:13:41.719223  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 830681us
I20260709 12:13:41.690752 10707 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.736605  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.737560  9622 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:41.693637 10717 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.740486  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:41.741037  9621 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:41.716398 10637 consensus_meta.cc:287] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 12:13:41.746785  8998 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:13:41.675076 10678 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.702572 10683 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:41.699318 10739 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:41.742201 10642 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 12:13:41.693704 10601 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.715083 10720 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.754681 10676 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.741149 10748 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:41.774302  9590 leader_election.cc:400] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:41.777707  9590 leader_election.cc:403] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:41.770262  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.771893 10642 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:41.755023 10637 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.790755 10744 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.774868 10676 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.792292 10692 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.777367 10719 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:41.791677 10723 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.004s
W20260709 12:13:41.802045 10745 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:41.803126 10720 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.803975 10747 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:41.805263 10598 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:41.806757 10669 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.613s	user 0.001s	sys 0.008s
I20260709 12:13:41.806258 10657 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.808835  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1911) took 1189 ms. Trace:
I20260709 12:13:41.809834 10662 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:41.812028  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2317) took 1188 ms. Trace:
I20260709 12:13:41.812875  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 924) took 1155 ms. Trace:
I20260709 12:13:41.788662 10748 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:41.815876 10601 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:41.817845  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.822861  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:41.825234 10683 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.826177  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1867) took 1194 ms. Trace:
I20260709 12:13:41.828655  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:41.829492  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.833369 10741 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:41.835532 10717 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.837102  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1908) took 1222 ms. Trace:
I20260709 12:13:41.839164 10545 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:42.068380  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 455402us
I20260709 12:13:42.117172  9621 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:42.041402  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 1913) took 1147 ms. Trace:
I20260709 12:13:42.118829  9624 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:41.899844  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 553) took 1299 ms. Trace:
W20260709 12:13:42.084542  9588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.007s	sys 0.014s
I20260709 12:13:41.903106  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:42.053871  8965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.088s	sys 0.128s
I20260709 12:13:41.906575  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 207) took 1197 ms. Trace:
I20260709 12:13:41.878499  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:41.901630  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:41.878895  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:42.118997  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:42.120736  9588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.015s
I20260709 12:13:42.083696 10616 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:13:42.160429  8963 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.4:33071 timed out after 1.564s (SENT) [suppressed 23 similar messages]
I20260709 12:13:42.124034  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2208) took 1156 ms. Trace:
W20260709 12:13:42.119625  9624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 266) took 1384 ms (client timeout 1834 ms). Trace:
I20260709 12:13:42.168702  9037 leader_election.cc:400] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:42.117439  9068 rpcz_store.cc:276] 0709 12:13:40.623751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.059796 (+436045us) service_pool.cc:224] Handling call
0709 12:13:41.099728 (+ 39932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.219658 (+119930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.219704 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:41.219761 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:41.219807 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.811794 (+591987us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54004204d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:41.811838 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.811970 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275156224}
W20260709 12:13:42.117885  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 343694us
I20260709 12:13:42.122371  9000 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:42.168350  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:42.116837  9073 rpcz_store.cc:276] 0709 12:13:40.619711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.710903 (+ 91192us) service_pool.cc:224] Handling call
0709 12:13:41.808644 (+1097741us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54000e88d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.808774 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500900736}
I20260709 12:13:42.121659  8921 rpcz_store.cc:276] 0709 12:13:40.708806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.882378 (+173572us) service_pool.cc:224] Handling call
0709 12:13:40.882693 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.648327 (+765634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.906261 (+257934us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400018e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:41.906500 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759274240}
W20260709 12:13:42.128373  8965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.088s	sys 0.128s
W20260709 12:13:42.128917  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 678035us
I20260709 12:13:42.126276  9067 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:42.117262  9069 rpcz_store.cc:276] 0709 12:13:40.614809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.614931 (+   122us) service_pool.cc:224] Handling call
0709 12:13:41.836872 (+1221941us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540026cad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.837014 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262348160}
I20260709 12:13:42.119866  9623 rpcz_store.cc:276] 0709 12:13:40.600280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.600428 (+   148us) service_pool.cc:224] Handling call
0709 12:13:41.899508 (+1299080us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400745c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.899719 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625018240}
I20260709 12:13:42.118678  8994 rpcz_store.cc:276] 0709 12:13:40.657346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.657516 (+   170us) service_pool.cc:224] Handling call
0709 12:13:41.812697 (+1155181us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54002355d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.812795 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657153408}
W20260709 12:13:42.176630  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 354915us
I20260709 12:13:42.120229  8920 rpcz_store.cc:276] 0709 12:13:40.632192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.633130 (+   938us) service_pool.cc:224] Handling call
0709 12:13:40.633405 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.716204 (+ 82799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.716238 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.716734 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.066771 (+350037us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:41.066813 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.825793 (+758980us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b5400311d54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:41.825845 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.825898 (+    53us) raft_consensus.cc:1685] finished
0709 12:13:41.825912 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.826118 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1974,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":189586176,"thread_start_us":349635,"threads_started":1,"wal-append.queue_time_us":416414}
W20260709 12:13:42.178215  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60000.3us
W20260709 12:13:42.114223 10599 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.928s	user 0.011s	sys 0.000s
W20260709 12:13:42.056608 10740 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.004s
I20260709 12:13:42.119092  9065 rpcz_store.cc:276] 0709 12:13:40.892756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.203178 (+310422us) service_pool.cc:224] Handling call
0709 12:13:41.203467 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.203656 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:41.309636 (+105980us) log.cc:844] Serialized 14 byte log entry
0709 12:13:41.835320 (+525684us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b48002601d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:13:42.039997 (+204677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.040094 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:42.040164 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.040279 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.040464 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330982,"prepare.queue_time_us":131536,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":341277,"raft.run_cpu_time_us":3254,"raft.run_wall_time_us":178419,"spinlock_wait_cycles":3325696,"thread_start_us":394706,"threads_started":1}
W20260709 12:13:42.102121 10680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.003s	sys 0.019s
I20260709 12:13:42.236140  8916 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:42.236299  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67727us
I20260709 12:13:42.236140  9070 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:42.238052  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:42.236649  8992 rpcz_store.cc:276] 0709 12:13:40.968042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.022314 (+ 54272us) service_pool.cc:224] Handling call
0709 12:13:41.878765 (+856451us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:42.123975 (+245210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19705216}
I20260709 12:13:42.238651  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:42.239392  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:42.051995 10632 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.112776 10752 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:42.254667  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:42.044545 10620 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 12:13:41.842272 10710 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.115419 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.016s
I20260709 12:13:41.887753  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1000) took 1334 ms. Trace:
I20260709 12:13:41.843010  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:42.250828 10720 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.252049 10747 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:42.252307 10646 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:42.238708  9624 rpcz_store.cc:269] 0709 12:13:40.735385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.735529 (+   144us) service_pool.cc:224] Handling call
0709 12:13:41.822701 (+1087172us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:42.119570 (+296869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6510464}
I20260709 12:13:42.250391  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:42.253412  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:41.842327  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:42.320219  9618 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.993744 10536 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.130481 10676 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.254136  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:42.260309  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:13:42.168078 10655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.034s	sys 0.056s
W20260709 12:13:42.308000  9622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.030s
W20260709 12:13:42.392115  9622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.005s	sys 0.030s
I20260709 12:13:42.167515 10577 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.897372  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:42.301827  8917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.017s
I20260709 12:13:41.907023 10672 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:42.361827  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.026s	sys 0.035s
I20260709 12:13:42.319605  8918 rpcz_store.cc:276] 0709 12:13:40.553135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.556035 (+  2900us) service_pool.cc:224] Handling call
0709 12:13:41.887530 (+1331495us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54000c9c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:41.887656 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71183744}
I20260709 12:13:42.357959  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2325) took 1732 ms. Trace:
I20260709 12:13:42.252791 10722 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:42.367200  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2335) took 1514 ms. Trace:
I20260709 12:13:42.168787 10717 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.368508  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:42.244449 10707 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:42.244719 10614 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:42.318852  8996 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:42.317305 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.004s	sys 0.019s
W20260709 12:13:42.361653 10597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.020s	sys 0.044s
I20260709 12:13:42.168686 10629 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
W20260709 12:13:42.397002 10690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.017s
I20260709 12:13:42.036887 10670 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:42.384683  9067 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:42.447126  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 570) took 1300 ms. Trace:
I20260709 12:13:42.324299 10644 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:13:42.372818 10423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.009s	sys 0.043s
W20260709 12:13:42.472393 10690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.018s
I20260709 12:13:42.254184 10740 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.355382 10663 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:42.234022 10598 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.319895 10710 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.446707 10722 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:42.390060 10655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.037s	sys 0.057s
I20260709 12:13:42.317876 10752 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.167747 10441 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.226s
W20260709 12:13:42.437004  9072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.034s	sys 0.039s
W20260709 12:13:42.531463  9072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.034s	sys 0.039s
I20260709 12:13:42.430781  9070 rpcz_store.cc:276] 0709 12:13:40.625753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.058416 (+432663us) service_pool.cc:224] Handling call
0709 12:13:42.357681 (+1299265us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000e83d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:42.357876 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567664512}
I20260709 12:13:42.167692 10723 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.167534 10669 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.427109  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.027s	sys 0.036s
W20260709 12:13:42.672884  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 997666us
I20260709 12:13:42.167626 10683 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.192898 10601 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.209s
I20260709 12:13:42.435547  9071 rpcz_store.cc:276] 0709 12:13:40.853194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.092890 (+239696us) service_pool.cc:224] Handling call
0709 12:13:41.093217 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.094861 (+  1644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.094902 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.095499 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.531588 (+436089us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:41.531651 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.531752 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.366930 (+835178us) raft_consensus.cc:1685] finished
0709 12:13:42.366949 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.367124 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5527,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5168,"thread_start_us":400460,"threads_started":1,"wal-append.queue_time_us":552642}
I20260709 12:13:42.322165 10620 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.401841 10608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.011s	sys 0.020s
W20260709 12:13:42.678781 10608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.011s	sys 0.020s
I20260709 12:13:42.679661  9615 raft_consensus.cc:2368] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:42.680663 10620 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.680805 10752 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:42.681381 10683 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:42.682873  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.682936 10778 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:42.682674 10687 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:42.683563 10778 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.684150 10687 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.685339  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:42.686399 10778 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.687466  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:41.995344 10661 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:42.688136 10687 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.688704 10661 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.401188  8917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.015s	sys 0.018s
I20260709 12:13:42.690294 10692 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:42.691161 10669 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.690953 10692 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.692032 10661 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.693019  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1003) took 2040 ms. Trace:
I20260709 12:13:42.693414  8917 rpcz_store.cc:276] 0709 12:13:40.652704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.668442 (+ 15738us) service_pool.cc:224] Handling call
0709 12:13:40.668824 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.669216 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.669257 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.520852 (+851595us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:13:41.628550 (+107698us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.689984 (+1061434us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:42.690044 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.690169 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.690214 (+    45us) raft_consensus.cc:1685] finished
0709 12:13:42.690227 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.692938 (+  2711us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1297,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":46451584,"thread_start_us":1057095,"threads_started":1,"wal-append.queue_time_us":854448}
I20260709 12:13:42.697880 10776 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.451839  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:42.262854 10616 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.704999 10616 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.709452  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 1918) took 1017 ms. Trace:
I20260709 12:13:42.709784  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:42.710150  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:42.709867 10692 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.711514  9067 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:42.449533 10597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.021s	sys 0.044s
I20260709 12:13:42.474720  8995 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:42.374941 10747 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.437047 10760 raft_consensus.cc:2764] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:13:42.713816  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 933) took 1095 ms. Trace:
I20260709 12:13:42.714227  8995 rpcz_store.cc:276] 0709 12:13:41.618508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.619364 (+   856us) service_pool.cc:224] Handling call
0709 12:13:42.713635 (+1094271us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54003dbb54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:42.713765 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915328256}
I20260709 12:13:42.299644 10599 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.715729  8997 raft_consensus.cc:2368] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:42.716048 10747 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:42.246526 10680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.003s	sys 0.023s
W20260709 12:13:42.453095  8999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.027s	sys 0.070s
W20260709 12:13:42.717170  8999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.028s	sys 0.070s
I20260709 12:13:42.387118 10632 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.709868  9074 rpcz_store.cc:276] 0709 12:13:41.692277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.123546 (+431269us) service_pool.cc:224] Handling call
0709 12:13:42.123921 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.671475 (+547554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.671521 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.671581 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:42.671624 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.709268 (+ 37644us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54001b6a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:42.709307 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.709402 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258539904}
I20260709 12:13:42.721585 10632 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.390424 10536 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.723057  9073 raft_consensus.cc:2393] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:42.724638  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 564218us
I20260709 12:13:42.727337 10616 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.727604  8963 leader_election.cc:400] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:13:42.728011  8963 leader_election.cc:403] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.727897 10616 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:42.396935 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.023s
I20260709 12:13:42.737169  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:42.740600  9073 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
W20260709 12:13:42.740684  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 501335us
I20260709 12:13:42.248301 10744 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.247248 10741 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.469375 10664 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:42.426739 10577 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.737042 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.004s	sys 0.024s
I20260709 12:13:42.372792 10646 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:42.478395 10649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.023s	sys 0.060s
W20260709 12:13:42.485263 10423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.009s	sys 0.044s
I20260709 12:13:42.449429 10614 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.776201  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:42.776633  9621 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:42.776932  8922 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:42.480712 10761 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:42.448724 10707 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.567513 10758 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:42.567623 10441 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.569309 10759 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:13:42.570660  8991 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:42.569572 10723 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:42.571658 10754 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:13:42.573971 10748 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.576169 10722 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.516414 10545 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.578567 10740 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.513019 10637 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:42.580273 10672 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.581652 10717 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.494848 10644 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.555462  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:42.531623 10768 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.561497 10662 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.806200 10741 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.807197 10644 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.809226 10744 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:42.602077 10755 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:13:42.602548 10690 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:42.604144  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:42.608808  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:42.814429  9617 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:42.479926  9620 rpcz_store.cc:276] 0709 12:13:41.141662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.141806 (+   144us) service_pool.cc:224] Handling call
0709 12:13:41.842171 (+700365us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16eee 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:42.441877 (+599706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47648512}
I20260709 12:13:42.509666 10598 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.632267 10710 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.548213 10657 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.505389 10663 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.651680 10642 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.537189 10765 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:13:42.484354 10670 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.492890 10651 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:42.687928  8993 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.684819  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:42.702425  9615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 551) took 2102 ms (client timeout 1564 ms). Trace:
W20260709 12:13:42.445133 10739 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.004s
W20260709 12:13:42.400828  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 140635us
W20260709 12:13:42.739537  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 438358us
I20260709 12:13:42.757634  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:42.760353  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.049s	sys 0.042s
I20260709 12:13:42.761214  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:42.762908  9074 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:42.764513  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:42.768880  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:42.769779  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:42.773700  8994 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:42.774062  9065 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:42.774381  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:42.738023 10661 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:13:42.763669  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:42.752238 10669 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.773727  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:42.777837  8925 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:42.713300 10676 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.781394  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:42.772446 10649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.023s	sys 0.061s
I20260709 12:13:42.773876 10646 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.786175  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:42.787716 10439 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:42.772516 10608 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:42.758632 10680 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:13:42.773289 10536 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.786103 10441 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:42.800647  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126586us
I20260709 12:13:42.772148 10664 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:42.806248 10720 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.784472 10761 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.851311 10642 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.852283 10614 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.852924 10577 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.812119 10768 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:42.854054  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:43.013430  9622 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.014115  8917 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:43.014526 10761 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.013070  8916 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
W20260709 12:13:42.988900  9618 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.001s
I20260709 12:13:43.017319  9618 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:43.017834 10639 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.018493  9068 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:43.018930  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.019752  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:43.020560  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.021595 10741 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.034937  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:43.034945 10741 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:42.986827 10707 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:42.925170 10710 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:42.985294 10663 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:42.985886  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.019866 10775 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:42.989784  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:42.977348 10744 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.854235  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 935) took 1231 ms. Trace:
W20260709 12:13:43.035742  9615 rpcz_store.cc:269] 0709 12:13:40.599570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.602381 (+  2811us) service_pool.cc:224] Handling call
0709 12:13:41.500010 (+897629us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:42.702099 (+1202089us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004d3fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:42.702301 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664563200}
I20260709 12:13:43.049607  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.051139 10642 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.056945  9068 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.037331 10739 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.037684  9619 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:13:43.037776  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.051s	sys 0.050s
I20260709 12:13:43.063163 10739 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.038019 10741 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.038522 10710 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.064705 10707 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:43.066536 10710 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.038872 10768 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.072573  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 930) took 1455 ms. Trace:
I20260709 12:13:43.015511  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.073712  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:43.073884 10761 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.039769  8992 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:43.041378  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:43.039389  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:43.051729  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.077111  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 326) took 1252 ms. Trace:
I20260709 12:13:43.021087  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:43.044685  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:43.014941  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.079382  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:43.077562  9000 rpcz_store.cc:276] 0709 12:13:41.824759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.714783 (+890024us) service_pool.cc:224] Handling call
0709 12:13:43.077053 (+362270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:43.047194  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:43.102509  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.135955  9067 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.038883  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.043869  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:43.143548  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64255.2us
I20260709 12:13:43.086295  8922 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:43.042594  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.046068  8923 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.044889  8920 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:43.145143  9071 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:43.143736  9065 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:42.854877  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.134790  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:43.136534  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 89412.5us
I20260709 12:13:43.150873  8993 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:43.152451  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.181259  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:43.154201  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:43.181666  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:42.859913 10722 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:43.146837  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.151332  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:43.183745  9066 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:42.926192 10616 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.143170  9069 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
W20260709 12:13:43.079412  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58416.8us
I20260709 12:13:43.042181  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:43.192005  9587 leader_election.cc:400] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:43.184392  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:43.042320  9618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 566) took 1925 ms (client timeout 2299 ms). Trace:
I20260709 12:13:43.195518  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:43.183384 10765 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:43.046149  8991 rpcz_store.cc:276] 0709 12:13:41.623303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.626636 (+  3333us) service_pool.cc:224] Handling call
0709 12:13:42.822915 (+1196279us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400196754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:42.854182 (+ 31267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167676672}
I20260709 12:13:43.179414 10717 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.186968  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.036494  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:43.179795  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45071.8us
I20260709 12:13:42.819103 10690 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.179335  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.202525 10764 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.074209 10646 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.091570 10720 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.190982  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.045672 10670 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.135332 10680 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:13:43.194478 10716 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.044137 10441 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.198173 10740 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.138295 10577 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.193567  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:43.039618 10639 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.191515 10642 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.222939  9623 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:43.101428 10598 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.199707 10657 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:43.193997  9587 leader_election.cc:403] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:43.040457  9617 raft_consensus.cc:2368] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:43.041024 10664 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.096283 10741 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:43.153000  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.200433  9073 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:43.200798  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.162389 10536 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.223626 10577 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:43.163094  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:43.177028 10782 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:43.201355  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:43.244539  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:43.188192 10707 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:43.210597  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 449471us
I20260709 12:13:43.211272  9067 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:42.819934  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:43.222132 10740 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.044206 10651 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.184010  8919 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:43.252612  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:43.223173 10642 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:43.046217 10608 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.045099 10669 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.184719  8925 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:43.203384  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.215874  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.097833 10768 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.040825 10775 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.185269  9068 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:43.118014 10649 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.189170 10722 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.214967 10616 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.211860 10720 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:43.205796 10690 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.235996  8963 leader_election.cc:400] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
W20260709 12:13:43.195884  9618 rpcz_store.cc:269] 0709 12:13:41.117143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.118859 (+  1716us) service_pool.cc:224] Handling call
0709 12:13:41.842809 (+723950us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:43.042262 (+1199453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10748672}
I20260709 12:13:43.267544 10577 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.260592 10707 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:43.309094  8993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 936) took 1683 ms (client timeout 1503 ms). Trace:
I20260709 12:13:43.309414  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 944) took 1187 ms. Trace:
I20260709 12:13:43.313572  9070 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.284173  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 942) took 1162 ms. Trace:
I20260709 12:13:43.320859  8992 rpcz_store.cc:276] 0709 12:13:42.121807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.603772 (+481965us) service_pool.cc:224] Handling call
0709 12:13:43.284005 (+680233us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001a0ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:43.284105 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523545984}
I20260709 12:13:43.322489  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.324052  8963 leader_election.cc:403] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:43.295338  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 329) took 1469 ms. Trace:
I20260709 12:13:43.324963  8995 rpcz_store.cc:276] 0709 12:13:41.825482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.715958 (+890476us) service_pool.cc:224] Handling call
0709 12:13:42.716221 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.789208 (+ 72987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.789253 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.789314 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:42.789357 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.294941 (+505584us) spinlock_profiling.cc:243] Waited 72.8 ms on lock 0x7b5400236ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:43.295007 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.295254 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167418240}
I20260709 12:13:43.223111  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.043529 10744 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.225669 10632 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.225080 10670 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:43.204701 10765 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.212836 10717 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.249154  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:43.354086  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 105012us
I20260709 12:13:43.250166  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:43.355003  9000 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.253216  8997 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.189230 10752 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.248584  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:43.363051  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 114521us
I20260709 12:13:43.240517 10629 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.236945 10536 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.259778 10642 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.252159 10441 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.247381 10740 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:43.396243  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 163917us
I20260709 12:13:43.261981  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.255028 10710 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.235621 10657 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.268026  9620 raft_consensus.cc:2368] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:43.073333  8999 rpcz_store.cc:276] 0709 12:13:41.617524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.624722 (+  7198us) service_pool.cc:224] Handling call
0709 12:13:41.733906 (+109184us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:41.734155 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.753398 (+ 19243us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:42.717557 (+964159us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.814750 (+ 97193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.817684 (+  2934us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:42.820426 (+  2742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.955395 (+134969us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.072488 (+117093us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":916165,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":15395,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":5918464,"thread_start_us":1023193,"threads_started":2,"wal-append.queue_time_us":93726}
W20260709 12:13:43.332756  9621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 273) took 1564 ms (client timeout 2024 ms). Trace:
W20260709 12:13:43.420608  9621 rpcz_store.cc:269] 0709 12:13:41.768230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.168042 (+399812us) service_pool.cc:224] Handling call
0709 12:13:43.332561 (+1164519us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400771854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:43.332698 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228032384}
I20260709 12:13:43.349155 10723 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:43.334995  8994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 940) took 1351 ms (client timeout 1631 ms). Trace:
W20260709 12:13:43.468148  8994 rpcz_store.cc:269] 0709 12:13:41.983947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.280607 (+296660us) service_pool.cc:224] Handling call
0709 12:13:43.334760 (+1054153us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001a18d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:43.334907 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774187264}
W20260709 12:13:43.309700  8993 rpcz_store.cc:269] 0709 12:13:41.625502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.625677 (+   175us) service_pool.cc:224] Handling call
0709 12:13:43.308824 (+1683147us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400196c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:43.309000 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441073408}
I20260709 12:13:43.340492 10439 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:43.470604 10439 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.346890  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2333) took 2668 ms. Trace:
I20260709 12:13:43.277560 10676 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:43.349210  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 153768us
I20260709 12:13:43.350210  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.484269  8995 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:43.352578  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.471303  9072 rpcz_store.cc:276] 0709 12:13:40.678189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.092724 (+414535us) service_pool.cc:224] Handling call
0709 12:13:41.092978 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.532023 (+1439045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.532068 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.532646 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.787442 (+254796us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:42.787496 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.317658 (+530162us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540028b9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:43.317724 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.317790 (+    66us) raft_consensus.cc:1685] finished
0709 12:13:43.317810 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.346768 (+ 28958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346752,"raft.queue_time_us":345021,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10186,"spinlock_wait_cycles":483585920,"thread_start_us":1111932,"threads_started":2,"wal-append.queue_time_us":237585}
I20260709 12:13:43.365224  9070 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:43.420017 10710 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.371652  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.306746 10720 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.278088 10716 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.282749  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.252748 10782 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.281504 10599 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.281590 10608 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.270789  8917 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:43.384728  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:43.471168 10750 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.407842  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1920) took 1711 ms. Trace:
I20260709 12:13:43.417608  9000 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:43.285173 10669 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.310025  8998 rpcz_store.cc:276] 0709 12:13:42.122339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.720938 (+598599us) service_pool.cc:224] Handling call
0709 12:13:42.721225 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.820216 (+ 98991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.820259 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.820315 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:42.820355 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.309082 (+488727us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54003dc054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:43.309148 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.309337 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227132672}
I20260709 12:13:43.358367  9615 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:43.370115 10423 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.396267 10536 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.471174  8997 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
W20260709 12:13:43.473495  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 141877us
I20260709 12:13:43.369179  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:43.540068  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 171095us
I20260709 12:13:43.542657  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.488003  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.418634 10646 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.492163  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.362061 10670 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.376233 10752 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.465967 10663 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:43.404274 10614 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 12:13:43.519937  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 135328us
I20260709 12:13:43.351337 10632 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.467576 10661 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:43.494918 10710 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.523593  9066 rpcz_store.cc:276] 0709 12:13:41.695944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.902767 (+206823us) service_pool.cc:224] Handling call
0709 12:13:43.407584 (+1504817us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:43.407763 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437382400}
I20260709 12:13:43.533716  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:43.528342 10739 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:43.567975  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 200165us
I20260709 12:13:43.543979  9621 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:43.567128  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:43.565204  8924 raft_consensus.cc:606] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:43.486476 10723 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.578415  9072 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:43.559996  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:43.579332  9620 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:43.579561 10765 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.573915 10663 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.580518 10765 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.573004 10661 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.561113 10744 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:43.581198 10765 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.560195 10651 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.582469 10651 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.577557 10739 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.583953 10739 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.505158 10716 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.585759 10716 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.520267 10707 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.527500 10616 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:43.592034 10439 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.532544 10423 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.634262  9067 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:43.640455  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.641670 10649 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.643118 10439 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.644218  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.543226 10676 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:43.568660 10632 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.560316  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:43.649128  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 265647us
I20260709 12:13:43.642153  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:43.654633  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:43.656028  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:43.657112  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.701633  8997 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:43.596170 10717 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.661767  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:43.740824  8995 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.662710  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:43.663425  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.665277  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.743630  8924 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:43.665828  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.666296  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:43.701645  8998 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:43.533504 10750 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.659927  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:43.752151  8992 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:43.618564 10599 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.590121 10768 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.754386  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:43.640153 10423 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.633440 10441 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:43.591785 10720 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.592840 10739 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:44.137312  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.032s	sys 0.041s
W20260709 12:13:44.275978  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.033s	sys 0.042s
W20260709 12:13:44.276279  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 613644us
I20260709 12:13:43.835069  8992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f24528c4e0f24715985149f6366da832"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:43.869304  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:44.278590  8992 raft_consensus.cc:606] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:43.626209  9616 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
W20260709 12:13:44.193487  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.013s	sys 0.040s
W20260709 12:13:43.766371  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 231330us
W20260709 12:13:44.280107  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 410871us
W20260709 12:13:44.313786  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.020s	sys 0.044s
I20260709 12:13:44.314862  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.315968 10577 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.317342  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:43.742408 10662 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:43.844884 10790 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:13:43.752651 10744 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:44.020763 10761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.020s
W20260709 12:13:43.844316 10793 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:13:43.740168 10722 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.756737 10599 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:44.319959 10690 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:44.028239 10782 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.956934 10661 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.858242 10765 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.027285 10802 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.327s
I20260709 12:13:43.960475 10775 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.025194 10657 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.919613 10750 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:43.917806 10768 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:44.340657 10752 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.325169 10577 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:44.344310 10794 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.592s	user 0.000s	sys 0.001s
I20260709 12:13:44.344770 10670 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.355762 10723 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:44.348335 10536 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.002s
I20260709 12:13:44.349921 10811 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:13:44.331671 10761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.010s	sys 0.028s
I20260709 12:13:43.841545 10629 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:44.340906 10599 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.376039 10423 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.378276 10423 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.379791 10739 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.382020 10663 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:44.385597 10642 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.000s
I20260709 12:13:44.386031 10642 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.387396 10811 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.389727 10811 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:44.393698 10710 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.816s	user 0.006s	sys 0.001s
I20260709 12:13:44.394136 10710 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.649823 10676 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:44.355502 10774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.022s
W20260709 12:13:44.395609 10774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.010s	sys 0.023s
I20260709 12:13:44.359056 10768 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.396847 10676 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.351694 10690 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:44.363193 10536 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:44.371152 10740 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.911s	user 0.001s	sys 0.006s
I20260709 12:13:44.408387 10740 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.420783 10768 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.417351 10690 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.456554 10536 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.456578 10710 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.400875 10441 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.465078 10740 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.469813 10720 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.422751 10642 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.410166 10599 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:44.484113 10632 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.733s	user 0.015s	sys 0.000s
I20260709 12:13:44.484923 10632 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.476325 10599 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.488880 10632 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.555701 10639 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:43.752971  9618 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:44.614189  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 278) took 1074 ms. Trace:
I20260709 12:13:44.614604  9618 rpcz_store.cc:276] 0709 12:13:43.544321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.545665 (+  1344us) service_pool.cc:224] Handling call
0709 12:13:44.613878 (+1068213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:44.617496  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 277) took 1078 ms. Trace:
I20260709 12:13:44.617969  9623 rpcz_store.cc:276] 0709 12:13:43.538866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.539017 (+   151us) service_pool.cc:224] Handling call
0709 12:13:43.539444 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.539863 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.539903 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.540497 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.866212 (+325715us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:44.616213 (+750001us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.616674 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.616858 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.616960 (+   102us) raft_consensus.cc:1685] finished
0709 12:13:44.616979 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.617245 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":556628,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":39873,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":355,"thread_start_us":617110,"threads_started":2,"wal-append.queue_time_us":822466}
W20260709 12:13:44.326707  9616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 560) took 1524 ms (client timeout 1944 ms). Trace:
W20260709 12:13:44.670404  9616 rpcz_store.cc:269] 0709 12:13:42.800213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.041912 (+241699us) service_pool.cc:224] Handling call
0709 12:13:44.324679 (+1282767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:44.320338  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.684957 10690 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:44.685935  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 365573us
I20260709 12:13:44.687294  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.688467 10690 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.689640  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.690786 10690 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:44.691351 10690 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.691798 10690 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.692348  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.694154 10820 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.694766 10820 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.695461 10820 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:44.699841  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.700788  9071 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:44.700896 10639 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.701570 10639 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.704231 10639 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.705190 10690 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:44.706727  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:44.707856  9071 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:44.708033 10690 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.709523  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.710160  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.712239  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:44.712415  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.714195  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.714929  9623 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:44.716286  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.718045  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.718762 10820 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:44.719869  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:44.720763  9071 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:44.721230 10820 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:44.721414  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:44.721562  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:44.722270  9621 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:44.722740  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.723376  9071 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:44.724205  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.725446  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:43.867707  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.726691  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.726711  9615 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:44.727624  9071 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:44.728056  9616 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:44.728682  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.729485  9071 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:44.729382  9624 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:44.730325  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.731006  9071 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:44.731833  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.732971  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.734004  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:44.734584  9071 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.742034  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:44.743400  9616 raft_consensus.cc:2368] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:44.744360  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.744635  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.747641  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.748656 10820 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.749084 10820 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.749450 10820 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.751489  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.755669  9065 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.756064  9071 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:44.756963  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.757198  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.757951 10690 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.765240 10690 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.765770 10690 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.768365  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 282) took 1957 ms. Trace:
I20260709 12:13:44.768986  9069 rpcz_store.cc:276] 0709 12:13:42.811153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.193065 (+381912us) service_pool.cc:224] Handling call
0709 12:13:43.193354 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.193572 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.193603 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.214511 (+ 20908us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.485388 (+270877us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:43.485425 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.485556 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.767810 (+1282254us) raft_consensus.cc:1685] finished
0709 12:13:44.767854 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.768102 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":241870,"threads_started":1,"wal-append.queue_time_us":346982}
I20260709 12:13:44.758091 10820 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.760574  9037 leader_election.cc:400] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:44.757249  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.773931  9037 leader_election.cc:403] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.776685 10720 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:44.779139 10690 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.780009  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.782053 10690 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.783167 10820 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.781931  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:44.786099 10820 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.786947  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:44.787737  9621 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.793116  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:44.794138  9622 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.797525  9621 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:44.799084  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:44.799497  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:44.800156 10820 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.800524  9069 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:44.800765 10820 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:44.801940  8819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 317) took 6105 ms. Trace:
I20260709 12:13:44.802330 10820 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.804714  9620 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:44.807893  9622 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:44.809352  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:44.810518 10690 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:44.811103 10690 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:44.802421  8819 rpcz_store.cc:276] 0709 12:13:38.695996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.696233 (+   237us) service_pool.cc:224] Handling call
0709 12:13:44.801667 (+6105434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.408382 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:41.515060 (+106678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:41.517072 (+  2012us) write_op.cc:435] Acquired schema lock
0709 12:13:41.518841 (+  1769us) tablet.cc:662] Decoding operations
0709 12:13:41.636645 (+117804us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:41.646237 (+  9592us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:41.647756 (+  1519us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:41.691585 (+ 43829us) tablet.cc:701] Row locks acquired
0709 12:13:41.693997 (+  2412us) write_op.cc:260] PREPARE: finished
0709 12:13:41.723802 (+ 29805us) write_op.cc:270] Start()
0709 12:13:41.736979 (+ 13177us) write_op.cc:276] Timestamp: P: 1783599221723734 usec, L: 0
0709 12:13:41.741504 (+  4525us) op_driver.cc:348] REPLICATION: starting
0709 12:13:41.829773 (+ 88269us) log.cc:844] Serialized 912 byte log entry
0709 12:13:42.811108 (+981335us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.000349 (+189241us) write_op.cc:301] APPLY: starting
0709 12:13:43.000466 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.000630 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.000810 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.001224 (+   414us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.001445 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:43.001510 (+    65us) write_op.cc:312] APPLY: finished
0709 12:13:43.001781 (+   271us) log.cc:844] Serialized 29 byte log entry
0709 12:13:43.001989 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.002101 (+   112us) write_op.cc:454] Released schema lock
0709 12:13:43.002161 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.046946 (+ 44785us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.046991 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":464870,"reported_tablets":3,"spinlock_wait_cycles":945920,"child_traces":[["op",{"apply.queue_time_us":188937,"apply.run_cpu_time_us":2284,"apply.run_wall_time_us":46558,"num_ops":2,"prepare.queue_time_us":640620,"prepare.run_cpu_time_us":34030,"prepare.run_wall_time_us":1388173,"raft.queue_time_us":222133,"raft.run_cpu_time_us":9923,"raft.run_wall_time_us":195857,"replication_time_us":1069454,"thread_start_us":1712676,"threads_started":4,"wal-append.queue_time_us":701527,"wal-append.run_cpu_time_us":21737,"wal-append.run_wall_time_us":1484619}]]}
I20260709 12:13:44.812426 10690 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.821271  8823 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 302) took 5994 ms. Trace:
I20260709 12:13:44.823355  8823 rpcz_store.cc:276] 0709 12:13:38.826521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.826670 (+   149us) service_pool.cc:224] Handling call
0709 12:13:38.985950 (+159280us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba5090 00007f3985c43f3a 00007f398b9f9e9c 00007f398baf804e 00007f3989fb92a4 00007f3989fb9232 00007f3989fb9161 00007f3989fb90dc 00007f3989fb8392 00007f3983f7648c 00007f3983f758c6
0709 12:13:44.820975 (+5835025us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":247902080}
I20260709 12:13:44.806972  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 280) took 1165 ms. Trace:
I20260709 12:13:44.825538  9620 rpcz_store.cc:276] 0709 12:13:43.641138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.641771 (+   633us) service_pool.cc:224] Handling call
0709 12:13:44.806655 (+1164884us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540069f354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:44.806889 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537024896}
I20260709 12:13:44.818789  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:44.827445  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 554) took 2143 ms. Trace:
I20260709 12:13:44.827586  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:44.828016  9624 rpcz_store.cc:276] 0709 12:13:42.683794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.683927 (+   133us) service_pool.cc:224] Handling call
0709 12:13:43.332685 (+648758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.729896 (+1397211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.826133 (+ 96237us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400771854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:44.827135 (+  1002us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400771850. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:44.827360 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4702322816}
I20260709 12:13:44.828667  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:44.834116 10662 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:44.834842 10662 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.840687 10798 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:44.841449 10798 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.842891 10810 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.843680 10810 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.846410 10810 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:44.847220 10669 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:44.847636 10791 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.847741 10669 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:44.849231 10669 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:44.850598 10669 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.852440 10819 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.853130 10740 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.853170 10819 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:44.906000 10740 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:44.906940 10819 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.859450  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 279) took 1301 ms. Trace:
I20260709 12:13:44.909788  9617 rpcz_store.cc:276] 0709 12:13:43.557704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.560455 (+  2751us) service_pool.cc:224] Handling call
0709 12:13:43.560855 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.200612 (+639757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.223907 (+ 23295us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.812533 (+588626us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.840295 (+ 27762us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:44.840369 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.858977 (+ 18608us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.859038 (+    61us) raft_consensus.cc:1685] finished
0709 12:13:44.859069 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.859272 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18537,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":572046,"threads_started":2,"wal-append.queue_time_us":24599}
W20260709 12:13:44.920501  9070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 276) took 2212 ms (client timeout 1645 ms). Trace:
W20260709 12:13:44.921015  9070 rpcz_store.cc:269] 0709 12:13:42.707948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.709551 (+  1603us) service_pool.cc:224] Handling call
0709 12:13:44.920119 (+2210568us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400369554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:44.920293 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387096448}
I20260709 12:13:44.867605  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:44.922964  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:44.923658  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1902) took 1055 ms. Trace:
I20260709 12:13:44.923979  8916 rpcz_store.cc:276] 0709 12:13:43.868417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.868547 (+   130us) service_pool.cc:224] Handling call
0709 12:13:44.923508 (+1054961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4352}
I20260709 12:13:44.884382  9073 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:44.881192  9066 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:13:44.891089  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.002s	sys 0.010s
I20260709 12:13:44.907034 10740 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:44.936533  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.003s	sys 0.010s
W20260709 12:13:43.996346  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123983us
I20260709 12:13:44.937794  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 285) took 1911 ms. Trace:
I20260709 12:13:44.938210  9068 rpcz_store.cc:276] 0709 12:13:43.026506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.264817 (+238311us) service_pool.cc:224] Handling call
0709 12:13:43.265188 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.265431 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:13:43.529951 (+264520us) log.cc:844] Serialized 14 byte log entry
0709 12:13:43.959535 (+429584us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b1800195400. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:13:44.937119 (+977584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:44.937239 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:44.937347 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.937476 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.937715 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12845,"prepare.queue_time_us":237808,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2770,"raft.queue_time_us":48854,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":45406464,"thread_start_us":1231727,"threads_started":2}
I20260709 12:13:44.895704  8918 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:44.942641 10820 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.943683 10820 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:44.944468 10441 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:44.899492  8995 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.158s	user 0.016s	sys 0.000s
I20260709 12:13:44.947265  8995 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:44.948061  8995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 952) took 1287 ms (client timeout 1574 ms). Trace:
W20260709 12:13:44.948522  8995 rpcz_store.cc:269] 0709 12:13:43.660906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.661451 (+   545us) service_pool.cc:224] Handling call
0709 12:13:44.947874 (+1286423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:44.949746 10820 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:44.950774  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:44.951586  9617 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:44.949710  8889 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:44.952857  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:44.953701 10441 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.952925  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:44.954355 10441 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:44.953754 10820 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.955467 10820 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:44.955973 10820 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:44.102290  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.033s	sys 0.075s
W20260709 12:13:44.957144  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.035s	sys 0.076s
W20260709 12:13:44.957576  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 1.41645e+06us
I20260709 12:13:44.958431  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:44.959820 10441 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:43.761305  8920 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:44.973203 10803 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.001s	user 0.007s	sys 0.004s
W20260709 12:13:44.942780  8918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1875) took 2172 ms (client timeout 2065 ms). Trace:
I20260709 12:13:44.974923  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:44.975164  8918 rpcz_store.cc:269] 0709 12:13:42.770192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.774775 (+  4583us) service_pool.cc:224] Handling call
0709 12:13:43.282587 (+507812us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16e9c 00007f3982b16a5b 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:44.942392 (+1659805us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540008bbd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:44.942666 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3217667712}
I20260709 12:13:44.976082  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1903) took 1105 ms. Trace:
I20260709 12:13:44.976490  8919 rpcz_store.cc:276] 0709 12:13:43.870924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.923635 (+ 52711us) service_pool.cc:224] Handling call
0709 12:13:44.975996 (+1052361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376}
I20260709 12:13:44.978221  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:44.979156  8917 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:44.979830  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1893) took 1315 ms. Trace:
I20260709 12:13:44.980233  8917 rpcz_store.cc:276] 0709 12:13:43.664361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.702942 (+ 38581us) service_pool.cc:224] Handling call
0709 12:13:44.979742 (+1276800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840}
I20260709 12:13:44.979851  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2361) took 1586 ms. Trace:
I20260709 12:13:45.003432 10441 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:45.003309  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46077.2us
I20260709 12:13:44.978996 10820 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.004190 10441 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:45.035288 10629 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.064077 10629 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.067579  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.069026 10820 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.069603  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.070572  8917 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:45.060983  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 284) took 2038 ms. Trace:
I20260709 12:13:45.053828  8920 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:44.994422  9074 rpcz_store.cc:276] 0709 12:13:43.393095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.414326 (+ 21231us) service_pool.cc:224] Handling call
0709 12:13:43.414640 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.419009 (+  4369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.419039 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.463311 (+ 44272us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.634470 (+171159us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:43.634519 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.634700 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.954349 (+1319649us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:44.979305 (+ 24956us) raft_consensus.cc:1685] finished
0709 12:13:44.979331 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.979636 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3951,"raft.queue_time_us":4045,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":41131,"spinlock_wait_cycles":19281152,"thread_start_us":164666,"threads_started":1,"wal-append.queue_time_us":484072}
I20260709 12:13:45.062415 10441 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:45.013686  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1897) took 1275 ms. Trace:
I20260709 12:13:45.072409  9067 rpcz_store.cc:276] 0709 12:13:43.022769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.246719 (+223950us) service_pool.cc:224] Handling call
0709 12:13:43.248113 (+  1394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.634787 (+386674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.060375 (+1425588us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400369054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:45.060770 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887407872}
I20260709 12:13:45.082172  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1898) took 1328 ms. Trace:
I20260709 12:13:45.071511  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:45.087827  9617 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.090600 10632 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:45.071496  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.091446 10632 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.092851 10830 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.093302 10830 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:45.093681 10830 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.096858  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:45.098169  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.098366  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:45.082499  8920 rpcz_store.cc:276] 0709 12:13:43.753907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.754077 (+   170us) service_pool.cc:224] Handling call
0709 12:13:45.078898 (+1324821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.084425  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.085952 10629 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:45.086467  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.080363  8922 rpcz_store.cc:276] 0709 12:13:43.738282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.738481 (+   199us) service_pool.cc:224] Handling call
0709 12:13:43.751991 (+ 13510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.752217 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:43.817577 (+ 65360us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.982204 (+1164627us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b18003a0180. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:13:45.012883 (+ 30679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.012988 (+   105us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:45.013111 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.013241 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.013464 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65269,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"spinlock_wait_cycles":16422272,"thread_start_us":22084,"threads_started":1,"wal-append.queue_time_us":1182961}
W20260709 12:13:45.104419  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 146149us
I20260709 12:13:45.108561  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.109076  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.109952  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.114820  9619 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:45.120239  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:45.127885  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.128789  8917 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.131459  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.132396  8920 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.134593  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1901) took 1276 ms. Trace:
I20260709 12:13:45.135756  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.135057  8921 rpcz_store.cc:276] 0709 12:13:43.857836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.858096 (+   260us) service_pool.cc:224] Handling call
0709 12:13:45.133736 (+1275640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.134092 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.134117 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.134188 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:45.134230 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.134280 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.134398 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260709 12:13:45.138302 10820 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:45.138950 10820 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:45.141820  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.144389  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.148974 10830 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:43.826401  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:45.151556  8996 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:45.151875  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.152230  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 950) took 1494 ms. Trace:
I20260709 12:13:45.152665  9624 raft_consensus.cc:1813] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Handling vote request from an unknown peer fd11e77b4be14e658672599b30d51e76
I20260709 12:13:45.152634  8996 rpcz_store.cc:276] 0709 12:13:43.658246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.701547 (+ 43301us) service_pool.cc:224] Handling call
0709 12:13:45.152136 (+1450589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.153519  9624 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:13:45.156411  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.172969 10629 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.141722 10820 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:45.176195  9617 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:45.150929 10662 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:45.177814  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:45.181270  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:45.183037  8920 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:45.173835 10629 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.183828  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:45.178983 10820 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:45.186426 10820 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.187777  8924 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.188347  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.188664 10820 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.189101 10629 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:45.192690 10752 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:45.196400  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.196782  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.193136  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1899) took 1415 ms. Trace:
W20260709 12:13:45.201148  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 102843us
I20260709 12:13:45.215058  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.197575  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.198508  9615 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:45.195963  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.223011 10662 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:45.223325 10752 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.193392 10820 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.212512  8923 rpcz_store.cc:276] 0709 12:13:43.764539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.764728 (+   189us) service_pool.cc:224] Handling call
0709 12:13:45.009651 (+1244923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.010145 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:45.073905 (+ 63760us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.179614 (+105709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.179666 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:45.179734 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.179798 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.179880 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105317,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":1564,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":1428,"thread_start_us":135109,"threads_started":2,"wal-append.queue_time_us":82468}
I20260709 12:13:45.227660  9622 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:45.239784 10820 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.241544 10820 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.234179  8917 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:45.241065  9621 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:45.226258 10830 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.260192 10752 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:45.262166  9619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 567) took 2199 ms (client timeout 2633 ms). Trace:
I20260709 12:13:45.262468  9617 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:45.263007  9617 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:45.264573  9617 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.265879  9617 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.226287 10840 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.259760  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.267509 10840 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:45.268074 10840 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.269421  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.270051  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:45.271020  8999 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.274441  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:45.225914  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 948343us
I20260709 12:13:45.261605  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.276829  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.262468 10752 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.278584  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.284011 10820 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.284595  9620 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
W20260709 12:13:45.262647  9619 rpcz_store.cc:269] 0709 12:13:43.062442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.123439 (+ 60997us) service_pool.cc:224] Handling call
0709 12:13:45.242543 (+2119104us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540061e4d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:45.262073 (+ 19530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4301909248}
I20260709 12:13:45.285434  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:45.286461  8992 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:45.278218  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.288110  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.289605 10820 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.290200  8923 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.278659  8995 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.290369 10820 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:13:45.292536 10599 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.293063  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:45.293449  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:45.293177 10599 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.296124  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:45.295409  9616 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.301008  9067 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:45.303683  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:45.304737  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.304965  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:45.305624  9068 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:45.305493  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.305912  8996 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:45.306491  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.306953  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:45.307293  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.306595  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.307701  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.308288  9069 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:45.308219  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:45.309262  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.309428  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:45.309923  9072 raft_consensus.cc:2376] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4. Re-sending same reply.
I20260709 12:13:45.310264  9000 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:13:45.311656  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.316429  9616 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:45.307673  8998 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:45.284101 10752 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:45.320376  8997 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:45.321038  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.321305 10752 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.326772  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.332695  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:45.337517  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.338630  8920 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:45.340860  9620 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:45.346478  8921 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:45.346402  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.347466 10599 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.354408  9068 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.359200  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.365998  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.366988  8917 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:45.368709  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.368858  8923 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:45.371084  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:45.375613  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47306
I20260709 12:13:45.377166  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.377993  9070 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:45.380407  9069 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:45.383100  8999 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:45.383497  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1900) took 1568 ms. Trace:
I20260709 12:13:45.383859  8924 rpcz_store.cc:276] 0709 12:13:43.814687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.814905 (+   218us) service_pool.cc:224] Handling call
0709 12:13:45.141467 (+1326562us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:45.187434 (+ 45967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.188230 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.383285 (+195055us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b540020eed0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:45.383432 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120680192}
I20260709 12:13:45.385058  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.385802  8924 raft_consensus.cc:2368] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:45.365350 10840 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.399715  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.415952  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.416579  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.417493  8923 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
W20260709 12:13:45.409165  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.470921  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:45.471834 10843 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:13:45.472229  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.472601  9067 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.472915  8924 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:45.473570 10632 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:45.473825  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.477344  8924 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 3. Current term is 4.
I20260709 12:13:45.478137  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:45.478223  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.490272  9621 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:45.494005  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.473723 10840 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:45.501773  8923 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:45.502188 10661 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.502884  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.504240  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.504956  8923 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:45.505677  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.506669  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.507207  8923 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:45.515452 10840 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:45.502946 10661 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:45.520895 10661 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:45.518301  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.523198  8924 raft_consensus.cc:2368] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3.
I20260709 12:13:45.529655 10840 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:45.555091  9073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2362) took 2085 ms (client timeout 2199 ms). Trace:
I20260709 12:13:45.558089  9621 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.541343  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.559839  8924 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:45.522527  9616 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:45.554325  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.495065  8919 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
W20260709 12:13:45.557924  9073 rpcz_store.cc:269] 0709 12:13:43.452474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.487647 (+ 35173us) service_pool.cc:224] Handling call
0709 12:13:45.530486 (+2042839us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000ad554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:45.537510 (+  7024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3083015936}
I20260709 12:13:45.561331  8888 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:45.563462  8923 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:45.564407  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 271510us
I20260709 12:13:45.565547  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.573562  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.574417  8925 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:45.577322  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.578469  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.579566  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.580699  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.581635  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.582708  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.586860  9073 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:45.589558  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.592128 10651 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.573642  9620 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:45.595515  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.596098  8925 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.598685 10720 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:45.599570  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:45.906556  8925 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:13:45.739259  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 389784us
W20260709 12:13:45.730923  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 388092us
I20260709 12:13:45.602306  8923 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.915015  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:45.612012  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.917547  8920 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:45.918574  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 358676us
I20260709 12:13:45.917835  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:45.880007  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002bdea0 after lost signal to thread 7719
W20260709 12:13:45.601361 10846 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:13:45.925596  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800303ce0 after lost signal to thread 8857
I20260709 12:13:45.925597  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.926190  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:45.923945  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:45.928702  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:45.904698 10651 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.805635  9615 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:45.797946  9620 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:45.940465  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800095220 after lost signal to thread 8949
I20260709 12:13:45.930455  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:45.789649 10722 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.927927  9072 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:45.916939  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:45.718968 10854 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.933218  9590 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.602s (SENT)
W20260709 12:13:45.949190  9646 debug-util.cc:398] Leaking SignalData structure 0x7b080029f060 after lost signal to thread 9024
W20260709 12:13:45.949524  9646 debug-util.cc:398] Leaking SignalData structure 0x7b080029f1e0 after lost signal to thread 9025
I20260709 12:13:45.952083  9074 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:45.953564  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800396400 after lost signal to thread 9098
W20260709 12:13:45.954466  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002c20e0 after lost signal to thread 9649
W20260709 12:13:45.954692  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800087f00 after lost signal to thread 9650
I20260709 12:13:45.942611 10810 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.952579  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:45.603390 10720 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:45.955125 10847 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 12:13:45.950423 10632 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.974385  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:45.975445 10642 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:45.955823 10840 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:45.979497  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800362880 after lost signal to thread 10598
W20260709 12:13:45.979831  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800356480 after lost signal to thread 10608
W20260709 12:13:45.982029  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800397a20 after lost signal to thread 10616
W20260709 12:13:45.982765  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800356740 after lost signal to thread 10649
W20260709 12:13:45.983103  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800356880 after lost signal to thread 10670
I20260709 12:13:45.983294  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:45.966547 10651 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.984968  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:45.985972  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 71521.8us
I20260709 12:13:45.986224 10775 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.984512 10810 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:13:45.977325 10632 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.986905 10775 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:45.987656 10632 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.986296  8921 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:45.988039 10632 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:45.989621  8921 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.989296 10632 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.990551  9617 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:45.990726  8921 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:45.988018 10775 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:45.992218 10775 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:45.995268  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.987793 10764 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:45.991125  8921 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:45.986840 10637 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.990576 10632 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.000447 10720 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.003159 10637 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:45.951736 10854 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.007609  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:46.013906  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:46.021690  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:46.024019 10764 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.008888 10651 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.025188 10651 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.025530 10651 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.015925 10637 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.030843  9069 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:46.019809  8921 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.034837  8921 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.036790  8924 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:46.040786  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:46.043560  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.044392  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:46.052104  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:46.054067 10740 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:46.055505 10764 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:46.055945 10764 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:46.056329 10764 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:46.063808  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 48510.7us
I20260709 12:13:46.034997  8821 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.069397  9069 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:46.070421  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:46.072285  8923 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:46.047015 10720 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:46.069134  8821 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:46.072707 10840 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.076689 10680 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.076997 10840 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.077111 10597 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:46.077548 10840 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.078142  8919 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:46.077450 10657 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.079551 10657 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:46.080543 10657 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.082841  8918 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:46.078709 10597 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.083546 10651 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.084303 10597 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.084686 10597 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:46.085376 10840 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.085541 10597 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.075019 10662 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:13:46.088346 10536 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:46.088836 10850 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:46.090443 10798 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:46.091830 10642 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:46.091997  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:46.092453 10577 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.093521 10651 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.077257 10680 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.095765  8821 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 5, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:46.097517 10845 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.688s	user 0.000s	sys 0.006s
I20260709 12:13:46.087513 10840 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:46.076196  8889 leader_election.cc:400] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:46.162710  8889 leader_election.cc:403] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:46.111136 10854 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:46.112432 10851 tablet_replica.cc:333] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
W20260709 12:13:46.114961 10690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.008s	sys 0.019s
I20260709 12:13:46.116035  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:46.118294  9646 debug-util.cc:398] Leaking SignalData structure 0x7b080034aa40 after lost signal to thread 10723
I20260709 12:13:46.148288 10597 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.151882  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:46.193996  8923 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.163393  8888 leader_election.cc:400] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:46.167107  8821 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:46.174336  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 98258.5us
W20260709 12:13:46.189177  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800362900 after lost signal to thread 10739
I20260709 12:13:46.125934  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:46.160843 10680 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.158929  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:46.154186 10577 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:46.149278 10720 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:46.201332  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800388c80 after lost signal to thread 10750
W20260709 12:13:46.202867  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800381c40 after lost signal to thread 10782
W20260709 12:13:46.203429  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800386480 after lost signal to thread 10804
W20260709 12:13:46.203751  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800323760 after lost signal to thread 10812
W20260709 12:13:46.194896 10690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.009s	sys 0.019s
I20260709 12:13:46.157913 10710 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:13:46.214324  9066 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:46.193701 10858 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:46.190146 10854 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:46.228628  8923 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:46.231070 10744 raft_consensus.cc:993] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:46.234197 10669 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.236428  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:46.237661  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:46.238188 10599 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:46.234794 10669 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.238776 10599 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.240383 10669 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.238286  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:46.240751 10599 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.238332  9622 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:46.241333  8997 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:13:46.241564  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 666857us
I20260709 12:13:46.211489 10765 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:13:46.242722  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:46.244029  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:46.245051 10854 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.245445 10854 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:46.246322 10854 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.248301  8993 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.249956 10663 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.250727 10663 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.251698  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:46.252619  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.251727 10744 raft_consensus.cc:1081] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:13:46.257475  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:46.258328  8995 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:46.258255  8997 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:46.259423 10853 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.260361  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.260200 10853 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.261176  9000 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:46.262634 10853 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:46.259559  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:46.263659  8998 raft_consensus.cc:2410] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:46.268576  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.269083 10851 raft_consensus.cc:2243] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:46.270370 10851 raft_consensus.cc:2272] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:46.201720 10651 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:13:46.271203  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.271749 10651 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:46.272215 10651 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:46.273276 10651 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.220172  8918 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.276623  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:46.277359  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 81094.8us
W20260709 12:13:46.039304 10441 consensus_queue.cc:1175] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4993160378a142a1bc21648120cbaebc" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:13:46.289999  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 72869.3us
I20260709 12:13:46.294405  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.295751  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.300384  9000 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:13:46.304625  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2365) took 1005 ms. Trace:
I20260709 12:13:46.304378 10764 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.293264 10740 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.304998  9066 rpcz_store.cc:276] 0709 12:13:45.299003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.300751 (+  1748us) service_pool.cc:224] Handling call
0709 12:13:45.301087 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.214751 (+913664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.304363 (+ 89612us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54001b6554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:46.304567 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099601280}
I20260709 12:13:46.305740 10740 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.306583 10764 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.308560 10740 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:46.309646 10577 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.292168 10637 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.313360 10637 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:46.314261 10637 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:46.315353  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.316746  9621 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:46.317358 10836 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.317975 10836 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:46.318451 10836 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:46.327404  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.330358  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:46.329744 10720 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.289317 10854 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.280530 10651 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.334415  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:46.335148  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:46.340251  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88682.2us
I20260709 12:13:46.300806  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:46.341684  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.280256  8918 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:46.347707  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:46.348560  8925 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:46.355928 10852 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.356237  8921 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:46.356817 10852 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:46.358690  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.358242  8918 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.359436  8918 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.360213  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.370904  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:46.366547  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 132914us
I20260709 12:13:46.383104  9040 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:46.384855  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52692.1us
I20260709 12:13:46.386530  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:46.298622 10858 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:13:46.389074  8925 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:13:46.390256  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 241239us
W20260709 12:13:46.375859  8963 connection.cc:256] RPC call timeout handler was delayed by -1.7577238779997515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 12:13:46.393078  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:46.402805  9590 leader_election.cc:336] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.635s (SENT)
W20260709 12:13:46.385712 10791 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.533s	user 0.011s	sys 0.017s
W20260709 12:13:46.420082  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 141414us
I20260709 12:13:46.427322  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:46.384917 10657 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.391572 10765 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:46.430080  8963 connection.cc:256] RPC call timeout handler was delayed by -1.6893071779998081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:13:46.410400 10597 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:13:46.419135 10791 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:46.434232  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:46.436124  8963 connection.cc:256] RPC call timeout handler was delayed by -1.1121483579997857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:13:46.437685  8963 connection.cc:256] RPC call timeout handler was delayed by -1.0257483579998734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:13:46.432655 10820 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.447279 10820 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:46.432132 10765 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:46.451484 10765 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:46.453394  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 63854.2us
I20260709 12:13:46.455338  9071 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:46.462118  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:46.475157  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:46.475340  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:46.444967  8919 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.480247  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:46.481000 10642 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.483177 10597 consensus_queue.cc:1243] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:13:46.499023  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 120004us
W20260709 12:13:46.494457  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67258.1us
I20260709 12:13:46.648870  8924 pending_rounds.cc:85] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 5
I20260709 12:13:46.569566 10842 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:13:46.627331  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.496773 10806 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:46.631727 10810 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.632881 10680 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:46.634037 10862 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.332s	user 0.004s	sys 0.000s
W20260709 12:13:46.644224  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.475131 10661 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.439409 10657 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.649221  8924 pending_rounds.cc:107] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:46.491825  8919 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:46.492888 10852 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.680816  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:46.650489 10866 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.218s	user 0.000s	sys 0.007s
W20260709 12:13:46.685359  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.686342 10441 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:46.734836 10441 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:46.690454  8993 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:46.686533  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:46.720662  8924 raft_consensus.cc:2889] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:46.743850  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63177.7us
I20260709 12:13:46.681996 10810 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.721472 10597 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:46.765808  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.769511  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 142190us
I20260709 12:13:46.773013  8919 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.775462 10852 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.776024 10852 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.770772 10441 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.754135 10810 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.793373  8963 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:46.796638 10441 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.735288 10661 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:46.808579 10680 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:46.776463 10852 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:46.826349  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.825774 10599 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:46.830490 10869 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.211s	user 0.006s	sys 0.006s
I20260709 12:13:46.830566 10599 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:46.864249 10878 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:46.863778 10599 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:46.932322 10836 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.007s
W20260709 12:13:46.932993  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.865579  8918 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:46.935117 10836 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.073220 10836 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:46.927718 10765 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.083372 10851 ts_tablet_manager.cc:1916] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:47.089689 10661 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.096271 10441 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:47.096113  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 615913us
I20260709 12:13:47.096725 10441 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:47.097273 10441 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:46.998592  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 243043us
W20260709 12:13:47.097254  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 326905us
W20260709 12:13:47.099016  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.102741  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.105408  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:47.119829  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:47.124784  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:47.127586  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.128124  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:47.106978 10806 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:47.130705  8993 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.111654 10639 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.116004 10836 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.121107 10854 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.130844  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:47.142807 10441 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.146292 10441 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:47.145952  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:47.152768  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.147653  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.160745  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:47.161374  8993 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:47.139045 10632 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.142182 10661 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.167328  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.141314 10716 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:47.147387 10854 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:47.130239 10885 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:13:47.172138 10806 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.178556  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:13:47.178812  9071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 293) took 1873 ms (client timeout 1749 ms). Trace:
I20260709 12:13:47.179967  9073 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.163805 10720 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.185353  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 309) took 1020 ms. Trace:
W20260709 12:13:47.179255  9071 rpcz_store.cc:269] 0709 12:13:45.305707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.318089 (+ 12382us) service_pool.cc:224] Handling call
0709 12:13:47.178635 (+1860546us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002d50d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:47.178743 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589176576}
I20260709 12:13:47.166971 10836 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.185870  9620 rpcz_store.cc:276] 0709 12:13:46.164766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.167379 (+  2613us) service_pool.cc:224] Handling call
0709 12:13:46.357992 (+190613us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:46.358259 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.428111 (+ 69852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.429577 (+  1466us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.498676 (+ 69099us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.106627 (+607951us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:47.112983 (+  6356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.119701 (+  6718us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.178878 (+ 59177us) raft_consensus.cc:1685] finished
0709 12:13:47.178900 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.185275 (+  6375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43302,"raft.queue_time_us":48080,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11218,"spinlock_wait_cycles":3545984,"thread_start_us":351861,"threads_started":1,"wal-append.queue_time_us":441040}
I20260709 12:13:47.177012 10632 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.194818 10632 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.187477 10885 consensus_queue.cc:1243] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:13:47.229486  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 51571.6us
I20260709 12:13:47.231851  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:47.230811  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70352.5us
I20260709 12:13:47.198949 10836 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.174772 10716 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.240036  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.195819 10720 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.238729 10836 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.312834  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.314447  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.236444 10810 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:47.315436  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77496.9us
I20260709 12:13:47.317005 10810 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:47.317518 10875 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.574s	user 0.003s	sys 0.012s
I20260709 12:13:47.319658  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 310) took 1120 ms. Trace:
I20260709 12:13:47.320408  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:47.321029 10871 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.587s	user 0.004s	sys 0.010s
I20260709 12:13:47.321201  8924 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:13:47.320147  9616 rpcz_store.cc:276] 0709 12:13:46.199762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.201386 (+  1624us) service_pool.cc:224] Handling call
0709 12:13:46.222342 (+ 20956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.377699 (+155357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.381271 (+  3572us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.435416 (+ 54145us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.569586 (+134170us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:46.569638 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.569726 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.319415 (+749689us) raft_consensus.cc:1685] finished
0709 12:13:47.319446 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.319589 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64601,"raft.queue_time_us":82048,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":4881,"thread_start_us":101833,"threads_started":1,"wal-append.queue_time_us":687419}
I20260709 12:13:47.323349  8918 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:13:47.324586  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.325191  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.325867 10836 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.327316  8918 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:47.328078 10836 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.328761 10836 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:47.329288  8918 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:47.330303  8996 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.335675  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:47.336465  8925 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:47.338258  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 101786us
W20260709 12:13:47.300614  9037 leader_election.cc:336] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.574s (SENT)
I20260709 12:13:47.301528  8995 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.230074 10661 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.340519  9074 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:47.307161 10716 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.307739 10852 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.339138  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:47.310199  8888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.526s (SENT) [suppressed 39 similar messages]
I20260709 12:13:47.343271 10720 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:47.311547 10882 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.003s
I20260709 12:13:47.338442 10842 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.339900 10820 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:47.305521 10854 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:47.347924 10842 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:47.348564  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:47.349534  9620 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:47.349038 10842 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.350801 10842 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:47.351254 10876 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.608s	user 0.007s	sys 0.012s
W20260709 12:13:47.365741  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48501.5us
I20260709 12:13:47.366382  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 313) took 1064 ms. Trace:
I20260709 12:13:47.367038  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:47.367455  9619 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.352784 10912 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:47.354795  8919 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:47.372010 10874 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.636s	user 0.014s	sys 0.008s
I20260709 12:13:47.371769 10908 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.373245  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 312) took 1078 ms. Trace:
I20260709 12:13:47.373594 10908 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.373692  9622 rpcz_store.cc:276] 0709 12:13:46.294821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.294965 (+   144us) service_pool.cc:224] Handling call
0709 12:13:46.295396 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.295694 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.295732 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.299141 (+  3409us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.431262 (+132121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.431304 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.431365 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.371408 (+940043us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:47.372937 (+  1529us) raft_consensus.cc:1685] finished
0709 12:13:47.372957 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.373184 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46668672,"thread_start_us":74225,"threads_started":1,"wal-append.queue_time_us":232029}
I20260709 12:13:47.374725  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2375) took 1780 ms. Trace:
I20260709 12:13:47.375072  9073 rpcz_store.cc:276] 0709 12:13:45.594554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.697106 (+102552us) service_pool.cc:224] Handling call
0709 12:13:47.179790 (+1482684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.180338 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.374521 (+194183us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002d50d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:47.374668 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923018112}
I20260709 12:13:47.377759 10908 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:47.378726  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.380575  9074 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.380575  9073 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:47.359891  9616 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:47.383353 10657 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.383827 10632 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:47.385344  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.386606 10632 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.388564  8995 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:47.390839  8997 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:47.391219  8997 pending_rounds.cc:85] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 2
I20260709 12:13:47.393031  8997 pending_rounds.cc:107] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:47.393271  8997 raft_consensus.cc:2889] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.392673  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:47.355966  8925 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:13:47.356406  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46244.8us
I20260709 12:13:47.357399 10820 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:47.398288 10820 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.357827 10850 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:13:47.358242  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57683.4us
I20260709 12:13:47.358604 10637 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:47.359319  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.360033  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:47.404241  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44391.3us
I20260709 12:13:47.300484 10886 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:47.360257 10881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.011s	sys 0.010s
I20260709 12:13:47.405216  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:47.405804 10881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.011s	sys 0.010s
I20260709 12:13:47.360248 10765 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:47.360997  9620 pending_rounds.cc:85] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 6
I20260709 12:13:47.407506  9620 pending_rounds.cc:107] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:13:47.407888  9620 raft_consensus.cc:2889] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.361286 10661 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:47.411168 10661 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.368711  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.366779  9624 rpcz_store.cc:276] 0709 12:13:46.301797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.301939 (+   142us) service_pool.cc:224] Handling call
0709 12:13:46.306419 (+  4480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.377872 (+ 71453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.377917 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.400784 (+ 22867us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.467060 (+ 66276us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:46.467130 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.467226 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.350488 (+883262us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:47.366076 (+ 15588us) raft_consensus.cc:1685] finished
0709 12:13:47.366103 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.366320 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71013,"raft.queue_time_us":74205,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6850,"spinlock_wait_cycles":8986368,"thread_start_us":31199,"threads_started":1,"wal-append.queue_time_us":311664}
I20260709 12:13:47.355731 10716 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:13:47.364135  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 126511us
I20260709 12:13:47.415515 10716 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.415813  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:47.406755  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.434448  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:47.435312  9074 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.437263  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:47.443789  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 296219us
I20260709 12:13:47.444710  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:47.445678  8918 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:47.446897  8921 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:13:47.448364  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:47.448829  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47140.3us
I20260709 12:13:47.449383 10851 ts_tablet_manager.cc:1929] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:47.449941 10851 log.cc:1199] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/6b9ee0b0b4df4d3abfdf4c57b26939a5
I20260709 12:13:47.450558 10441 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:47.360994 10852 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.450387  9040 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:47.460899  9071 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.427222 10912 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:47.480948  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.494331 10851 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47306 (request call id 83) took 2137 ms. Trace:
I20260709 12:13:47.495265  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.495009 10851 rpcz_store.cc:276] 0709 12:13:45.370287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.375331 (+  5044us) service_pool.cc:224] Handling call
0709 12:13:45.601894 (+226563us) ts_tablet_manager.cc:1151] Deleting tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5
0709 12:13:46.111936 (+510042us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b171a2 00007f398ba58889 00007f398ab89d88 00007f398ac50c99 00007f398ac51293 00007f398ac822d0 00007f398ac6883d 00007f398ac687e9 00007f398ac68779
0709 12:13:46.112029 (+    93us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:47.314864 (+1202835us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:47.449230 (+134366us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:47.494233 (+ 45003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19402112,"tablet-delete.queue_time_us":225554,"thread_start_us":191147,"threads_started":1}
I20260709 12:13:47.496743 10820 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:47.497190  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:47.497956  8921 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:47.468123  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2229) took 1118 ms. Trace:
W20260709 12:13:47.478834  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.496243  8997 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:47.427858  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:47.494452  8919 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:47.505946  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:47.476253  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:47.499989  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.503528  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 96906.2us
I20260709 12:13:47.427495 10911 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.509620  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:47.510123  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:47.515290  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 68057.1us
I20260709 12:13:47.499068  8998 rpcz_store.cc:276] 0709 12:13:46.349557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.349721 (+   164us) service_pool.cc:224] Handling call
0709 12:13:46.361789 (+ 12068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.362102 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:46.831671 (+469569us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.467567 (+635896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.467643 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:47.467720 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.467815 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.468000 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":823005,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":65969,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":869115,"threads_started":3,"wal-append.queue_time_us":358769}
I20260709 12:13:47.440762 10899 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:13:47.469818 10903 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.442257 10720 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:47.470955 10842 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.495368 10802 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.429664 10886 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.498286 10854 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:13:47.497964 10765 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:13:47.525250  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.517877  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 6b9ee0b0b4df4d3abfdf4c57b26939a5 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:13:47.570294  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.572134  9068 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:47.702545  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.576370  8995 raft_consensus.cc:2368] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:47.585633  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:47.705753 10716 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:47.705957  8924 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:47.708323 10903 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.709219  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:47.709683  8810 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 201798us
I20260709 12:13:47.725679  9621 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:47.512926  9617 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.662297  8917 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:47.524946 10662 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:13:47.719619  9037 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.773s (SENT)
I20260709 12:13:47.746773  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:47.507824 10895 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:47.723809  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 306774us
I20260709 12:13:47.750756  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:47.751665 10599 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.752068 10599 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:47.752432 10599 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:47.756239 10907 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.289s	user 0.006s	sys 0.000s
I20260709 12:13:47.755896  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:47.757308 10922 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.757877 10922 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:47.758875 10922 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.759840  9617 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
W20260709 12:13:47.760456  9617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 595) took 1329 ms (client timeout 1714 ms). Trace:
W20260709 12:13:47.760850  9617 rpcz_store.cc:269] 0709 12:13:46.431491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.432082 (+   591us) service_pool.cc:224] Handling call
0709 12:13:47.426930 (+994848us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16eee 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:47.760392 (+333462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27906944}
I20260709 12:13:47.763127 10895 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:47.763471 10898 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.764164 10898 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.764586 10895 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.768854  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.772449  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.551882  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1054) took 1425 ms. Trace:
I20260709 12:13:47.696931 10597 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:13:47.674106 10642 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.792805  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.528707 10639 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.745609  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:47.748946  9037 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.816s (SENT)
I20260709 12:13:47.796895  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.796963  9616 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
W20260709 12:13:47.797860  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48949us
I20260709 12:13:47.798103  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.749378 10716 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:47.730443  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 178474us
I20260709 12:13:47.728503 10858 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.724076  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:47.800170  9071 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.520030 10852 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:47.784106  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 45615.7us
I20260709 12:13:47.723402 10899 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.786468 10886 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:47.713011 10802 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:47.718441 10710 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:13:47.712894 10720 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:47.790220 10915 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:47.815174  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:47.713395  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:47.574332 10632 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 12:13:47.792412 10642 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.763154  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:47.730947 10661 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.803795  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.779376 10842 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:47.572223 10919 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.266s
I20260709 12:13:47.810115 10854 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.810626  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:47.780772  8919 rpcz_store.cc:276] 0709 12:13:46.126938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.149553 (+ 22615us) service_pool.cc:224] Handling call
0709 12:13:46.194736 (+ 45183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.440397 (+245661us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b54004b08a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb2dc0 00007f3985c3d1c0 00007f3985c3e231 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c
0709 12:13:47.354016 (+913619us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b58001a8ad0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985b970aa 00007f3985c19447 00007f3985c31fe7 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4
0709 12:13:47.508067 (+154051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.530962 (+ 22895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540255872}
I20260709 12:13:47.803309 10908 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:47.725071  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.825073  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:47.965392  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.028470  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:47.818647  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 367638us
I20260709 12:13:47.910825 10441 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.029621  9071 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:13:47.954996  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.040328 10441 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.041896 10765 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.042385 10765 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:47.816807 10911 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:47.952591  9074 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 12:13:48.043527  9074 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
W20260709 12:13:47.876441  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61637.2us
I20260709 12:13:48.037065  8993 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:48.042800 10765 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.047458 10599 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.048324 10639 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:48.048734 10639 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:48.049543 10639 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.050786 10639 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.052187 10765 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.053112 10802 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.054867 10765 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.056609 10710 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.053352 10642 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:48.036760  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 226189us
I20260709 12:13:48.058101  9070 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:48.055349 10921 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.049612 10599 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:47.801143 10900 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.057722  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:48.108218  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.108258  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.108867  8993 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.082592  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:47.953768 10912 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.808147 10852 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.082592 10441 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.135938 10441 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.136364 10441 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.103567  9000 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:48.110227  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.103809  8992 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:13:48.113051  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55403.8us
I20260709 12:13:48.025413 10720 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.082207  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.127720  9070 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:48.109896 10921 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.128168 10802 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.149961 10441 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.128894 10900 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.903569 10858 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:47.814723 10899 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.036352 10661 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:48.108376  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:48.131496  8994 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.132828  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.068329 10920 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.140309  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.140347  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.144177  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.146478  8995 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:48.128180  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.148633  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.183045  8997 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:48.160573  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78061.8us
W20260709 12:13:48.163452  9066 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.016s	sys 0.025s
W20260709 12:13:48.184603  9066 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.016s	sys 0.025s
I20260709 12:13:48.163699  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.185191  8999 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:48.141487 10632 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.140187 10680 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.164340  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.182145  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.215507  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.216748  8995 raft_consensus.cc:2410] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:48.222100  9068 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:48.210685  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.223376  8994 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:48.224807 10441 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:48.165148 10802 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:48.231271  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.234607  8994 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:48.195840 10885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.015s	sys 0.013s
I20260709 12:13:48.238646  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.183408 10661 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.238139  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.247674  8992 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:48.241617  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.248320  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.246466  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.249343  8999 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:13:48.240084  9587 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.502s (SENT)
I20260709 12:13:48.250054  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:48.198386 10886 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.258224  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.259981  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:48.253090  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46494.1us
I20260709 12:13:48.210608 10912 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.255370  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:48.240578 10885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.015s	sys 0.013s
I20260709 12:13:48.276947  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:48.277215  8991 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:48.273216  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:48.237783 10881 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.278112  8995 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:48.238257  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.291638  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.293983  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.219177 10680 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:48.308004  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 268949us
I20260709 12:13:48.314776  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.219437 10632 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.317420  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:48.319547  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46462us
I20260709 12:13:48.315481  9069 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:13:48.321627  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.279094 10642 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:48.292840 10893 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:48.274601 10912 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:48.212759 10920 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.310751  9073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f24528c4e0f24715985149f6366da832"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:13:48.325675  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.328709  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.330695  9067 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:48.320214 10836 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.336580  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.245661 10842 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.353184  9073 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:48.354458  9073 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.356775  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:48.331902 10637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.032s	sys 0.027s
I20260709 12:13:48.276417 10886 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.358644  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.328771 10912 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.375365  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.375767 10720 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.351081 10836 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:48.376811 10836 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.377246 10720 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.378582 10720 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:48.379379  8998 raft_consensus.cc:2376] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4. Re-sending same reply.
I20260709 12:13:48.379582 10920 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.366731  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.380761  8995 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:48.381402  9621 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:13:48.385332  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.310724 10881 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.351114  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.359721 10637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.032s	sys 0.028s
I20260709 12:13:48.350636 10898 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.350905  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.414216  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.427999  8995 raft_consensus.cc:2376] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3. Re-sending same reply.
I20260709 12:13:48.414324  9623 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:48.429852  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:48.382952 10852 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.331753 10642 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:48.433482  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 106090us
I20260709 12:13:48.410007 10908 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.408260 10710 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.441735  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.449702  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.421826  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:48.357695 10802 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.462886  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.466529  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:48.434501 10940 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:48.466523  8991 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:48.509994  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.470646  8920 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:48.469381  8921 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:48.460583  8996 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:13:48.523869  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 80868.3us
I20260709 12:13:48.488432  9615 raft_consensus.cc:2368] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:48.527998  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:48.462399 10900 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.509140  9617 raft_consensus.cc:2410] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:13:48.528684  9622 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.468441 10921 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:48.528077  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:48.537196  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 70532.2us
I20260709 12:13:48.525519  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.538061  8999 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.489092 10680 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.493789  9620 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:48.542554  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:48.539677  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.544463  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.563647  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.537488  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 956) took 1011 ms. Trace:
I20260709 12:13:48.487670 10710 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.570667  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:48.574301  9000 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:48.574062  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.553054 10928 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:13:48.553380 10946 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:48.591343  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.592192  8997 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:48.597358  8993 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:48.598672  8994 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:13:48.575031 10929 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:13:48.609385  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57296.2us
I20260709 12:13:48.612195  9622 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:48.613649  8999 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:48.613960  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.615383  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.603924 10931 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:13:48.578915 10632 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:48.590246 10842 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.620579  8993 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.620419  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.632102  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.616550 10886 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.633914  8991 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:48.633994  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.636160  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:48.618296 10939 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.648267 10939 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.651770  8995 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.624722  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.575320  8996 rpcz_store.cc:276] 0709 12:13:47.526030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.530214 (+  4184us) service_pool.cc:224] Handling call
0709 12:13:48.328347 (+798133us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:48.534544 (+206197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3181952}
W20260709 12:13:48.629900 10930 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:13:48.671972 10936 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:13:48.673722 10937 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:48.676040 10642 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:48.676506  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2393) took 1105 ms. Trace:
I20260709 12:13:48.677006  9072 rpcz_store.cc:276] 0709 12:13:47.571213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.571483 (+   270us) service_pool.cc:224] Handling call
0709 12:13:47.571835 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:47.603977 (+ 32142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.604037 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:47.765130 (+161093us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b2c00078738. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:13:47.765755 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 12:13:48.197945 (+432190us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:48.198004 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.201828 (+  3824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.676139 (+474311us) raft_consensus.cc:1685] finished
0709 12:13:48.676167 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.676434 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3518,"raft.queue_time_us":32031,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":27679,"spinlock_wait_cycles":55738240,"thread_start_us":431761,"threads_started":1,"wal-append.queue_time_us":566129}
I20260709 12:13:48.687278  9073 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.688395  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:48.689107 10944 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:13:48.691656 10950 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:13:48.697528  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.698374  9624 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:13:48.665932 10941 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:13:48.703661  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.705823  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.706450  9071 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:48.714300  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 96019.8us
I20260709 12:13:48.718688  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:48.719650  8925 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:48.721557  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:48.733894  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.752543  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.757738 10680 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.758667  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.759559  8997 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:48.760319  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:48.764442 10912 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.765774  9000 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:48.752395  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:48.769579  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.769798 10661 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:48.770819  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:48.770991  8993 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:48.772022 10959 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.752688 10599 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:48.774673 10597 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:48.753203  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:48.775547 10680 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:48.776419  9615 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.720810 10720 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:13:48.792513  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.792892 10680 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.793772  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.782262  8963 leader_election.cc:400] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:48.785537 10919 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:48.790107  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.777889 10661 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.794880  8963 leader_election.cc:403] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:48.795567  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.794916  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.766947 10912 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:48.783336 10639 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.004s
I20260709 12:13:48.843076  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:48.845904  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 63815.4us
I20260709 12:13:48.843282  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.848572  8925 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:48.852016  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 161929us
I20260709 12:13:48.852428  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.855489  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.796800 10597 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:48.859723  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.832854  9620 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:48.864327 10910 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:48.864756 10910 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:48.865036  9037 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.028s (SENT)
I20260709 12:13:48.865481  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:48.867026  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.869004  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.832561 10836 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:48.851679 10661 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:48.870893  8997 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:48.852053 10946 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:48.940155  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.859936 10710 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.942725  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.854075 10919 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3.
I20260709 12:13:48.865451 10962 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:48.862713  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:48.868194 10637 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.936172 10657 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.967922  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:48.968699  8993 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:48.971545 10858 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:48.950656 10661 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:48.973690 10661 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:48.975538  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 110526us
I20260709 12:13:48.974000 10946 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.049533 10912 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:49.050436 10597 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.116305 10912 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.117295  9073 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:49.118005  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:49.118849  8925 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.119601  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.120870  8997 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:49.122058  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.115439  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.124908  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.125535  8993 raft_consensus.cc:2376] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4. Re-sending same reply.
W20260709 12:13:49.127295  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 349510us
I20260709 12:13:49.129242  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.123075  8997 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:49.131559  8925 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:49.115438  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.136833  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.137502  8993 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:49.138371  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.139467  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.143801  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.144706  8992 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:48.951407 10962 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:49.136915  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.123701 10854 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:49.153542  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.173480  8997 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:49.152086 10720 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.147228 10661 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.150627 10912 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.019937  8996 raft_consensus.cc:2376] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5. Re-sending same reply.
I20260709 12:13:49.135612 10886 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.020345 10637 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.176723  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.143865 10710 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:13:49.145617 10943 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:13:49.179275  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:49.175622 10968 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:13:49.050057 10910 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:49.189443 10933 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.809s	user 0.002s	sys 0.000s
I20260709 12:13:49.193614 10962 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.224190 10962 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.175622 10979 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:49.195848 10965 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:13:49.201949  8994 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.204039 10899 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:49.207643  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.216607  8992 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:49.217357  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:49.177901 10973 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 12:13:49.221186  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.219602 10680 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.223109 10910 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.223373 10637 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.178725 10720 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.244053 10949 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.177229 10854 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.245630 10925 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:49.246240 10925 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.246673  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.230013  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.247947  8919 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.238350  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:49.239540  8991 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:49.244673 10949 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.249867  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:49.267225  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.277596 10942 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.285331 10942 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.285781 10942 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.243013 10943 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.246996 10854 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.259976 10836 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.304620 10900 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.316061 10599 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:49.319290  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:49.319965  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 102707us
W20260709 12:13:49.320809  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.320761  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.322343  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.323639  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.324926  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.325631  9071 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:49.333171  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.331178  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1951) took 1220 ms. Trace:
I20260709 12:13:49.334340  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:49.335273  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.334623  9065 rpcz_store.cc:276] 0709 12:13:48.110593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.110711 (+   118us) service_pool.cc:224] Handling call
0709 12:13:49.322186 (+1211475us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b5800178e98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:49.331127 (+  8941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12512640}
W20260709 12:13:49.342161  9037 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.522s (SENT)
I20260709 12:13:49.342839  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.344383  9622 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:49.317595 10900 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.347539 10900 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.328320 10810 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.348744 10810 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.349962  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 601) took 1843 ms. Trace:
I20260709 12:13:49.345475 10895 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.350829 10810 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.334002 10943 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.351697 10925 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.352975  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.354278  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.354903  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1947) took 1270 ms. Trace:
I20260709 12:13:49.355132  9074 rpcz_store.cc:276] 0709 12:13:48.084230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.084755 (+   525us) service_pool.cc:224] Handling call
0709 12:13:49.354139 (+1269384us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800178e98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:49.354859 (+   720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41375104}
I20260709 12:13:49.357957  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:49.346603  9037 leader_election.cc:336] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.305s (SENT)
I20260709 12:13:49.360162  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.361763  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.325151 10720 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.363422 10962 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.373019 10720 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.375699  9065 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.375615  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.376340  9066 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:49.377743  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.378590  9066 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:13:49.379739  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:49.380246  9066 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.380856  9624 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:49.383738 10881 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.343158 10854 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:49.386551  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.396760  9073 raft_consensus.cc:2410] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.387494  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:49.397805  9622 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.401444  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.402699  8888 leader_election.cc:400] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:49.404156  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.390470  9066 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:49.405730  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.404359  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.410811  9070 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.411536  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:49.384068 10900 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.417204  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.419282  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.435742  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:49.398757 10943 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.441497  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.442210  8992 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:49.400650 10854 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.420107 10900 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.420197  9618 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:49.420710  9617 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 4. Ops: []
I20260709 12:13:49.420998 10949 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.414881  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.350359  9619 rpcz_store.cc:276] 0709 12:13:47.506172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.507922 (+  1750us) service_pool.cc:224] Handling call
0709 12:13:47.696079 (+188157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:47.696493 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.696524 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:47.797894 (+101370us) log.cc:844] Serialized 26 byte log entry
0709 12:13:48.170236 (+372342us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:48.170300 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.170406 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.188761 (+1018355us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:49.331596 (+142835us) raft_consensus.cc:1685] finished
0709 12:13:49.332810 (+  1214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.349894 (+ 17084us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14861,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":25615,"spinlock_wait_cycles":26787712,"thread_start_us":357403,"threads_started":1,"wal-append.queue_time_us":513891}
I20260709 12:13:49.423717  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:49.424674  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.452708  9622 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:49.433861 10942 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.437927  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.455765  8991 raft_consensus.cc:2368] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:49.455869  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.456588  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:49.438300  8998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 966) took 1531 ms (client timeout 1574 ms). Trace:
I20260709 12:13:49.439407  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:49.457791  8998 rpcz_store.cc:269] 0709 12:13:47.907260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.907564 (+   304us) service_pool.cc:224] Handling call
0709 12:13:49.438140 (+1530576us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002d7b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:49.438246 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785138560}
I20260709 12:13:49.440240  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.417598 10881 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:49.413606 10880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.015s	sys 0.065s
I20260709 12:13:49.465855  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.466508  8991 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:49.440861 10810 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.441169  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.444947  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.450126  8995 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.467344  8999 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:49.467571  8995 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:49.450716  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46668.2us
I20260709 12:13:49.468614  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.452764  9069 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:49.425410  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:49.454412  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:49.469867  9070 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.454797  8992 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:49.458771  8994 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.461406 10986 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.472008  8994 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:49.477612 10842 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.478358 10982 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:13:49.479480 10895 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:49.481298 10854 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.471459 10899 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.475679 10810 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.449226 10952 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.464565 10881 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.483628 10881 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.483969 10810 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.471211 10657 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:13:49.484771  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:49.465736 10880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.015s	sys 0.066s
I20260709 12:13:49.485875  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.487056 10908 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.487390  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.487594  8997 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.487758 10908 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.488049  8997 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:49.488791  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.485541 10661 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:49.489485  8994 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.490449 10661 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:49.490552  8994 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.490873 10661 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:49.491420  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.492614 10912 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.491873 10661 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.493382  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.489883 10908 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.489883  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:49.493839 10661 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.495826  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.495792  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:49.503827  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 101041us
I20260709 12:13:49.505564  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.488855  8997 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.505223 10810 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:49.498456 10919 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:49.476682  8995 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.508448  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.513010  9623 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:49.512547  8995 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.519454  8997 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.518015  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.522578  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.508610 10858 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.523730  9624 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.526495 10900 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:49.526926 10900 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.527346 10900 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:49.528141  9619 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:49.530055  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:49.530652  9069 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.508816 10939 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:49.532305 10939 raft_consensus.cc:2764] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:49.533512  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:49.510742 10810 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.535399 10858 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.535626 10810 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.498353 10962 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.536921  8995 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:49.535091  8994 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:13:49.541764  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 91956.9us
I20260709 12:13:49.542785  9069 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:49.545279  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.545840  9070 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:49.544420  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.552433  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:49.553092  8922 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:49.556708  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 99191.1us
I20260709 12:13:49.557528  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.511983 10942 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.537533 10952 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:49.562701  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.555392 10908 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:13:49.551080 10898 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:13:49.561553 10858 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:13:49.572254  8922 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:49.573350  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1090) took 1149 ms. Trace:
I20260709 12:13:49.573694  8922 rpcz_store.cc:276] 0709 12:13:48.424077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.428520 (+  4443us) service_pool.cc:224] Handling call
0709 12:13:49.552285 (+1123765us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:49.573249 (+ 20964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5909760}
I20260709 12:13:49.574352  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.574924  9069 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:49.565647  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.576112  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.576903  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.559207 10710 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:49.554912 10986 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.581743  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.584733  8922 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:49.582602  8921 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:49.560315 10680 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.582763  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:49.577128 10949 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.587671  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.554523 10910 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:13:49.555228 10919 consensus_queue.cc:1059] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:13:49.588414 10986 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.561918 10657 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:13:49.570544 10942 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.626330 10986 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.618415  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:49.627411 10639 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:49.627929 10639 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:49.628822 10639 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.597528 10880 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:49.592116  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 588) took 1124 ms. Trace:
I20260709 12:13:49.632758 10880 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:49.635550  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76522.8us
I20260709 12:13:49.612287 10991 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.597045 10680 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.640962 10680 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.637774  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.614929 10946 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.642045 10946 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.643999 10946 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.635658  9617 rpcz_store.cc:276] 0709 12:13:48.467521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.315985 (+848464us) service_pool.cc:224] Handling call
0709 12:13:49.316475 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:49.449140 (+132665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.591872 (+142732us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b54007611d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:49.592055 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229675776}
I20260709 12:13:49.646291  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.647193  8921 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:13:49.655406 10597 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.655514 10910 raft_consensus.cc:3055] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.656141 10910 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:49.657189 10900 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.559543 10962 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:49.640076  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.595372 10898 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.658077  8821 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 206) took 4892 ms. Trace:
I20260709 12:13:49.647002  8822 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 4, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 4 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.565442 10952 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.661703 10919 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:49.584376 10710 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.669481  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:49.671252  8822 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:13:49.670323 10919 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.672919 10919 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:49.673317  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.657289 10910 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.675323  8920 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.673842 10919 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.671715  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:49.677670 10919 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.675926 10952 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.663292  8821 rpcz_store.cc:276] 0709 12:13:44.765437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.842976 (+ 77539us) service_pool.cc:224] Handling call
0709 12:13:49.657926 (+4814950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:46.493563 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:46.497084 (+  3521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:46.497134 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:13:46.497160 (+    26us) tablet.cc:662] Decoding operations
0709 12:13:46.662299 (+165139us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:46.702041 (+ 39742us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:46.705290 (+  3249us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:46.830179 (+124889us) tablet.cc:701] Row locks acquired
0709 12:13:46.830239 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:13:46.830432 (+   193us) write_op.cc:270] Start()
0709 12:13:46.830738 (+   306us) write_op.cc:276] Timestamp: P: 1783599226830355 usec, L: 0
0709 12:13:46.830770 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:13:46.933104 (+102334us) log.cc:844] Serialized 1723 byte log entry
0709 12:13:47.507958 (+574854us) op_driver.cc:464] REPLICATION: finished
0709 12:13:47.790265 (+282307us) write_op.cc:301] APPLY: starting
0709 12:13:47.790358 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:47.790545 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:47.887580 (+ 97035us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:48.312114 (+424534us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:48.351499 (+ 39385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:13:48.358129 (+  6630us) write_op.cc:312] APPLY: finished
0709 12:13:48.375354 (+ 17225us) log.cc:844] Serialized 41 byte log entry
0709 12:13:48.375620 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.375715 (+    95us) write_op.cc:454] Released schema lock
0709 12:13:48.375758 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:48.376109 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.376138 (+    29us) write_op.cc:454] Released schema lock
0709 12:13:48.969827 (+593689us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3832a 00007f3985bbdf14 00007f3985bbdec3 00007f3985bbde38 00007f3985bbddf3 00007f3985bbd0dc 00007f3985be6e16 00007f3985bcecbb 00007f3985bb939d 00007f3985bbcd75
Metrics: {"mutex_wait_us":1567,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":275419,"apply.run_cpu_time_us":4548,"apply.run_wall_time_us":585869,"num_ops":4,"prepare.queue_time_us":200591,"prepare.run_cpu_time_us":37951,"prepare.run_wall_time_us":743904,"raft.queue_time_us":61512,"raft.run_cpu_time_us":13190,"raft.run_wall_time_us":1598589,"replication_time_us":610325,"spinlock_wait_cycles":128535936,"thread_start_us":632194,"threads_started":4,"wal-append.queue_time_us":379602,"wal-append.run_cpu_time_us":5057,"wal-append.run_wall_time_us":2124329}]]}
I20260709 12:13:49.681646  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.673995  8822 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 2 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.637156  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.688181  8997 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.637712  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.689559 10657 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.690122 10657 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:49.690234 10881 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.689973  8822 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.691090 10657 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.682893 10910 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.692358  8822 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:49.703040  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.704218 10680 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.704674 10953 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.705284 10980 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.705295 10953 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.705894 10980 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.705983 10953 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.706321 10980 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:49.687356  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50548.8us
I20260709 12:13:49.711958 10942 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.711860  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:49.717630  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:49.719525  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.613466 10810 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.724407 10661 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.725250  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.724987 10661 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.728005 10908 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:49.728615 10908 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:49.737428  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51055.4us
I20260709 12:13:49.733217 10661 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.733389 10900 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.740036 10908 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.693589 10881 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.721210 10680 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:49.756341  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.635123 10880 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.747898  8991 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:49.770898  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:49.771524  8991 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:49.772336  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.772858  8991 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:49.748415  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 73748.2us
W20260709 12:13:49.688247  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 130790us
I20260709 12:13:49.744379  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:49.754148  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 214868us
I20260709 12:13:49.745021  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.759586  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.686131 10710 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:49.765213  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.766835  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:49.781595  9000 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:49.781656  8994 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:49.783449  8992 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:13:49.783520  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.795295  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:49.795471  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.782675  9590 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.796657  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:49.797228  8923 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.746567 10946 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:49.786213  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.799120  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.806135  8991 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:49.783994  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.810776  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:49.811398  9074 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.811141  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.745939 10898 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:49.817915  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:49.819283  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.820892  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:49.800916 10900 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:49.851066  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.802147 10946 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.812142 10925 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.798738 10810 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:49.855329  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.856906  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:49.873477  8992 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.818974 10880 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.858116  9617 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:49.820919 10680 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.821460 10642 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.821086 10947 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.821223 10939 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:13:49.885306  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.902962  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.870486 10946 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.818078 10881 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:13:49.821250 10898 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:49.899983 10680 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.775321 10962 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:49.864444  9074 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:13:49.911384  8923 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:13:49.892071 10810 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.935998  8996 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:13:49.961239  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.899430 10642 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:13:49.932015  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.978902  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:49.956588 10949 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:49.997803  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.896611  8992 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:13:50.005685  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 210228us
I20260709 12:13:50.014707 10881 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.015630 10881 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:50.018014 10881 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:50.022148  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:49.971901 10680 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.904794 10900 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 12:13:50.032053  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 235115us
W20260709 12:13:50.065727  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 244892us
W20260709 12:13:50.064416  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 308217us
I20260709 12:13:49.987140 10642 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.048134  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:49.956687 10939 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:50.115931  8997 raft_consensus.cc:2368] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:50.021821 10947 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:50.121888  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.121876  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.019982 10942 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.118575  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.120532 10991 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.044273 10881 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
W20260709 12:13:50.149389  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.130345 10925 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.133883 11007 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.143349 10943 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:13:50.156075  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 372214us
I20260709 12:13:50.164105  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.166072 10949 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:50.166702 10949 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.169796  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.145651 10947 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:13:50.156037 10994 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 12:13:50.135260 10942 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.206844  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.233173  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.172447 10900 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:13:50.228564 10953 consensus_meta.cc:287] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.008s
I20260709 12:13:50.204568 10919 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:13:50.219985 10996 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 12:13:50.224056 10998 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:13:50.235273 10933 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:50.228051 11007 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.227118 11003 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.154932 10925 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.270150  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 222056us
I20260709 12:13:50.277745  8991 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.207865 10810 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:13:50.287866  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.339432  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.219071 10980 consensus_meta.cc:287] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.005s
W20260709 12:13:50.310662  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.245165 11002 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.251425 10900 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:13:50.345106 10597 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.001s
I20260709 12:13:50.346024 11008 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:13:50.362501  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 243972us
W20260709 12:13:50.364229  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 230226us
I20260709 12:13:50.370115  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:50.360229 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.018s	sys 0.030s
W20260709 12:13:50.402976  8993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.007s	sys 0.001s
W20260709 12:13:50.428169  8993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.008s	sys 0.001s
W20260709 12:13:50.396224  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 278696us
I20260709 12:13:50.429234  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:50.263269 10953 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.312448 10919 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.433544  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63513.6us
W20260709 12:13:50.434607  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64799.5us
I20260709 12:13:50.363632 10898 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:50.440053  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.428067 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.019s	sys 0.030s
W20260709 12:13:50.456187  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.357370 11007 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:50.457412  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.368177 11002 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:50.470770 11007 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.474277  9623 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.441159 10939 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:50.361894 10980 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.501778 10441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.006s	sys 0.012s
W20260709 12:13:50.502324 10441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.006s	sys 0.012s
I20260709 12:13:50.466207 11005 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.347823 11003 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.506199  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.493347 10982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.002s	sys 0.015s
W20260709 12:13:50.507011 10982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.002s	sys 0.015s
I20260709 12:13:50.366086 10947 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.366755 11008 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.546715  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.524744 10966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.024s	sys 0.009s
I20260709 12:13:50.492408 10639 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:13:50.570125  8994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.023s
W20260709 12:13:50.562026 10966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.024s	sys 0.010s
I20260709 12:13:50.538390 10939 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:50.610594  8994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.000s	sys 0.032s
I20260709 12:13:50.541582 10597 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.548126 10925 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:50.562655 10942 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:50.562956 11024 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:50.546859 10898 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:13:50.506554 10900 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.565887 10982 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:50.616487 11017 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 12:13:50.612449 11002 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:50.643473  8923 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:50.640828 10710 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.002s
W20260709 12:13:50.641072 10986 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.014s	user 0.009s	sys 0.004s
I20260709 12:13:50.636701 10943 raft_consensus.cc:2764] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:13:50.636605 10982 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:50.623651 10597 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.620932 10939 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.676575  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 323508us
I20260709 12:13:50.677322  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:50.666805 10982 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.679303 11016 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:13:50.682601 11018 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 12:13:50.665704 10710 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:50.681900  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 179710us
W20260709 12:13:50.705595  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.706158  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.704820 10980 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:50.703320  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.668030 10986 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:50.713387  8922 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:50.704500 10949 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
W20260709 12:13:50.710990 11023 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:13:50.723783  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.707068 11024 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:13:50.716697 11019 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:13:50.728937  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 564860us
W20260709 12:13:50.720443 11004 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:13:50.735021  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:50.740754  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.764194  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.765653  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:50.721853 10980 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.784569  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:50.774415  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 342061us
W20260709 12:13:50.788638  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.788700  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:50.784751 11013 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.749935 10919 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:50.773300  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 93378.4us
I20260709 12:13:50.775072  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:50.776289 11031 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:13:50.777100 11033 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:50.720944 10953 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:50.803352  8888 leader_election.cc:400] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:13:50.804831  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:50.805392  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:50.804266  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.791115  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:50.808526  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:50.720183 10949 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.784902 10984 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.836046  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:50.785281 11015 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.837824  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:50.785542 11032 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:13:50.780854 10910 consensus_meta.cc:287] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.002s
W20260709 12:13:50.835347 10994 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:13:50.838951  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.792040 10880 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.914s	user 0.009s	sys 0.004s
I20260709 12:13:50.840785  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:50.787662 10952 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.003s
I20260709 12:13:50.843600  8920 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:13:50.844432  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.836099  8924 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5.
I20260709 12:13:50.784168 10939 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:50.960968  8916 raft_consensus.cc:2410] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:50.962200  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:50.834954  9623 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
W20260709 12:13:50.784847 11020 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:50.834508 10962 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:50.845536  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:50.888952 10999 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.764s	user 0.000s	sys 0.013s
I20260709 12:13:50.895675 10597 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:50.897181 11025 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:13:50.897444 10910 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.840281 11015 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:50.807626 10637 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.885915 11038 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:50.837845 11013 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.840386 10840 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.928755  8925 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:50.895473 11022 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:13:50.929620  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 86729.9us
I20260709 12:13:50.930461  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2271) took 1184 ms. Trace:
I20260709 12:13:50.886634 11047 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.809111 11008 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:50.932548  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.013021 10984 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:51.018643 10984 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:50.939880  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.019265  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:51.019721  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.945559 10946 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.978s	user 0.012s	sys 0.000s
I20260709 12:13:51.020783 10984 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:51.020577 10946 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.780433 11003 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:50.780493 11024 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:50.803376 10980 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:50.964448  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:50.965060  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.036139  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.970781  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2272) took 1224 ms. Trace:
I20260709 12:13:50.972863  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:50.974768  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 134013us
I20260709 12:13:50.995597  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:50.996222 11015 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:50.998530 10680 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.880s	user 0.006s	sys 0.009s
I20260709 12:13:50.961458 11002 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.973038 10939 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.018877  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:50.947618 10986 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:50.939888 11040 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:51.022598 10441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.097s	sys 0.066s
W20260709 12:13:51.052426 10441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.097s	sys 0.066s
I20260709 12:13:51.021580 11047 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.023864 11045 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:51.024580 10642 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.895s	user 0.013s	sys 0.002s
I20260709 12:13:51.063632 10642 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.064919  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:51.065302  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:51.065656  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.066149  8998 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:51.066275  8992 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.016733 10979 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.025288  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2278) took 1270 ms. Trace:
I20260709 12:13:51.025851 11054 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:13:51.002771 11056 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:51.029364 11013 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.984858 10962 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:51.038496  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:51.014411 10919 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.013655 10710 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.005347 10910 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.043188 11024 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.042990  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.012825 11030 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:51.036803  8993 rpcz_store.cc:276] 0709 12:13:49.746327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.749812 (+  3485us) service_pool.cc:224] Handling call
0709 12:13:49.750207 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.750480 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.750517 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.751067 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.428623 (+677556us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:50.481434 (+ 52811us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.730150 (+248716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.730259 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.970528 (+240269us) raft_consensus.cc:1685] finished
0709 12:13:50.970556 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.970710 (+   154us) inbound_call.cc:177] Queueing success response
0709 12:13:50.994606 (+ 23896us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800281ce0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e522 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
Metrics: {"prepare.queue_time_us":55219,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":8723,"raft.queue_time_us":23883,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7917,"spinlock_wait_cycles":6971264,"thread_start_us":859249,"threads_started":2,"wal-append.queue_time_us":843877}
I20260709 12:13:51.013922  8995 rpcz_store.cc:276] 0709 12:13:49.745947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.747958 (+  2011us) service_pool.cc:224] Handling call
0709 12:13:49.748383 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:49.748858 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.748898 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:49.757416 (+  8518us) log.cc:844] Serialized 52 byte log entry
0709 12:13:50.204041 (+446625us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:50.204085 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.204162 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.873547 (+669385us) raft_consensus.cc:1685] finished
0709 12:13:50.873574 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.930398 (+ 56824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063,"raft.queue_time_us":6101,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":19618,"thread_start_us":381251,"threads_started":1,"wal-append.queue_time_us":655436}
I20260709 12:13:51.047894  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:51.048645  8925 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:51.050017  8999 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:50.960441 10952 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.044693 10980 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:51.068761  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.067093  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.015056 11038 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.174397  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1105) took 1357 ms. Trace:
I20260709 12:13:51.614665 11047 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.615097  8922 rpcz_store.cc:276] 0709 12:13:49.816752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.816917 (+   165us) service_pool.cc:224] Handling call
0709 12:13:49.817258 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.714680 (+897422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.174034 (+459354us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54000c9c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:51.174306 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060487040}
I20260709 12:13:51.615801 10919 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.616361 11038 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:51.616698  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:51.617316 11056 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:51.617574  8922 raft_consensus.cc:1803] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: voting while tombstoned based on last-logged opid 2.4
I20260709 12:13:51.617765 10986 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:51.067791 11045 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.619344 10979 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:51.619683  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.620606  8995 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:51.620443 10979 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.471597 10946 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:51.621587  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:51.047080 11002 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.621520  8994 rpcz_store.cc:276] 0709 12:13:49.755482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.929034 (+173552us) service_pool.cc:224] Handling call
0709 12:13:49.929364 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.965689 (+ 36325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.965744 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.975423 (+  9679us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.613778 (+638355us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:50.613834 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.613914 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:51.025081 (+411167us) raft_consensus.cc:1685] finished
0709 12:13:51.025101 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.025234 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26596,"raft.queue_time_us":26976,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":14553,"thread_start_us":565424,"threads_started":1,"wal-append.queue_time_us":682887}
W20260709 12:13:51.093220 11005 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.004s
W20260709 12:13:51.464941 11011 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.432s	user 0.003s	sys 0.000s
I20260709 12:13:51.379792  9623 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.343659 10657 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:51.624666  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:51.625361  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:51.625556 10900 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.626618 10952 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.063687 11053 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:51.153294  8992 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:13:51.627483  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.627882  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:51.623908 10962 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.629226  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:51.700369  9624 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:13:51.629551 11024 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.630373 10898 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:51.066293  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:51.614348 10441 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.706158 10441 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:51.614060  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2280) took 1853 ms. Trace:
I20260709 12:13:51.617954 10919 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.087524  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:51.089993 10949 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:51.207584  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.094924  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2281) took 1331 ms. Trace:
W20260709 12:13:51.098515  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.622327  8997 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:51.620899 11045 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.618357 11056 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.618187  8922 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
W20260709 12:13:51.344476 10991 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.198s	user 0.009s	sys 0.004s
I20260709 12:13:51.631211  8925 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.623322  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:51.631294  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:51.759474  8999 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:51.596704 10854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.005s	sys 0.013s
W20260709 12:13:51.760190  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 128999us
I20260709 12:13:51.758764  8991 rpcz_store.cc:276] 0709 12:13:49.763573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.936811 (+173238us) service_pool.cc:224] Handling call
0709 12:13:50.277363 (+340552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.320143 (+ 42780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.094665 (+774522us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400196750. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:51.094848 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779292032}
I20260709 12:13:51.633859  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:51.623603  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:51.763186  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:51.631251  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:51.190593 10942 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.765033  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.657470  8994 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:51.639132  8998 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.153256 11041 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:51.637316  9071 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.655313  8995 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
W20260709 12:13:51.638803  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.771987  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.772397  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.476357 10982 consensus_meta.cc:287] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
I20260709 12:13:51.773644  9618 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.773910 10982 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.637830 11030 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:51.611752 11057 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.006s
W20260709 12:13:51.661753  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 623290us
I20260709 12:13:51.050379 10939 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.474382  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.047154 10680 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.663165  9622 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.088019  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.663594  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.084386 11052 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.176162 10989 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.668856  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:51.671026  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.706238 11053 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.701879  8993 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.676433  8992 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:51.676667  8923 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.708206  8916 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:51.662663 11005 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.707264 10441 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.707865  9000 rpcz_store.cc:276] 0709 12:13:49.760298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.933001 (+172703us) service_pool.cc:224] Handling call
0709 12:13:49.933337 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.137510 (+204173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.137562 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.137631 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:50.137682 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.083587 (+945905us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003dcf54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:51.613770 (+530183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.613986 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468830592}
I20260709 12:13:51.755945  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.719609  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:51.757931  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.758543  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.760411 10854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.790s	user 0.005s	sys 0.013s
I20260709 12:13:51.635043  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:51.675395 11038 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.762251  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.762533  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:51.654465  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 403614us
I20260709 12:13:51.663822 11013 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:51.707717 10908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.022s	sys 0.014s
I20260709 12:13:51.699990  9617 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:51.763453 11026 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.776564  9068 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:51.758437 11015 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 12:13:51.755455 10886 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.711185 10980 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:51.786779  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:51.704475 11040 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:52.096719 10979 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.097049 11040 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.099380 11037 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.709997 10642 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:51.675148 10657 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:51.937572 11018 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:51.786346 11047 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.028234 11064 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 12:13:51.711756 11024 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.711513 10898 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:51.704725 10986 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:13:51.765591  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:51.766908 10991 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.811544  9072 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.128436  8994 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.127368  8998 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:13:52.129037  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 375) took 1068 ms. Trace:
I20260709 12:13:52.125411  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:51.777683 10810 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.788996 11061 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:51.786227 11057 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.002s	sys 0.009s
I20260709 12:13:51.770928 10942 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:51.513723 11009 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:51.821357  8924 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
W20260709 12:13:51.805946 10992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.848s	user 0.058s	sys 0.063s
I20260709 12:13:51.786783 11065 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:51.855007  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:51.855931  9073 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:13:51.856518  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.151598  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.152097  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.857851  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.115871 11040 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:51.782814 10919 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:51.789425 11046 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:51.823813  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:52.172044  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 348285us
I20260709 12:13:51.863718  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:52.086951  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.042830  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.005543  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.174219  8923 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5.
I20260709 12:13:52.175086  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.175922  8922 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:52.176899  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.818859  8996 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.075536  8993 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:51.942860  9622 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:52.090417  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.179610  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 372) took 1120 ms. Trace:
I20260709 12:13:52.179952  8993 rpcz_store.cc:276] 0709 12:13:51.059524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.627272 (+567748us) service_pool.cc:224] Handling call
0709 12:13:52.179558 (+552286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:52.180506  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.181161  9070 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:52.114357 11047 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.182175  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:52.002391  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:52.093585  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 306866us
I20260709 12:13:51.938280  8921 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:52.095824 10980 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.812858 11052 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:52.196074  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.790197  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.863749 11054 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:52.093148 10908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.025s	sys 0.014s
I20260709 12:13:51.863417  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:51.960242 10639 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.028815 10939 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.031715 11043 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.120093  8995 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:52.121245  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:52.168883 10986 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.158830  9618 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:52.005745 10885 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.124315  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:51.943908 10949 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:52.214534 10949 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.217412 10949 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.039804 11053 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.021011 11030 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:51.960426 11027 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.219395 11027 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.220778 11010 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.221259 11010 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:52.222100 11027 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:52.037801  8919 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:52.129408  8998 rpcz_store.cc:276] 0709 12:13:51.060350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.066823 (+  6473us) service_pool.cc:224] Handling call
0709 12:13:52.128981 (+1062158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:52.130620  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:52.222980  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1928) took 1190 ms (client timeout 1527 ms). Trace:
W20260709 12:13:52.223678  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 93161.5us
I20260709 12:13:52.039846 10982 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:52.226056 10982 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:52.023945 10680 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.114705 10858 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:52.227260 10810 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.227774 10810 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:52.227555 10858 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.228255 10810 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.854743 10989 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:51.985472 11038 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.101775 10886 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:52.231228  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 266) took 1265 ms (client timeout 1612 ms). Trace:
W20260709 12:13:52.231757  8924 rpcz_store.cc:269] 0709 12:13:50.965681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.972495 (+  6814us) service_pool.cc:224] Handling call
0709 12:13:52.231056 (+1258561us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400019354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:52.231167 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800993024}
I20260709 12:13:52.159188  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:51.784818 11041 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.232811 10886 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.232972  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.233970  8924 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:52.101965 11015 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.235548  8920 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:52.235867  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1106) took 2382 ms. Trace:
I20260709 12:13:52.236310  8921 rpcz_store.cc:276] 0709 12:13:49.853232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.853403 (+   171us) service_pool.cc:224] Handling call
0709 12:13:49.856408 (+  3005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.183693 (+2327285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.235592 (+ 51899us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400311d54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:52.235781 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4618535296}
I20260709 12:13:52.236868  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 265) took 1273 ms. Trace:
I20260709 12:13:52.237016 11015 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.237635  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.237406  8920 rpcz_store.cc:276] 0709 12:13:50.963215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.964227 (+  1012us) service_pool.cc:224] Handling call
0709 12:13:52.236694 (+1272467us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400244d54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:52.236807 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759720192}
W20260709 12:13:52.147796 10992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.191s	user 0.058s	sys 0.064s
I20260709 12:13:52.238348  8921 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:52.144284 11045 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.239526 11045 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.232882 11038 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.242096 11045 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.243733  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.245307  8920 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:52.246068  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1111) took 1154 ms. Trace:
I20260709 12:13:52.246439  8920 rpcz_store.cc:276] 0709 12:13:51.092063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.244581 (+1152518us) service_pool.cc:224] Handling call
0709 12:13:52.244921 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.245762 (+   841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.246003 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:52.247502  9065 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.251220  9619 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:52.133136 10642 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.184015  8994 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:13:52.184613  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.185266  8916 raft_consensus.cc:2410] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:52.257761  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1112) took 1165 ms. Trace:
I20260709 12:13:52.187983  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.199723  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.258982  8923 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:52.258358 10810 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.261421  8923 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:52.262004 10441 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.262766  8923 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.258770  8922 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:52.167048  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.266686  9071 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.268447  9071 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:52.038513 10910 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.200901  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:52.223551  8919 rpcz_store.cc:269] 0709 12:13:51.033042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.042704 (+  9662us) service_pool.cc:224] Handling call
0709 12:13:52.222906 (+1180202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:52.273677  8919 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 4. Ops: []
I20260709 12:13:52.275085 10810 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.232707 10989 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.234922 11041 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.258190  8916 rpcz_store.cc:276] 0709 12:13:51.092395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.256725 (+1164330us) service_pool.cc:224] Handling call
0709 12:13:52.257113 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.257324 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.257364 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.257421 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.257503 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.257576 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.257696 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:52.275288  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.230170 10858 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.270253  8822 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 329) took 8510 ms. Trace:
I20260709 12:13:52.275151  8919 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.279515  8822 rpcz_store.cc:276] 0709 12:13:43.760061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.760242 (+   181us) service_pool.cc:224] Handling call
0709 12:13:52.270187 (+8509945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:50.005264 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:50.006020 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:50.006070 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:13:50.006096 (+    26us) tablet.cc:662] Decoding operations
0709 12:13:50.006936 (+   840us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:50.007044 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:50.007084 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:50.007962 (+   878us) tablet.cc:701] Row locks acquired
0709 12:13:50.007984 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:13:50.008209 (+   225us) write_op.cc:270] Start()
0709 12:13:50.008353 (+   144us) write_op.cc:276] Timestamp: P: 1783599230008140 usec, L: 0
0709 12:13:50.008378 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:13:50.009237 (+   859us) log.cc:844] Serialized 2059 byte log entry
0709 12:13:51.087483 (+1078246us) op_driver.cc:464] REPLICATION: finished
0709 12:13:51.774261 (+686778us) write_op.cc:301] APPLY: starting
0709 12:13:51.774345 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:51.774507 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:51.774627 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:51.775417 (+   790us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:51.775621 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:13:51.775666 (+    45us) write_op.cc:312] APPLY: finished
0709 12:13:51.775898 (+   232us) log.cc:844] Serialized 47 byte log entry
0709 12:13:51.776054 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:51.776157 (+   103us) write_op.cc:454] Released schema lock
0709 12:13:51.776200 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:52.150611 (+374411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:52.152740 (+  2129us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1178262,"reported_tablets":9,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":686524,"apply.run_cpu_time_us":2352,"apply.run_wall_time_us":14172,"num_ops":5,"prepare.queue_time_us":236750,"prepare.run_cpu_time_us":21825,"prepare.run_wall_time_us":193003,"raft.queue_time_us":317664,"raft.run_cpu_time_us":12478,"raft.run_wall_time_us":1080659,"replication_time_us":1078966,"thread_start_us":1512560,"threads_started":4,"wal-append.queue_time_us":264266}]]}
I20260709 12:13:52.298892  8916 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:52.153918 11065 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:52.314811  9590 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.612s (SENT) [suppressed 51 similar messages]
W20260709 12:13:52.361708  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46941.6us
I20260709 12:13:52.234843  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:52.186084 11040 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:13:52.317134  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 110457us
I20260709 12:13:52.199911 11054 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:52.152577 11009 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.180689 10919 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.316382 10939 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.378196 10939 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:52.379694 11070 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:13:52.380609 10939 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.381225 10939 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.381693 10939 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:52.344209  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.384095  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 374) took 1324 ms. Trace:
I20260709 12:13:52.384495  8999 rpcz_store.cc:276] 0709 12:13:51.060106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.768404 (+708298us) service_pool.cc:224] Handling call
0709 12:13:51.768624 (+   220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.769001 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.769020 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.785865 (+ 16845us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.144971 (+359106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.351078 (+206107us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.383781 (+ 32703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.383853 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.383896 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:52.383910 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.384038 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45258,"prepare.queue_time_us":21401,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1353,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"thread_start_us":269690,"threads_started":2,"wal-append.queue_time_us":382948}
W20260709 12:13:52.388226  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.388597  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 373) took 1328 ms. Trace:
I20260709 12:13:52.388994  8997 rpcz_store.cc:276] 0709 12:13:51.059820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.764344 (+704524us) service_pool.cc:224] Handling call
0709 12:13:51.764600 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.007331 (+242731us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:52.129954 (+122623us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.386745 (+256791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.386791 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.386836 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.388350 (+  1514us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54002364d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:52.388401 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.388537 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29116,"prepare.queue_time_us":157374,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"spinlock_wait_cycles":557494144,"thread_start_us":348289,"threads_started":2}
I20260709 12:13:52.349781  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:52.310110 10908 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.147996 11061 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.391191 10908 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.393134 11061 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:52.357086  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.306824  8919 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.398056 11026 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:52.362097  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 177657us
I20260709 12:13:52.341049 11053 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.372000  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60373.9us
I20260709 12:13:52.330026 11028 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:52.318552 10986 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.185745 11046 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.376062 10980 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.377189 11002 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.377686 11081 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.512491 11081 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.413466 11010 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.515010 11010 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.413551 10657 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:52.414433  9073 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
W20260709 12:13:52.356698 10900 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 12:13:52.416553  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:52.518015 10925 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.316576 11043 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.301903  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.457020  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:52.356186 10989 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.488245  8925 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:52.507875 11053 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.508116 11028 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.511404 10986 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:52.518718 10925 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.309988 10639 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.328810 11015 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 12:13:52.366719 11040 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:52.319984 10885 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.367918 10854 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.170s
I20260709 12:13:52.353749 11052 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.329391 10942 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.644500  8923 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:52.557133  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 263492us
W20260709 12:13:52.663631  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.744390  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 287460us
W20260709 12:13:52.759421  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.758630  9073 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:52.760059  9037 leader_election.cc:400] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4.
I20260709 12:13:52.737226  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:52.732553  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 316077us
W20260709 12:13:52.762104  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 394821us
I20260709 12:13:52.763298  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:52.764950  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 309505us
I20260709 12:13:52.765993  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:52.671854  9072 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 12:13:52.767231  9072 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:52.767982  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2422) took 1105 ms. Trace:
I20260709 12:13:52.768270  9065 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:52.768332  9072 rpcz_store.cc:276] 0709 12:13:51.662804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.663343 (+   539us) service_pool.cc:224] Handling call
0709 12:13:52.767927 (+1104584us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:52.771474  9000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.008s
W20260709 12:13:52.771946  9000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.003s	sys 0.008s
W20260709 12:13:52.775352  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 425630us
I20260709 12:13:52.785745  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:52.787300 10441 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.787809 10441 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.788146 10441 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.789165  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:52.793641  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.793787 10441 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.533241 10900 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:13:52.683745  8917 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.001s
I20260709 12:13:52.611364 10657 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:52.797186  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:52.749254 11024 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.810427  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:52.798723  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.009s	sys 0.004s
W20260709 12:13:52.542196 11078 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:13:52.802469 10441 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.610831  8918 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:52.802660  8964 leader_election.cc:336] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.614s (SENT)
I20260709 12:13:52.802639  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.818984  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.796780 11052 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.741740 11026 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:52.749637 10908 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.741779 11044 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:52.805809  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:52.955551  9073 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:52.773205 11040 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:52.956086 11068 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:52.685014 11009 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:52.677524 11085 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:52.686250 11043 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.591183 10898 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:52.808458  8922 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.610639 11054 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.969213 11054 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.949149 11026 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.971529 11026 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:52.972107 10885 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:52.950750 11015 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:13:52.814229  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.009s	sys 0.005s
I20260709 12:13:52.814966  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:52.815693  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:52.817148  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:52.799650 11027 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:13:52.819985 11082 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:52.880156  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77516.9us
W20260709 12:13:52.982839  8964 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.968s (SENT)
I20260709 12:13:52.983444  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:52.806365  8917 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:52.796406 11005 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:52.819305 10952 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:52.805073 10992 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.804843 10900 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.806846 10657 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:52.541426 10989 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:52.561070 10991 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.248s
W20260709 12:13:52.813977  8996 consensus_meta.cc:287] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.001s
W20260709 12:13:52.925863  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 135232us
I20260709 12:13:52.893837 10639 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.010057  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:53.004866 10939 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:52.928236  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 121910us
I20260709 12:13:52.803754  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:52.800154 10942 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:52.929383  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 119879us
I20260709 12:13:52.798617  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2423) took 1135 ms. Trace:
I20260709 12:13:52.953717 11041 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:52.954829 11065 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:53.037680  9066 rpcz_store.cc:276] 0709 12:13:51.663051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.091458 (+428407us) service_pool.cc:224] Handling call
0709 12:13:52.091733 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.091939 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:52.148873 (+ 56934us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.798288 (+649415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.798343 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:52.798393 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.798458 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.798565 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47628,"prepare.queue_time_us":186638,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":35914,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":81699,"thread_start_us":685456,"threads_started":3,"wal-append.queue_time_us":392807}
I20260709 12:13:53.039850  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.040093 10991 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:53.040539  9065 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:53.007925 10952 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:52.948179  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:53.042470  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 105808us
I20260709 12:13:52.948474 10982 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:52.974557  8999 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.947479 11087 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:52.974689  8916 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:13:52.975036  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 821144us
I20260709 12:13:52.949592 11080 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.964491 11044 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.956668 11068 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:52.941109 10986 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:13:53.058207  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:52.967356 11038 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:13:52.973376 11085 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.000442 11015 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:53.050419 11080 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.063269 11015 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:53.063571 11080 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.064633 11015 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.066565 11015 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:53.002977  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 186682us
I20260709 12:13:53.048816 11087 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:53.047464 10982 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:52.981961 11082 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:53.077217 10952 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.007491 10657 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.010774  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:13:53.079607  8996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2287) took 2028 ms (client timeout 1626 ms). Trace:
W20260709 12:13:53.079993  8996 rpcz_store.cc:269] 0709 12:13:51.051004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.052472 (+  1468us) service_pool.cc:224] Handling call
0709 12:13:53.079493 (+2027021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.024195 10989 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:53.006752  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1917) took 2200 ms (client timeout 2018 ms). Trace:
I20260709 12:13:53.025889 10881 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.029289 11040 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.007290 11092 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:53.021462  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 217808us
I20260709 12:13:53.098045  8920 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:53.015268  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2425) took 1338 ms. Trace:
I20260709 12:13:53.035691  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 341) took 1370 ms. Trace:
I20260709 12:13:53.041451  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.099049 11040 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.099701 11040 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:53.100023  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.101115  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.101769  8923 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:53.101699 11068 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.087626 10900 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.102579  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.103071 10881 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:53.036703  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:53.103575 10881 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.103905  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:53.104271  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67654.2us
I20260709 12:13:53.098629  9074 rpcz_store.cc:276] 0709 12:13:51.677325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.194242 (+516917us) service_pool.cc:224] Handling call
0709 12:13:52.201807 (+  7565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.201959 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:13:52.732454 (+530495us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.014679 (+282225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.014749 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:13:53.014812 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.014899 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.015158 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49257,"prepare.queue_time_us":76882,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":85,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":923,"thread_start_us":395539,"threads_started":2,"wal-append.queue_time_us":338867}
I20260709 12:13:53.039736 10898 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.105262  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.049577  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:53.050892  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:53.106925  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56065.6us
I20260709 12:13:53.107041 11092 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.107599 11092 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.107992 11092 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:53.108913  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.056731  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.069159  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.110248  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.111326  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:53.112239  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.112440 10925 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:53.005185  8964 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.074s (SENT)
I20260709 12:13:53.112766  8916 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:53.080920 10982 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:53.113201  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 108049us
I20260709 12:13:53.113575  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:53.114039  8964 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.516s (SENT)
I20260709 12:13:53.114198  8916 raft_consensus.cc:2376] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4. Re-sending same reply.
W20260709 12:13:53.114629  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.115062  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.115799  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.115485 11098 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:53.116175  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.048846 11041 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.118952 11041 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:53.009001 10992 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:13:53.119424 11041 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.078192 11027 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:13:53.098719  9067 rpcz_store.cc:276] 0709 12:13:51.665396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.325663 (+660267us) service_pool.cc:224] Handling call
0709 12:13:52.326064 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.330806 (+  4742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.330831 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.342874 (+ 12043us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.764627 (+421753us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:52.764692 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.764782 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.035459 (+270677us) raft_consensus.cc:1685] finished
0709 12:13:53.035479 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.035621 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":333446,"threads_started":1,"wal-append.queue_time_us":437332}
I20260709 12:13:53.085457  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.086270  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.131965  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.083418 11026 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:53.085346  8917 rpcz_store.cc:269] 0709 12:13:50.806064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.806903 (+   839us) service_pool.cc:224] Handling call
0709 12:13:51.474122 (+667219us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:13:53.005150 (+1531028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16565120}
I20260709 12:13:53.090703 10919 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.096977 11085 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.104650  9618 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:53.105345 10898 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.140996 10898 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.011823 11013 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.143513 11013 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:53.137997  9623 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.147485  9621 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:13:53.049209 11037 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:13:53.074548  8999 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:13:53.067910 11087 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.122100  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.115033  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:53.124264  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 74772.8us
W20260709 12:13:53.152556  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.125908  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:53.132177  8924 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:13:53.154577  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.155596  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.088642  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:53.132615  9624 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:53.156352  8925 raft_consensus.cc:2376] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3. Re-sending same reply.
I20260709 12:13:53.132422  9066 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:53.134908  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.112967 10925 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.160338  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.135416 11091 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:53.137883  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.138136 10992 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:53.140272  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.155725  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.119942 11088 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:13:53.162380  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.131673 11009 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:53.158245  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:53.160202 11097 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:53.163256  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:53.172256  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.144567 11013 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:53.158042  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.205619  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.297632  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.246569  8921 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:53.318059  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.297154  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.296223  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.145551 11065 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.409364  8997 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:53.179880  9621 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
W20260709 12:13:53.213667  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.184876  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.300601  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.443900  8996 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.300817  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.446277  8999 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:53.296665  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.316247  8924 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:53.295689  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:53.320463  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.296101  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.289548  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:53.260087  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.447147  9624 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:53.463680  9000 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:53.208921  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.305987  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.465262  8995 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:53.461494  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 323865us
I20260709 12:13:53.200304  9623 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:53.431591  8966 leader_election.cc:336] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.614s (SENT)
I20260709 12:13:53.467880  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.301585  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.164938 11037 consensus_queue.cc:1243] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:53.451853  8994 raft_consensus.cc:2376] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7. Re-sending same reply.
I20260709 12:13:53.465442  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.478974  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:53.452759  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:53.480264  9621 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:53.468166  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.413110  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:53.482374  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50804.7us
W20260709 12:13:53.483300  8966 leader_election.cc:336] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.661s (SENT)
I20260709 12:13:53.483757  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.264338  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.474558  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:53.466698  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.462508  8919 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:13:53.485141  8966 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.673s (SENT)
W20260709 12:13:53.494081  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 335938us
W20260709 12:13:53.494648  8966 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.854s (SENT)
I20260709 12:13:53.408198 11040 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.180902  9618 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:53.138383  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.300915 11044 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.242060 10657 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.495757  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.556118  9066 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:53.223982 11087 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.496644  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.409981 11068 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.279131 11053 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.322393 11076 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:53.445366  8998 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:53.498728  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:53.498855  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:53.292053 11002 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.240288  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.256008 11026 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.204913 11091 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:53.270025 10989 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:53.451288 11065 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.499439  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:53.504083  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.569602  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.289829 10982 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.488761  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.513187  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.493362  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.549778 11106 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.491163 11013 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.445329 11097 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.297673 10881 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.527117  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.631166  9623 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:53.525384  9619 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:53.498219 11088 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.472011 10710 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.500155 11037 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:53.490873 10854 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:13:53.510556 11040 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.525941 11028 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.489961 10939 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.499944 11027 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.538246 10980 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:53.549665 11052 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.007s
W20260709 12:13:53.563823  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 65108.5us
I20260709 12:13:53.568534  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:53.656363  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.571677  8916 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:53.553182  8918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1942) took 1917 ms (client timeout 1661 ms). Trace:
I20260709 12:13:53.214598 11080 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.572847  8924 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:13:53.574133  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.579805  9621 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
W20260709 12:13:53.604876  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.674047  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.676901  8994 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:13:53.678526  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 167649us
W20260709 12:13:53.679114  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.679683  8923 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:53.566280 10898 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.683502  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:53.686486  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 273446us
I20260709 12:13:53.568418 11076 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.571477 10989 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.565364 11002 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:53.691192  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.691931  8998 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:53.570528 11065 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.570528 11015 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.641032  9074 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:53.570242  9620 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:53.700629  9624 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.659744  8916 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:53.575610 11106 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:53.703119 11106 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.700670 11015 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.705169 11015 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.565502 11068 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.709308  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.668150 11027 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.698433 11052 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.718025  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.719331 10898 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.663172 11088 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 12:13:53.720536 11104 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:53.723896  9066 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 4. Ops: []
I20260709 12:13:53.687547  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:53.684376  8925 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:53.572535 11041 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.638219  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:53.645056 10710 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.695273  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:53.632225  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128987us
I20260709 12:13:53.648995 10980 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:53.701681  9622 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:53.698191 11109 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.687495 11046 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.217782 10925 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:53.758842  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:13:53.796710  9067 raft_consensus.cc:606] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:53.797088  9067 raft_consensus.cc:614] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:53.760444  8924 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:53.691180  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.713629 11052 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:53.813251 11107 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:13:53.722936 11088 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.828086 10919 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.832882 10919 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:53.833761 10919 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.835318 11088 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:53.759485 11037 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:53.787022 10980 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:53.842343  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 140465us
I20260709 12:13:53.759570 11111 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.845278  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:53.843396  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 348772us
W20260709 12:13:53.844636  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.845182  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 157701us
W20260709 12:13:53.847203  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.848882  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.849573  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.850217  9069 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:53.850517  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:53.851153  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:53.851752  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.852044  9072 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:53.851059  9074 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:53.667135  8918 rpcz_store.cc:269] 0709 12:13:51.634718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.798434 (+163716us) service_pool.cc:224] Handling call
0709 12:13:53.527647 (+1729213us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000ca3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:53.551900 (+ 24253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370244480}
I20260709 12:13:53.848641  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:53.851065  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:53.853981  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.862393  9067 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:53.853259  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:53.863719  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.865643  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.866545  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.867165  9073 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:53.837206 11080 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.869041  8993 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:13:53.869338  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.873114  8992 raft_consensus.cc:2410] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:53.869604  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.873806  9000 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:53.870148  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.874814  8994 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:53.870471  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.871472  9068 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:13:53.871620  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.866786  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:53.876063  9070 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 1.
I20260709 12:13:53.876617  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.877004  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.877044  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.877673  8995 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.877211  8994 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.878134  9000 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.880586  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.884197  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.885283  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.885823  8992 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:53.886325  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.887297  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.888501  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.904330 10441 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.904726 10441 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:53.905062 10441 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.906032  8992 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:53.889117  8994 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:53.889765  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.908028  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:53.908275  9000 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:53.842535 10919 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.890905  8999 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:53.890833  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.890833  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:53.910475  8991 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:53.896950  8995 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:53.900004  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:53.911742  8993 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:53.913813  8997 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:53.850449 11111 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:53.927870 10441 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:53.928956  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 80755.2us
I20260709 12:13:53.947451 11047 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.915333  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:53.949312 11113 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:53.949754 11113 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:53.950125 11113 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.950702  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.882431 10858 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:53.930128  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.952023 11068 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.853430 10900 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:53.953224 10657 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:53.953311 10900 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.955955 10900 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.902719 10989 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.932104 11081 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.850025 11037 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.896108 11028 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:13:53.896443 10992 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:53.945379  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.946321  8992 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:13:53.951218  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.930374 10881 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.956863  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1121) took 1845 ms. Trace:
I20260709 12:13:53.981922  8920 rpcz_store.cc:276] 0709 12:13:52.111178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.309019 (+197841us) service_pool.cc:224] Handling call
0709 12:13:52.309348 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.098434 (+789086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.956632 (+858198us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540015a254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:53.956809 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813408000}
I20260709 12:13:53.786871 11091 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.837127 11088 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:53.941110  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:53.959594  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.871693 11044 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.807569 11002 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:53.935563 10979 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.962337  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.962860  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:53.999853  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.000941  9072 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:54.001269  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:53.966967  9074 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:53.941438  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.001750  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.934252 11111 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.984215 10441 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.002853  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:53.942102 10982 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.956822 11076 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:53.985983  8996 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.005s
I20260709 12:13:54.020460  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.022506  9624 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:53.986135 11037 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.988533  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:53.991683 11052 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:53.994663 11097 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:53.996951  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.050254  9069 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:53.998502  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:53.999064  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.002326  9072 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:13:53.971868 11047 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.003703  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.003854  9067 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:54.056262  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.056807  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.004369  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.057881  9067 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:54.024266  8964 leader_election.cc:336] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.727s (SENT)
I20260709 12:13:54.058427  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.059018  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:54.005043  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 64021.9us
I20260709 12:13:54.026132  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.063144  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.026818 11005 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.030820  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:53.973348 10710 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.027909  9073 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:53.999727 11108 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.018824 11065 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.003525 11080 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:13:54.025023  8996 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:53.999938 10979 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.040714 10657 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:54.000190 11040 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.033674 11081 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.043620 11009 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:13:54.019502 10952 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.040738  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 1935) took 2407 ms. Trace:
I20260709 12:13:54.050637  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.089700  8922 rpcz_store.cc:276] 0709 12:13:51.632809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.264752 (+631943us) service_pool.cc:224] Handling call
0709 12:13:52.265094 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.968403 (+703309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.040488 (+1072085us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540020f8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:54.040671 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231966976}
I20260709 12:13:54.053794  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:53.995424 11041 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.026983 11002 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.999617 11044 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:54.061556  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.062189  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.093080  9072 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:54.062494  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.063650  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.093637  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.093701  9074 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:54.065907  9621 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:54.061988 11076 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:54.095844  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45284us
I20260709 12:13:54.096892  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.097594  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.005712 10919 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.078145 11108 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:54.103093  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:54.096100 11092 consensus_meta.cc:287] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.988s	user 0.018s	sys 0.004s
I20260709 12:13:54.067344  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.068786  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.069731  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.071890 11005 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:54.073925  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.106941  9073 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:54.075397 11103 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.075490  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.076192  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.137944  8999 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.076257  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.076501 11106 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.002758 10858 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:54.045298  9616 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:13:54.101022 11053 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.086778  8998 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:54.062294 10939 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:53.997577 10992 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.089092 10979 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.106302  9067 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:54.106063  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.108443  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.166611 11098 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:54.166723  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60724.2us
I20260709 12:13:54.112769  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 1955) took 1067 ms. Trace:
W20260709 12:13:54.167811 11087 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.608s	user 0.018s	sys 0.008s
I20260709 12:13:54.167972 11009 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.096628 11026 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:54.168591  9066 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 2. Current term is 4. Ops: []
I20260709 12:13:54.168668 11026 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.119383 11040 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.169222 11026 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.119771 10989 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.171401 10989 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.105374 11092 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.171798 10989 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.171880 11091 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:54.172370 11091 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.173422 11092 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.173177 11091 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.173992  8992 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.174420 11091 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.129029 11065 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.130154 11108 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.177801 11108 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.178323 11027 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.099803 11046 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.137439 11103 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.104575 11110 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.103350 11047 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.134929 11097 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.142846 11082 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.089094 11081 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:54.196055 11081 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.089300 10952 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:54.199369 10952 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.199431  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.096412 11044 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.152544  8999 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:13:54.160923  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 82942us
I20260709 12:13:54.167647  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.206135  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.206367  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.131613 11037 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.208719  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.105080 11076 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:13:54.115958  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.211026  9067 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:54.211397  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 108773us
I20260709 12:13:54.213241  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.214196  9068 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.214854  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.167409  8923 rpcz_store.cc:276] 0709 12:13:53.045365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.125667 (+ 80302us) service_pool.cc:224] Handling call
0709 12:13:54.112587 (+986920us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400313154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:54.112714 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209331072}
I20260709 12:13:54.181036  9623 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:54.215929  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 609) took 1094 ms. Trace:
I20260709 12:13:54.105561  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:54.219137  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.220158  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.220444  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.220715  9073 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:54.221277  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123787us
I20260709 12:13:54.182181  8992 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:13:54.166749  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58341.8us
I20260709 12:13:54.223043  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.186338 10858 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.227923  8993 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:54.228520 11010 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.229242  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.229794  8993 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.230185 11098 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.187485 11106 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.188305 10992 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.189309 11005 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.163177 11024 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.232590 11024 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:54.190142 11103 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.165596 11111 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.192530 11110 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.197417  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.118974 10980 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.246075  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.216288  9622 rpcz_store.cc:276] 0709 12:13:53.121121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.121767 (+   646us) service_pool.cc:224] Handling call
0709 12:13:54.215754 (+1093987us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400771854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:54.215873 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264444160}
I20260709 12:13:54.217607  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.224576  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.225481  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.226819 10943 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.227274  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.227473 11097 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.219189 11037 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:54.196059 11082 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.249161  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.208809 11046 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:54.262589 10992 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.231335  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.256857 11052 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.263140 11024 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.263756  8921 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.277851 11037 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.233681 11027 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:13:54.233224  8917 raft_consensus.cc:606] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.282269  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.257001  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:54.289280  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63848.7us
I20260709 12:13:54.261171 11106 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.328434  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.295840  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.264854 11076 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.296128  8993 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.297538  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.329968  8995 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:54.330643  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:54.298084  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70895.5us
I20260709 12:13:54.256726 11110 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.264160 10943 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:54.287953 11097 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.337683  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.286685  9618 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:54.322641  9073 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.338812  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:54.339346  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.323189  8994 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:54.326319  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:54.326545  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49281.4us
I20260709 12:13:54.287729 10992 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.327808  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.331913  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.335107  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.353459  8924 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.335474  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:54.336151 11015 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.630s	user 0.004s	sys 0.022s
I20260709 12:13:54.335064  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.320024  8917 raft_consensus.cc:614] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:54.355542  8991 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:54.287405 11028 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:13:54.358359  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.354846  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.361485  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.363760  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.368472  8994 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:54.364560  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:54.369406  9069 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.365671  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.370406  8993 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.371562  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.373699  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.374193  9037 leader_election.cc:400] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5.
I20260709 12:13:54.337656  9615 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.373406  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.328830 11106 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.376829  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.378527  8995 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.352224 11024 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.381880  8963 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:54.352028  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.351387 10980 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.357537 10992 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.392517  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.393222  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.393890  8991 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:54.395859  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.396984  8994 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:13:54.383673  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.337370 11098 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.385188  8993 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.338116 11097 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.386530  8995 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.315529 11052 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.357872 10943 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:54.392406  9072 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.378196 11087 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.350639 11065 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:13:54.382567 11106 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.378808 10657 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.404646  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.406056  8995 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:54.382036 11068 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.378957 11118 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:54.387373 11013 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:54.390213 11092 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.371419 11015 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.390885 10810 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.391072 10925 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.419528  8993 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:13:54.424446  8964 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.018s (SENT)
I20260709 12:13:54.427734  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.372211 11113 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.400164 11098 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.437348  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:54.402530 11097 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.402168 11009 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.400741  8996 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:54.430737  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.392498 10639 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:13:54.445736  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:54.454805  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.459940  9065 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:54.446403  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.381184 11116 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:13:54.383069 11100 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:54.408782 11087 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:54.450521  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.472548  8993 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.425209 11068 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.473585  9000 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:54.426576  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.431540 11092 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:54.446188 11118 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:54.480831  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.390244 11046 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.447587 11098 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.488306  8993 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.448207  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.460201 10639 consensus_queue.cc:1243] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:54.439181 11081 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.447139 11133 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.487121 11092 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.497406 11088 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.474989 11087 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.446313 10810 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.474412 11068 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.509814  8993 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:54.446450 10925 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.513543  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.464864 10982 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:13:54.524791  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 124713us
W20260709 12:13:54.536000  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 162345us
W20260709 12:13:54.542395  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.489322  9620 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.537758  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:13:54.549913  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.477949 10979 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.551270  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.505687  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.505558 11111 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.495095 10657 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:54.559738  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.506820 11013 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.548871 11047 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.582909  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:54.582935  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.592423  8995 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:54.584277  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:54.585801  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60260.5us
I20260709 12:13:54.586774 11138 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.487425 10943 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.596940  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.612717  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.613508  8998 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.579345 11040 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:54.611981  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 98575us
W20260709 12:13:54.621724  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.588362 11133 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.623984  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.598888 11100 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.578063 10881 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:54.595989 11138 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.608187 11122 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.585307 10858 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:54.627585 11040 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:54.652978 11130 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:13:54.653743 11132 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:54.653913 11134 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:54.655326 10810 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.608515 11047 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.656431 10992 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.655424 11013 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.666344 10952 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.668677  9615 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:54.669091 10952 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.663414 11113 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.663046 11081 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.651238 11135 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:54.672870 10989 consensus_meta.cc:287] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 12:13:54.673127 11135 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.673308 10989 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.673645 11135 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.627135 11133 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:54.675619 11133 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.665418 10979 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.660807 11100 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.662011 11015 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.685964 10989 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.685870 11100 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.670610 11134 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:54.692796 11138 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.693862 11138 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.694005 11047 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.622169 11118 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:54.688521 11026 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.004s
I20260709 12:13:54.670360 11037 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.696843 11134 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:54.704443 11091 consensus_meta.cc:287] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 12:13:54.698284 11110 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.708593 11135 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.712169 11110 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.718993 11133 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.566308  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:54.746922  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 180400us
I20260709 12:13:54.751322  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.752707  8999 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.752974  8922 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.754705  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.756644  8916 raft_consensus.cc:1217] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:13:54.757025  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.757360  8916 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:54.612720  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.760028  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.760584  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.759063  8925 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.636487 10657 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.764086  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.764333  8919 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:54.771910  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.772104  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 143098us
I20260709 12:13:54.764951  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.763207  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.778604 10979 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:13:54.779492 11076 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:54.808511 11076 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.809782  8923 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:54.777776  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.809013 10979 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.811910 10979 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:54.811957 10925 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.710256 11098 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.813027 11106 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.813429 10979 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.817338 11098 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:54.818948  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.669862 11040 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.824460  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:54.820055  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.826916  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.828325 11138 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:54.828728 10858 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:54.830065 11100 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:54.830430 11118 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.830751 11100 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.830960 11118 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:54.831828  8920 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:54.832472 11118 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.833024  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.832559 11100 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.776352 10992 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.777829  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:54.840415  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.841625 11133 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:54.842099 11082 consensus_meta.cc:287] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.001s
I20260709 12:13:54.843803  9071 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:54.847720 10979 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.848011  8918 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:54.848629  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1139) took 1294 ms. Trace:
I20260709 12:13:54.849246  8921 rpcz_store.cc:276] 0709 12:13:53.554039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.795745 (+241706us) service_pool.cc:224] Handling call
0709 12:13:53.797103 (+  1358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.304171 (+507068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.848090 (+543919us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400312c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:54.848402 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072732416}
W20260709 12:13:54.854136  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 236047us
I20260709 12:13:54.856600  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.857893  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:54.859812  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.860620  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.861971  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.862931  8919 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.864010  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 1973) took 1015 ms. Trace:
I20260709 12:13:54.864632  9065 rpcz_store.cc:276] 0709 12:13:53.843783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.843893 (+   110us) service_pool.cc:224] Handling call
0709 12:13:53.844152 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.467009 (+622857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.858685 (+391676us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000ab254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:54.859100 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415579904}
I20260709 12:13:54.865304 11068 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.867039  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:54.705230 11026 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.868324  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.869383 10992 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.871163 11026 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.871457  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.872390 11106 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:54.802830  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.857506  8921 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:54.881045  8925 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:54.857605  8994 raft_consensus.cc:2376] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:13:54.883060 11135 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:54.885229 11037 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.886396 10943 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.886981  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:54.887470  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47246.2us
I20260709 12:13:54.887954  9617 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:54.888506 11108 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.888973 11108 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.889418 11108 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.890632  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:54.892831 11024 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.894250 10980 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:54.894649 10980 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:54.895774 11044 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.692s	user 0.017s	sys 0.000s
I20260709 12:13:54.900077 11068 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.900524 11076 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.899719 10980 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.902158  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:54.908684  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.909590  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.909940 11044 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:54.910540  8995 raft_consensus.cc:2376] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4. Re-sending same reply.
I20260709 12:13:54.909651  8991 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:54.912781 11044 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:54.913887  9616 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.914527  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:54.921132  8995 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:54.923398  8998 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:54.924607  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 339) took 1228 ms. Trace:
I20260709 12:13:54.925088  9623 rpcz_store.cc:276] 0709 12:13:53.696392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.696526 (+   134us) service_pool.cc:224] Handling call
0709 12:13:54.924107 (+1227581us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54001301d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:54.924395 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058206976}
I20260709 12:13:54.927901  9621 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.852164  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:54.930685  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 78820.2us
I20260709 12:13:54.932382 11052 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:54.932791  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:54.933130 11052 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:54.933482 11054 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:54.923424  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:54.934409 11135 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.934844 11135 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:54.936532 11135 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:54.938726 11135 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.945256  8922 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:54.959873  8993 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.961699 11100 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.965997  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:13:54.947332 11052 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:54.971952  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.974490 11116 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.975090 11116 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.975606 11116 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:54.982987  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 111813us
I20260709 12:13:54.985126  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.984298  8995 raft_consensus.cc:2955] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:54.987037  8997 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:54.986954  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.987186  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:54.990586  8991 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.990763  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:54.992712 10982 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:54.994215 11136 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.996963  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:54.990504  8994 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:55.002871  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:55.004014  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 360) took 1124 ms. Trace:
I20260709 12:13:55.004211 10980 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:55.004489  9070 rpcz_store.cc:276] 0709 12:13:53.879435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.879565 (+   130us) service_pool.cc:224] Handling call
0709 12:13:53.895795 (+ 16230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.198340 (+302545us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:54.323214 (+124874us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.618787 (+295573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.618842 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:54.618896 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.003533 (+384637us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:55.003603 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.003799 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1159,"prepare.queue_time_us":125597,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":50525,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4110,"spinlock_wait_cycles":695261440,"thread_start_us":393471,"threads_started":3,"wal-append.queue_time_us":187172}
I20260709 12:13:55.007359 10982 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.007813 10982 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.009269  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.008853 10982 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.010102  9622 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:55.011359 11052 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.015806 11152 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:55.017428  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 138637us
I20260709 12:13:55.018565  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.019428 10657 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:55.004050  8925 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:55.025116  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44069.6us
I20260709 12:13:55.026346 10898 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.026803 10898 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.027169 10898 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.027998  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:55.028707  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46411.1us
I20260709 12:13:55.029490  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:55.030428  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:55.031380 11040 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.031838 11040 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:55.032286 11040 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.033601  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.034507  8992 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:13:55.035291  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.038326  8922 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.042938 10657 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.043494 10657 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.044754 10657 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.046948  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:55.052207 10881 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.060853 10881 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.061246 10881 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.062399 10982 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.062712 11125 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:55.063302 11125 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:55.063400 11110 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:55.052819  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.053138  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:55.065269  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 74612.7us
I20260709 12:13:55.053740  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:55.053946 11087 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.007s
I20260709 12:13:55.054628  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:55.055631  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:55.057246 11041 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.057271  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:55.099159 11091 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.099265 11138 consensus_queue.cc:1059] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:55.099675 11091 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.100059 11091 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.100342 11138 raft_consensus.cc:3055] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.100720 11138 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:55.101016  8924 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.009s
I20260709 12:13:55.101555  8924 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:55.102428 10952 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.102056 11138 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.059078  9070 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.052239  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:55.065019 11110 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:13:55.064627 11125 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.066643 11047 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.067193  9066 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:55.068223  9068 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:55.069106  9065 raft_consensus.cc:2410] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:55.070322  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 1999) took 1067 ms. Trace:
I20260709 12:13:55.070848  9074 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:55.072292  9073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.003s	sys 0.019s
W20260709 12:13:55.074365 11097 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.000s
I20260709 12:13:55.074783  8919 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.060191  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.080215 11118 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:55.083297 11092 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.006s
W20260709 12:13:55.083606 11065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.020s
I20260709 12:13:55.083125  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.092780 11111 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.097115 11041 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:55.097797  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 79417.4us
I20260709 12:13:55.155989  9071 rpcz_store.cc:276] 0709 12:13:54.003125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.003488 (+   363us) service_pool.cc:224] Handling call
0709 12:13:55.070077 (+1066589us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54000e7ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:55.070246 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810618752}
I20260709 12:13:55.089185 11040 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:55.164342  9073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.005s	sys 0.019s
I20260709 12:13:55.086805 10898 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:55.166949  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56605.2us
I20260709 12:13:55.159439 10881 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.101053  8822 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:55.180953 10881 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:55.180982  8822 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.189428  8822 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.193199 10657 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.193361 11100 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:55.194478 11135 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.194859 11135 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.195529 11106 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:55.195894 11135 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.199019 10898 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.200531 11116 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.200743 11135 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.202765 11116 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.199607  8822 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:55.164074 11065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.013s	sys 0.020s
I20260709 12:13:55.155491 11047 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:55.172449 11005 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:55.165293 11097 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.165582 11087 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.173702 11108 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.174782 11009 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:55.173734  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 90744.6us
I20260709 12:13:55.177843 11110 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.165761 11136 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:55.218132 11005 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:55.218251  9616 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.232620  8925 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.167776 11041 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.227344 11110 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:55.226735  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:55.246958 11005 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.247730  9622 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.248963 11013 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:55.250018 11010 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.250458 11010 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.251547 11010 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.252310 10989 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:55.252866 11010 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.226390 11087 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.242467 11110 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.243580  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2454) took 1031 ms. Trace:
I20260709 12:13:55.239018 11106 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:55.226395 11108 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.244061 11100 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.244264 11157 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.254827  9074 rpcz_store.cc:276] 0709 12:13:54.212030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.221241 (+  9211us) service_pool.cc:224] Handling call
0709 12:13:55.070351 (+849110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.155732 (+ 85381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.243326 (+ 87594us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54000e7ed0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:55.243514 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946373504}
I20260709 12:13:55.237819  8822 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.263383 11100 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.263633 11157 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.267824 11100 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:55.272729  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 234497us
I20260709 12:13:55.258028 10898 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:13:55.169200 11092 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:55.285612 11103 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.970s	user 0.008s	sys 0.010s
I20260709 12:13:55.286116 11103 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.286980 11108 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.287413 11108 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:55.288578 11103 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.288445 11108 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.289793 11108 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.290055 10854 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.290408 10854 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.282516  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:55.296083 11138 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.301853  9074 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:13:55.257740 11076 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:13:55.311666  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:55.311370 10854 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.308063 10898 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:13:55.313107 10854 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.313499 11092 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.317663  9067 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.321167  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2460) took 1094 ms. Trace:
I20260709 12:13:55.321635  9067 rpcz_store.cc:276] 0709 12:13:54.234200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.234407 (+   207us) service_pool.cc:224] Handling call
0709 12:13:54.264315 (+ 29908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.318253 (+1053938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.320838 (+  2585us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400422cd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:55.321098 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389990784}
I20260709 12:13:55.323619  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.323897 11040 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:55.325235  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.325595  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.326385 11097 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.326423  9622 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:55.268638 11111 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:13:55.333814 11110 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.282954  8822 catalog_manager.cc:5697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.340713 11091 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.342336 11009 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.344059  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:55.344756  8917 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.278294 11106 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.346784 11106 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:55.347596 11159 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:55.348496  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.350219  9622 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.350560  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:55.336452  8822 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 3 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.351895  8925 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:13:55.352357  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 56424.3us
I20260709 12:13:55.351332  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:55.344276 11157 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.376668 11116 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:55.377398  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:55.377624  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 104171us
W20260709 12:13:55.378644  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.379338  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.384040  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.400751  9622 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.389955 10710 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.380076  8822 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 3 to 4, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.407828  8822 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 3 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.408746 11047 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.382836 11076 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.410132 11047 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.410903 11076 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.411592 11076 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.413252 10710 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.414637 11091 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.417304  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.383054 11108 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.418916 11108 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.422290 11108 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:55.360260 11097 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.427706 11097 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.430371 11097 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.377408 11116 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:55.432029 11116 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.433167  8917 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:55.434996 11047 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.440778  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.440965  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:55.441303  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.441562  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:55.441692  9616 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:55.443598 11131 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.444260  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:55.444871  8993 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:55.445884  9622 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:55.439504 11047 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.399835 11040 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:13:55.453154  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:55.458760  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.458813  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.459967  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.473266  8822 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 5 to 6, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 6 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:55.474313  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70842.2us
I20260709 12:13:55.454401 11125 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.451174 11040 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.486334  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.465950 10992 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:55.491361  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:55.492201 10639 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:55.495805  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 170696us
I20260709 12:13:55.496587  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:55.497943  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.500319 11110 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:55.500757 11110 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.501075 11110 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.503286 11026 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:13:55.503441  8822 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:55.508769  9622 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:55.457010 11076 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.480124 11040 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:55.460799 11133 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:13:55.485417 11047 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.478046 11108 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:13:55.512001  8822 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.656787  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:55.607169  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:55.590104  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.555537  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.608780  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:55.564539  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:13:55.629848  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68813.8us
I20260709 12:13:55.532569  8925 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:55.669960  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.669776  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.671643  8996 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.612942  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.618970  9624 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:55.670923  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.673100  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.673790  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.674085  8919 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:55.674299  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:55.680912  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.628281  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:55.577315  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.544076  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.676607  9623 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.596891  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.565508  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.655717 10989 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:55.630159 11166 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:55.682478  8993 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:55.656965 11092 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:55.698024  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89333.7us
I20260709 12:13:55.628722  9617 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:55.638221 10639 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.512089 10992 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:55.584981 10657 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.699255  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.700780  9622 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:55.619571 10854 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.513882 10898 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.576026  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:55.698518  9621 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:55.703812  9619 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:55.704129  9000 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.546147  8917 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:55.643971 11091 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.701732 10979 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.668125  8822 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:55.722651  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.714622  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.720630  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.711617 11133 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:55.728717  9073 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:55.725656  8991 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:55.725852  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 106423us
I20260709 12:13:55.707175 11092 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:55.727483  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.709923 10639 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:55.730602  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.728832  8822 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 4 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 5 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.700057 11135 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:13:55.715444 10710 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.733125  9069 raft_consensus.cc:2410] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:55.743405  9067 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:55.745894  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.730392 11091 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.749014  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:55.715552 11010 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:13:55.750396  8822 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.754673 11041 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.755929  9065 raft_consensus.cc:2410] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:13:55.731154 11131 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:55.707345 10989 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.716807 10657 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.768276 10710 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.769503 11091 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:55.769805 10657 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.745977 10898 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:55.774299  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.760844  8999 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:55.756261  9621 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:55.777153  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.778473  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.748687 11133 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:55.779385  9065 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:55.780006  9070 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.779489  8822 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:55.742622 10854 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.819620  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:55.822890  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:55.824306  9067 raft_consensus.cc:2410] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:55.781545 10710 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.825536 11116 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:55.734138 11040 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.827827  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.834635  9065 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:55.832343  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.839144  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:55.842098  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 66618.5us
W20260709 12:13:55.841951  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64884.4us
I20260709 12:13:55.791009 11167 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.846674  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.849628 11164 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.850268 11164 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.837383 11103 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:13:55.772645 11010 consensus_queue.cc:1243] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:13:55.857084 11168 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.152s	user 0.004s	sys 0.000s
I20260709 12:13:55.775440 11131 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.863186  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.861739  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.863615  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:55.864270  8995 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.832628  9618 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:13:55.865902  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:55.872920  8994 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:55.875116  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.875790  9068 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:55.846939  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:55.780414 10898 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.874408 11167 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.884618  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.886273  8999 raft_consensus.cc:2410] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:55.886439  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.887112  9068 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:55.888484  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:55.889076  8993 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:55.890012  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.890518  8993 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.836838 11133 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.897627  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:55.906033  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:55.878341 10710 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.917420  9623 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:13:55.922667  8996 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:55.924803  8991 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:55.832392 11092 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.927918  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:55.932268 11172 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.932511 11026 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:55.932797 11163 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.936631  8996 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.946354  8995 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:55.950110  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.951458  9068 raft_consensus.cc:2410] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:55.950079  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.837913 10992 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:55.970544  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 111769us
I20260709 12:13:55.953001  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:55.936116 11172 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.837889 10639 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:55.975849  8996 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:55.975977  8995 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:55.977957  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 99805.1us
I20260709 12:13:55.937698 11116 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.982389  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:55.973872 11172 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.947706 11026 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:55.947576 10989 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:55.991982  8996 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
W20260709 12:13:55.993559  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.987910  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.004029  8998 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:13:56.011548  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:56.012392  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 174904us
I20260709 12:13:55.952950 11163 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:55.953138 11125 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:13:56.019057  9618 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.018985  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.019990  9068 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.020407 11028 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.017947  8992 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:55.989029 11005 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.026889  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:56.025642  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:56.003099 11111 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:13:56.037014  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.038215  9068 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:56.039920  9000 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:56.041198 10979 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:56.041743 11131 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.043517 11131 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.044001 11131 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.044804 10854 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.046321  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:56.024456 10639 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.023824 11041 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:56.036010 11110 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.004s
I20260709 12:13:56.031116 10657 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.049752  8964 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.572s (SENT)
I20260709 12:13:56.059441  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.059629  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:56.033617 11116 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.041215 10710 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:56.070688  8919 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:56.077045  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 149240us
I20260709 12:13:56.078471  8925 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:56.078830  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.083979  9068 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:13:56.080837  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:56.093544  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:56.059508 10989 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:56.046943 11028 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.098214 11138 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.099726  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.119632  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.104934 11135 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:56.110739 11009 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:56.110929  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.111449 11164 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:56.111824 10898 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.111949 11173 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.113385 11163 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.114266 10979 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:56.083248 11176 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.125528  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.056354 11097 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:13:56.119349  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:56.100085  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.120992  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:13:56.116789  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 84717.9us
I20260709 12:13:56.085271 10710 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:56.128701  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:56.124733 11135 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:56.061378 11110 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.130764  8925 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:13:56.137562  8964 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.683s (SENT)
I20260709 12:13:56.142109  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:56.140893 11028 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.117702  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.080586 10657 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.120814 11009 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:56.163393  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.125160 10979 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:56.128587 11041 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.148926  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:56.173568  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 52663.5us
I20260709 12:13:56.181063  8925 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.166848 11005 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:56.185133  8997 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:13:56.079388 11026 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.191179  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.191711 11026 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.191546 11135 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.192828 11135 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.189726  8919 pending_rounds.cc:85] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 5
I20260709 12:13:56.195499  8919 pending_rounds.cc:107] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:56.195936  8919 raft_consensus.cc:2889] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:56.195797 10979 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:56.195356  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89135.3us
I20260709 12:13:56.145413 10992 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:56.129570 10989 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.170261 11125 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.204730  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:56.205235  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.131546 11138 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.205574 11157 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.217535  8993 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:13:56.295745  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55098.1us
W20260709 12:13:56.684628  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 547060us
W20260709 12:13:56.248510  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.290458  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:56.695221  8924 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:56.219044  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.696565  9065 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:13:56.339164  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.527868  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
W20260709 12:13:56.440847  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.601496  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 404147us
W20260709 12:13:56.437337  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 223346us
I20260709 12:13:56.703027  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:56.703779  8993 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:56.248562  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:56.181856 10854 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:56.719306  9071 raft_consensus.cc:2410] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:13:56.722201  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.717504  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:13:56.540656 11172 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 12:13:56.500811 10989 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.215948 11103 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:56.684648 10979 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.734072  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:56.735263  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:56.369928  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:56.500948 11138 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.240504 11041 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.491s
I20260709 12:13:56.541561 10657 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:56.738721  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.745476  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.745791  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.369500 11110 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.248124 11097 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:56.370397 10710 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.747745  8999 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.749950  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.703802 11198 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.737686 10898 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.734809  8917 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.206615 11173 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.539s
I20260709 12:13:56.718007 11157 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.749830  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:56.751643  8993 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:56.723789 10854 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.742224 11185 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.219537 10992 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.760921  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.735148 11172 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:56.760306 10639 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 12:13:56.765796 10639 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:56.766247 10639 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:56.766363 11194 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:56.766610 10639 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.767941  8925 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:56.517764 11005 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.752944 11103 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:56.772049  8964 leader_election.cc:336] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.788s (SENT)
I20260709 12:13:56.761308 10989 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.772733 11185 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.752858 11118 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:13:56.776703 11118 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.777063 11118 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:56.777361 11185 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.774803 10989 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.777894 11118 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.780049 10989 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:56.781906 10639 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.782351  8919 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.784108  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.749678 11182 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:13:56.785418 11118 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.784808 11131 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.786754  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.786859  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.787484  8919 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:56.789204  8919 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.789547  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:56.790169  9616 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.790565  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.791216  8919 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:56.793021  9067 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:56.793128  9069 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:56.794075  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:56.794550  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:56.795149  9073 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.796006  9065 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:56.797394  9065 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:56.798655  9065 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.799088  9617 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:56.789211  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:56.800045  9621 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:56.802012  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:56.802675 11135 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.000s
I20260709 12:13:56.802692  9070 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:56.807571  8917 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:56.808247  9070 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:56.792121  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:56.762591 11196 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.817589 11009 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.818140 11196 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:56.773375 11026 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:13:56.809963  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.811126  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.811481  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:56.811736  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.811993  9623 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:56.812950 11172 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.759580 11110 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.784121 10639 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.814452 11157 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:56.751878 11097 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.808876  9073 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:56.915457  9000 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.818794  9069 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:13:56.833000  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:56.882356  8919 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:56.881064  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:56.819417  9067 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:13:56.840901  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:56.888826  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.901515  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:56.921613  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.818918 11009 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.756758 10898 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:56.832990 11188 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.475s	user 0.000s	sys 0.011s
I20260709 12:13:56.943041  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:56.945034  8925 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:56.977982  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 137192us
I20260709 12:13:56.885180  9616 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:56.838897 11198 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.978893  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:56.979084 11198 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:56.979516  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:56.981335 11198 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.826148 10854 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.981527  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:56.982206  8994 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.829897 11041 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.826694 11167 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:56.817605 10992 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:56.974761  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:56.987551  8995 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.987749  8993 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:56.978080 10710 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.820423 11196 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:56.901479 11116 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:13:57.008476  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.009479  8916 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:57.010643  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.012841 10898 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:56.824862 11199 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 12:13:57.014134  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.014484 11103 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.016156 11173 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.016950 11173 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:56.820127 11040 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.905267 11111 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:13:56.923913 11135 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.975900  9073 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.927917 10989 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.914491  8918 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:13:56.926230 11110 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.028085  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 303816us
I20260709 12:13:57.074551  8924 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:57.077229  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2328) took 1438 ms. Trace:
I20260709 12:13:57.077796  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.020768  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:57.080171  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 317483us
I20260709 12:13:56.986621 11125 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.087999  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55417.3us
I20260709 12:13:57.077668  8997 rpcz_store.cc:276] 0709 12:13:55.590539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.596154 (+  5615us) service_pool.cc:224] Handling call
0709 12:13:55.596544 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.187103 (+590559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.028524 (+841421us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54001a18d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:13:57.028746 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353020800}
I20260709 12:13:57.091217  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.099324  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:57.104199  8964 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.922s (SENT)
I20260709 12:13:57.104791  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.076283 11092 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.075730 11167 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.119000  8995 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:13:57.109746  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 122721us
I20260709 12:13:57.074764 10898 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:57.108543  8921 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:56.992764 10710 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.991544 11041 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:57.122304  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 417087us
W20260709 12:13:57.122747  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 246350us
W20260709 12:13:57.123479  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 373701us
I20260709 12:13:57.102871 11217 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.122987  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:57.124109  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46388.7us
I20260709 12:13:57.102319  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.123852  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.106467 10989 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:57.147219  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:57.145912  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53186.7us
W20260709 12:13:57.149667  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.149827  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.100083 11135 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.184010  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45503.2us
W20260709 12:13:57.152596  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61461.7us
I20260709 12:13:57.153353  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:13:57.186386  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63484us
I20260709 12:13:57.133258 10710 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.153592  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:13:57.151717  8964 leader_election.cc:336] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.506s (SENT)
I20260709 12:13:57.139722 10992 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:57.259271  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:57.263729  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 110217us
W20260709 12:13:57.264258  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 140478us
I20260709 12:13:57.269853  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.265614  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.185700 11198 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.139870 11097 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.268685  9067 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
W20260709 12:13:57.264395  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82008.4us
I20260709 12:13:57.270596  9065 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:13:57.133728 10898 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.241923 11108 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.191159 11196 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.151314 11167 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.279942  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.253552 10979 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.269155 11028 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:57.316569  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 72229.2us
W20260709 12:13:57.333294  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.145375 11176 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 12:13:57.252236 11026 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.322000  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50571.1us
I20260709 12:13:57.266752 10992 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.337625 11208 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:13:57.337718 10992 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.338555 10898 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:57.344862 11213 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:13:57.346004 11196 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.347904  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 68059.5us
I20260709 12:13:57.348795 11196 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.325430 11097 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.322414 11215 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:13:57.349346 11196 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.350996 11097 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.356299 11167 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.354720 11196 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:57.154219 10989 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.360878 10989 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.361457 10989 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.320016  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.326264  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.317188 11173 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.321870 11182 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.335059 11028 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.337339 11212 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:13:57.356868 11167 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.325099 11207 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:13:57.370721 11157 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:57.371258 11157 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.371809 11226 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:57.373063  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 221382us
I20260709 12:13:57.373723 11207 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.373829 11182 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.374342 11207 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:57.373747  8964 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.513s (SENT)
I20260709 12:13:57.375713  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.375845 11217 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:57.377082  8964 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.622s (SENT)
I20260709 12:13:57.377496  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.280812 11106 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:57.324887  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:57.391593  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 66782.7us
I20260709 12:13:57.191596 11172 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
W20260709 12:13:57.382247  9071 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.000s
I20260709 12:13:57.367472 11028 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.362025 11026 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.305661 11116 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:13:57.368145 11196 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.368800 11041 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.373530 11157 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:57.355015 11125 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.434465  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.408222 11176 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:57.369355 11167 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.324406 11108 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:57.396521  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:13:57.397792  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78569us
I20260709 12:13:57.398880 10989 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.406524 11173 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:57.440208  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63151.6us
W20260709 12:13:57.458810  8964 leader_election.cc:336] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.738s (SENT)
I20260709 12:13:57.409122 11118 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.440428  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.445302  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.401659 11220 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.456712  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.399276 11106 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.483099  9072 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
W20260709 12:13:57.486081  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.491478  9072 pending_rounds.cc:85] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 4
I20260709 12:13:57.491865  9072 pending_rounds.cc:107] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 5.5
W20260709 12:13:57.491909  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46702us
I20260709 12:13:57.492324  9072 raft_consensus.cc:2889] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.493112  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:57.490927  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53265.2us
I20260709 12:13:57.493808  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.494676  8919 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 2: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:57.424484 11041 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:13:57.496711 11009 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.502522 11009 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.503023 11009 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.403959 10992 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.481972 11110 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:57.530711  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.455389 11097 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:57.446943 11108 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.441448 11176 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:57.529757  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:57.523782 11010 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.038s	sys 0.056s
I20260709 12:13:57.532637  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.496517 11220 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.504217 11103 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.535589  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 213025us
I20260709 12:13:57.446689 11228 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:13:57.507041 10898 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.504153  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.550763  8920 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:57.551533  9073 raft_consensus.cc:2368] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
W20260709 12:13:57.553920  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95160.9us
W20260709 12:13:57.532011  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.011s
W20260709 12:13:57.572860  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 217511us
I20260709 12:13:57.575117 11211 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.531791 10979 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:57.735438 11211 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:57.736644  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.008s	sys 0.011s
I20260709 12:13:57.736374 10979 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.737368  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 755847us
I20260709 12:13:57.738140  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.740005 11110 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.549826 11226 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:57.531556 11135 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.529821 11173 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:57.585848  9590 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.953s (SENT) [suppressed 35 similar messages]
W20260709 12:13:57.741565  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 155742us
I20260709 12:13:57.741407 11226 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.714284 11028 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.743304 11135 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:57.552591 11097 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.743841 11135 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.744565 11028 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.744732 11097 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.745118 11204 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.797s	user 0.002s	sys 0.000s
I20260709 12:13:57.746079 11135 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.747474 11009 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.748296  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.749056  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:57.755275  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.756742  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.757349  9622 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:57.757495 10710 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.760079  9068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 387) took 1555 ms (client timeout 1555 ms). Trace:
I20260709 12:13:57.760504  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.761197  9618 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:57.589465  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:57.587347 11182 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:57.548985 11198 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:13:57.612092  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.762291 11173 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:57.585979 11010 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.038s	sys 0.057s
W20260709 12:13:57.607899 11040 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 12:13:57.594079 11201 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.593883 11118 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:57.637179 11228 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:57.608860  8917 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:57.614064  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.745237 11097 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.772111  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 182716us
I20260709 12:13:57.772265  8918 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:57.645406  8995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:13:57.773751 11097 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.773877  8995 raft_consensus.cc:606] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:57.774336 11097 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:13:57.612224 11026 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.622658 11207 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:57.603492 11103 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.673166  9071 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:57.668694  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.675065  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.673924  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.776577 11097 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.777035 11097 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:57.777105 11041 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:57.777236  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 102314us
I20260709 12:13:57.777812 11041 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:57.678630 11106 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.778774 11041 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.770743 11110 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:13:57.780877 11103 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.776571  9071 pending_rounds.cc:85] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 2
I20260709 12:13:57.781424  9071 pending_rounds.cc:107] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:57.666675 11214 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:57.686939 10992 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.781810  9071 raft_consensus.cc:2889] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.781955 11214 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.631392 11176 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.783008  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.775799  8922 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:57.763433 11225 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.684280 11240 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.712160 11092 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
W20260709 12:13:57.714533  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 118598us
W20260709 12:13:57.592084  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 59539.3us
W20260709 12:13:57.760517  9068 rpcz_store.cc:269] 0709 12:13:56.204844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.204974 (+   130us) service_pool.cc:224] Handling call
0709 12:13:57.759842 (+1554868us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400369554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:57.759982 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441238912}
I20260709 12:13:57.766933  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.767727  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.763491 11173 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:57.774366  8995 raft_consensus.cc:614] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:57.673377  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.781370 11103 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.693207 11108 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.783696  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.825524  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.784482  8920 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:57.785701  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.685993  9067 raft_consensus.cc:2955] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:57.788297  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:57.849156  9065 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.783913  9066 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:57.789143  8925 raft_consensus.cc:2376] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4. Re-sending same reply.
I20260709 12:13:57.798571 11240 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.799065 11118 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.799860  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.802435 11214 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.807842  8991 raft_consensus.cc:2410] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:57.768869 11028 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.854053  8920 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:57.871965  9069 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:57.859099  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.858402  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.872893  8921 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:13:57.873391  8916 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:57.874487  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.874756  9066 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:57.818408  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 219472us
W20260709 12:13:57.818813  8964 leader_election.cc:336] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.050s (SENT)
I20260709 12:13:57.820456  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.783186 11228 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:13:57.702133 11203 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.708s	user 0.000s	sys 0.003s
I20260709 12:13:57.824329  8919 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:57.848417  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 80778.5us
I20260709 12:13:57.768515 10989 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:13:57.901038  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:57.901363  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:13:57.824170 11026 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:57.788774 11009 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:57.902881  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.873118  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.910900  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.875027  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:13:57.895737  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 70325us
I20260709 12:13:57.917862  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.920956  8925 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:57.924052 11249 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:57.916678  8923 raft_consensus.cc:2376] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4. Re-sending same reply.
I20260709 12:13:57.913264  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:57.919585  8920 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:57.929658  9066 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.823385 11173 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:57.899489 11157 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.902196 11028 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.940855  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.935738  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.941561  9623 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:57.858822  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.942910  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.875718 10639 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.846606 11238 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:13:57.852259 11092 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.939646  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:57.858489 11234 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 12:13:57.858518  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.972724  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.941111  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.899993 11230 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.932298  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.973619  8924 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:57.928479 11226 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:13:57.942605  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.974294  9588 leader_election.cc:400] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
I20260709 12:13:57.976656  9588 leader_election.cc:403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.943351 11110 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:57.946547 11167 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.851156 11103 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.981127  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2338) took 1087 ms. Trace:
I20260709 12:13:57.979780  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:57.949589 11224 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.951128 11108 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.981513  8991 rpcz_store.cc:276] 0709 12:13:56.890470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.890577 (+   107us) service_pool.cc:224] Handling call
0709 12:13:57.977517 (+1086940us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400236ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:57.977625 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911471360}
I20260709 12:13:57.951157 11240 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.951545  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.954675  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 390) took 1617 ms. Trace:
I20260709 12:13:57.955600 10710 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:57.960611 11028 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.962083  9066 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:57.939070 11239 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.966207  9065 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:57.968735  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:13:57.969267  8925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:57.909556 11199 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:13:58.009749  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:57.971638  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.799911 11225 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.858814  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.944527  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:57.946283  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:57.975947  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:13:57.982386  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 163611us
I20260709 12:13:58.012125  9623 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:13:58.012643  8964 leader_election.cc:336] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.094s (SENT)
I20260709 12:13:58.013098  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:57.979091  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46886.7us
I20260709 12:13:58.012259 11173 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:57.968196 11125 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.985666  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:58.015609  8924 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:58.015368 11125 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.980816  8918 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.017488 11125 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:58.018002 11125 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.018453 11125 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.020651 11125 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:57.987545  8917 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:57.977954 11110 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:58.021796 11173 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.021263 11125 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.022943 11125 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.022338 11110 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.023324 11125 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.024010 11110 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.024843  8918 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:58.025810 11246 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:58.025949  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 50092.3us
I20260709 12:13:58.026269 11246 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:58.026649 11246 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.987799 11197 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.027410  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:58.027673 11197 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:13:58.028355  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.028934 11197 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:57.989363 11248 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:58.031423 10854 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:57.989553 11103 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:58.033402  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.034029  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.034899  9622 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:57.990025  9071 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:57.990725 11167 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.990936  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:57.984951 10992 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.991185 11176 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.981308 11214 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.983458 11224 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.968199 10639 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.993299  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:57.994362 11211 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:57.984282 11026 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.037029  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:57.995543  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:57.985416 11005 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.007758  8925 raft_consensus.cc:606] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:58.014645  9040 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:57.969434 11092 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.035017  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.099692  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:58.035662  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.114917  8920 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:58.115484  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:58.126473  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89650.7us
I20260709 12:13:58.127264  9588 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:57.985165  9074 rpcz_store.cc:276] 0709 12:13:56.337673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.337830 (+   157us) service_pool.cc:224] Handling call
0709 12:13:56.438614 (+100784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.439039 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.439079 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.499549 (+ 60470us) log.cc:844] Serialized 26 byte log entry
0709 12:13:56.732011 (+232462us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:56.732087 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.732264 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.701433 (+969169us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:13:57.954381 (+252948us) raft_consensus.cc:1685] finished
0709 12:13:57.954403 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.954616 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":523,"raft.queue_time_us":314178,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2658,"spinlock_wait_cycles":57277312,"thread_start_us":230263,"threads_started":1,"wal-append.queue_time_us":362672}
I20260709 12:13:58.011067  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:58.134896  9073 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:13:58.135849  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.010946 10710 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 12:13:58.166260  9065 raft_consensus.cc:2368] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:58.166090  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.167514  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.168586  9065 raft_consensus.cc:2410] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:58.128978 11239 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:58.170315  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 160267us
W20260709 12:13:58.137445  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 122871us
I20260709 12:13:58.175326 11108 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:58.169323  9623 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:58.176103  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:58.176692  8919 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.115481 11224 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.177268  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:58.177881  8918 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.091368 11167 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:58.178139  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 165508us
I20260709 12:13:58.178525 11167 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:58.179783  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 233564us
I20260709 12:13:58.179157  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:58.181468  8925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:58.181737  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:58.182356  8925 raft_consensus.cc:606] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:58.182760  8925 raft_consensus.cc:614] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:58.172178 11239 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:58.115653 10992 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:58.173043  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54326.3us
I20260709 12:13:58.173476 11106 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:58.174198  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.169871 11118 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.184670  8924 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:13:58.185066  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.186995  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:58.193446  9623 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.193444  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:58.193737  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.194986  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:58.187690  8964 leader_election.cc:336] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.055s (SENT)
I20260709 12:13:58.190765  8922 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:58.194585  9621 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:58.192760  8924 pending_rounds.cc:85] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 2
I20260709 12:13:58.200007  8924 pending_rounds.cc:107] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:13:58.202965  9624 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:58.136634 11005 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:58.182706 11092 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.200256  8924 raft_consensus.cc:2889] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:58.202034  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.183590  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:58.183984 11131 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.136507  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:58.227385  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:13:58.195559 11157 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.195916 10992 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.192350 11108 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.203008 11118 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:58.225684  9623 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:58.200248 11182 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.035148 11246 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.232542  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.248591  9066 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:13:57.981016 11230 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.211763 11009 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.216254 11005 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.204766 11106 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:58.214253  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.225239 11211 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.186174 11214 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.239423  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.242292 11229 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.244354 11118 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.248194 11199 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.246111 11217 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.249464  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:58.284018  8919 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:13:58.254400  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:58.256376  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:58.256496  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:58.257956  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 315294us
I20260709 12:13:58.232347 10898 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.232587 11157 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:58.235705 11108 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.264815 10639 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:58.302803  9066 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:58.236477  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:58.237713 11263 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:13:58.280001  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.235885 11264 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.298998  9071 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 1.
I20260709 12:13:58.309584  9066 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:58.299962 11220 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:58.300535  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44180.9us
I20260709 12:13:58.313781  9590 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:13:58.314900  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 127226us
I20260709 12:13:58.235986 11131 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.284523 11199 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.265717 11246 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:58.254958 11028 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:13:58.311416  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:13:58.315629  8964 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.127s (SENT)
I20260709 12:13:58.311916  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:58.301594 11157 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.317920  9071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58540
I20260709 12:13:58.324043  9071 raft_consensus.cc:606] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 12:13:58.324390  9071 raft_consensus.cc:614] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:58.321744  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:58.298797  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:13:58.302865 11108 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.337383  8917 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:13:58.343402  8917 raft_consensus.cc:614] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:58.319355 11199 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.300532 11217 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:58.355204  8964 leader_election.cc:336] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.136s (SENT)
I20260709 12:13:58.355747  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.329352 10639 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:58.329612 11201 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:58.353268  9620 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:58.325851 11103 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:13:58.317561 11263 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.344198 11264 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.355878 10989 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.351526 10898 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.365837 11268 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:58.367149 11225 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:58.397185 11258 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:58.371258 10639 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.352609 11229 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:58.396138 11264 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.439311  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:58.350437 11106 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:13:58.452343  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 141163us
I20260709 12:13:58.393561 11201 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:13:58.456041  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 100882us
W20260709 12:13:58.467916  8964 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.199s (SENT)
I20260709 12:13:58.468513  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.468600  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:58.439333 10898 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:58.473078 10898 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.499246 10989 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:13:58.504045 11214 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:58.505339 11272 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.505167 11201 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.447415 11264 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.520720  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:58.522737  8992 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.525821  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:58.526659  8994 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:13:58.503892 11229 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:58.438377 11268 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.521219 11197 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.537358 11197 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.518518 11214 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:13:58.555753 11267 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:13:58.556748  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:13:58.587356  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.524704 11272 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:58.606050  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 356648us
W20260709 12:13:58.642201  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 136848us
W20260709 12:13:58.635864  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.564946  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 97065us
W20260709 12:13:58.646492  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.627054  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:58.649498  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.650619  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.649909  8994 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:13:58.655045  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:58.665696  8996 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:13:58.692472  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:58.618717 11176 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.003s
I20260709 12:13:58.555785 11277 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:58.698773  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 519662us
I20260709 12:13:58.627445 11283 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.626057 11131 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:58.650082 11026 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
I20260709 12:13:58.799851  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:58.665346 11097 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.888s	user 0.013s	sys 0.000s
I20260709 12:13:58.805621  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:58.862768  8994 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:13:58.864138 11281 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:13:58.864472  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:58.865326  9619 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.865855 11271 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 12:13:58.866796 11265 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.864684 11198 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:58.955317 11198 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.960253  9622 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:13:58.699771 11282 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.703876 11220 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:13:58.972312 11198 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:58.996502 11279 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.331s	user 0.000s	sys 0.000s
W20260709 12:13:59.005708 11110 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.981s	user 0.007s	sys 0.004s
W20260709 12:13:59.011296 11227 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:13:59.015837 11167 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.000s
I20260709 12:13:59.016330 11167 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:59.017182 11092 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.000s
W20260709 12:13:58.964671  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 164940us
W20260709 12:13:58.987072  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.018479 11167 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:59.019111 11173 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.997s	user 0.001s	sys 0.009s
I20260709 12:13:58.995121 11282 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:58.667577 10989 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:59.022396 11182 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.001s
W20260709 12:13:59.025353  8918 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.001s
W20260709 12:13:59.027311 11108 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.000s
W20260709 12:13:59.027915 10992 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.788s	user 0.003s	sys 0.007s
W20260709 12:13:59.029824 11224 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.000s
W20260709 12:13:59.040465 11270 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.583s	user 0.001s	sys 0.000s
W20260709 12:13:59.045631 11211 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.005s
W20260709 12:13:59.057781 11157 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 12:13:59.101980  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.130961  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.131657  9066 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:13:59.104452  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:13:58.968927 11283 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:59.032611 11125 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.009s	user 0.012s	sys 0.000s
I20260709 12:13:58.922646 11097 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.041165 11284 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.990083 11010 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:59.041738  9620 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:58.976161  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:59.118927  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:59.121480  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 471445us
W20260709 12:13:59.036435 11106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.006s
I20260709 12:13:59.122568  8918 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:13:59.148989  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.140203  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.107635 11198 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.181766  8997 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.123427 11182 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.108101 11263 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:13:59.132793 11264 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
W20260709 12:13:59.222946  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.077080 11092 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.187645  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1188) took 1007 ms. Trace:
I20260709 12:13:59.275825  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.123799 11108 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.279438 11220 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.280273 11263 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.283288 11198 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.137686 11157 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.175938 11284 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.172883 11010 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.129169 10992 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.179280  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:13:59.340737  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 161659us
W20260709 12:13:59.173297 11106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.007s
I20260709 12:13:59.174055 11041 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 12:13:59.292089  9615 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:58.920588 11265 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.293329  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:59.137483 11246 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.304634  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:13:59.356804  9069 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:13:59.306550  8992 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.003s
I20260709 12:13:59.357329  8992 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:13:59.189232 11270 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:13:59.325492  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 206920us
I20260709 12:13:59.174567 11125 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.335606 11287 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:59.305245 11211 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:59.307875  8918 rpcz_store.cc:276] 0709 12:13:58.176004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.176992 (+   988us) service_pool.cc:224] Handling call
0709 12:13:59.183115 (+1006123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:59.351320  8999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.083s	sys 0.087s
W20260709 12:13:59.366465  8999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.084s	sys 0.088s
I20260709 12:13:59.348310 11263 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:59.354744  9071 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:13:59.317410  8993 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:59.335534 11288 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:59.308763 11264 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.373183  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.373970  8998 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:59.374434  9071 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:59.348876 11280 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.131892 11224 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.356851 11246 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.407006  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:59.415531  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:59.417869  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:59.369237 11287 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.420499 11228 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.421999 11228 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.422101 11287 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.423213  8996 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:59.423745  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 406) took 1477 ms. Trace:
I20260709 12:13:59.424099  9073 rpcz_store.cc:276] 0709 12:13:57.946207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.946333 (+   126us) service_pool.cc:224] Handling call
0709 12:13:59.423548 (+1477215us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000ab254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:59.423674 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270712064}
I20260709 12:13:59.424621 11264 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.425433 11283 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:59.426393 11294 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:59.427867 11296 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:13:59.430104 11291 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:59.432443  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2512) took 1431 ms. Trace:
I20260709 12:13:59.433761 11224 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.434803  8822 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 303) took 6303 ms. Trace:
I20260709 12:13:59.408492 11246 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.443395  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:59.404135 11199 consensus_meta.cc:287] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.043s	user 0.009s	sys 0.003s
I20260709 12:13:59.445111 11097 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.447055 11265 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:59.448421 11157 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:59.434737  8995 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.432817  9067 rpcz_store.cc:276] 0709 12:13:58.001239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.268911 (+267672us) service_pool.cc:224] Handling call
0709 12:13:58.269238 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.269592 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:13:58.316969 (+ 47377us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.650775 (+333806us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.651428 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.651599 (+   171us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:58.651660 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.651741 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.432237 (+780496us) raft_consensus.cc:1685] finished
0709 12:13:59.432257 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.432388 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14163,"prepare.queue_time_us":46463,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3918,"raft.queue_time_us":3056,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":19417,"thread_start_us":304424,"threads_started":1,"wal-append.queue_time_us":852590}
I20260709 12:13:59.454989  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:59.455363  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:13:59.456231 11250 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.524s	user 0.012s	sys 0.014s
I20260709 12:13:59.456562  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:59.478238  9623 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:13:59.457019 11005 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.174s	user 0.008s	sys 0.003s
I20260709 12:13:59.430997 11230 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:13:59.470482  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52737.3us
I20260709 12:13:59.488813  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:13:59.478025  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 190601us
I20260709 12:13:59.488652  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:59.374014 11211 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.493559  8964 leader_election.cc:400] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:59.494086  8964 leader_election.cc:403] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:59.405932 11263 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.510085  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.512565  9071 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:13:59.518385  8994 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.004s
I20260709 12:13:59.518916  8994 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:59.494284  9617 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:59.494836 11282 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.496245 11157 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.496274 11287 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.560264  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:13:59.498888  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:59.563480  9073 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:59.563963  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 72141.1us
I20260709 12:13:59.458127  8822 rpcz_store.cc:276] 0709 12:13:53.131312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.132116 (+   804us) service_pool.cc:224] Handling call
0709 12:13:59.434724 (+6302608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:56.139018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:56.139872 (+   854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:56.139923 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:13:56.139965 (+    42us) tablet.cc:662] Decoding operations
0709 12:13:56.211644 (+ 71679us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:56.211761 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:56.211806 (+    45us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:13:56.290859 (+ 79053us) tablet.cc:701] Row locks acquired
0709 12:13:56.290913 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:13:56.291088 (+   175us) write_op.cc:270] Start()
0709 12:13:56.291281 (+   193us) write_op.cc:276] Timestamp: P: 1783599236291023 usec, L: 0
0709 12:13:56.291307 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:56.292147 (+   840us) log.cc:844] Serialized 6287 byte log entry
0709 12:13:56.910285 (+618138us) op_driver.cc:464] REPLICATION: finished
0709 12:13:57.387676 (+477391us) write_op.cc:301] APPLY: starting
0709 12:13:57.387778 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:57.423574 (+ 35796us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:57.482257 (+ 58683us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:57.525943 (+ 43686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:57.526377 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:13:57.526426 (+    49us) write_op.cc:312] APPLY: finished
0709 12:13:57.526830 (+   404us) log.cc:844] Serialized 113 byte log entry
0709 12:13:57.539501 (+ 12671us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:57.557233 (+ 17732us) write_op.cc:454] Released schema lock
0709 12:13:57.557341 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:57.561504 (+  4163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:57.561550 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19100,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":477121,"apply.run_cpu_time_us":5704,"apply.run_wall_time_us":173777,"num_ops":16,"prepare.queue_time_us":206578,"prepare.run_cpu_time_us":25391,"prepare.run_wall_time_us":397048,"raft.queue_time_us":130459,"raft.run_cpu_time_us":27214,"raft.run_wall_time_us":210905,"replication_time_us":618787,"thread_start_us":721900,"threads_started":4,"wal-append.queue_time_us":410614,"wal-append.run_cpu_time_us":20462,"wal-append.run_wall_time_us":1881761}]]}
I20260709 12:13:59.497221 11108 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:59.493510 11230 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.569123  9071 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:13:59.571131  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:13:59.409408 11288 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.491153 11005 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.574245  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:59.521149 11283 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:59.576536  8919 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:59.576720  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:13:59.566484 11250 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:59.478399 11199 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.529217 11198 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:59.575780  8925 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.581403  9067 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:59.580492  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:59.583781  9073 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:13:59.586747  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:59.582291  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 660) took 1388 ms. Trace:
W20260709 12:13:59.588239  8871 auto_rebalancer.cc:893] Removing replace marker failed: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:13:59.575788 11157 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:13:59.640542  8871 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:13:59.590463  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:13:59.576300 11041 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:59.575613 11287 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.654031  9616 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:59.656139 11157 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:59.640899  8871 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:13:59.658974 11285 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:13:59.660872 11211 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.575435 11010 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:59.637996  9588 leader_election.cc:336] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.555s (SENT)
I20260709 12:13:59.638386  9066 raft_consensus.cc:2368] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 3. Current term is 4.
I20260709 12:13:59.577382  9615 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:59.638557  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51893.5us
I20260709 12:13:59.586918  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:13:59.664172 11290 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.580132 10992 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:13:59.664173  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:59.665293  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:13:59.666308  9620 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.666963  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:13:59.667709 10989 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.668329 10989 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.669260  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:13:59.669973 10989 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.670727  9615 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:13:59.593309 11224 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.671900  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.672725  8994 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:59.588766 11264 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:59.651615  8925 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:13:59.579818 11239 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:59.641693  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:59.672780  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.689947  8992 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:59.686689  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:59.686761  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.691804  8994 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:13:59.692408  8997 raft_consensus.cc:2410] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:59.637775 11284 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.697750  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.697841  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:59.698426  8992 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:59.695724  8996 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:59.650225 11125 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.698477  8991 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.664719 11290 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.690169  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 325) took 1220 ms. Trace:
I20260709 12:13:59.720522  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.593745  9617 rpcz_store.cc:276] 0709 12:13:58.186603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.189356 (+  2753us) service_pool.cc:224] Handling call
0709 12:13:59.427092 (+1237736us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:13:59.467635 (+ 40543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.558886 (+ 91251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.574790 (+ 15904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10505472}
I20260709 12:13:59.721856  8991 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:59.724915  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.725646  8991 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:59.722836  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 438) took 1120 ms. Trace:
I20260709 12:13:59.723555  8994 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:59.723788  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.732394  8996 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:13:59.733623  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.671787 11041 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:13:59.700629 11239 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.721357  8917 rpcz_store.cc:276] 0709 12:13:58.470069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.475933 (+  5864us) service_pool.cc:224] Handling call
0709 12:13:58.476335 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.476690 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.476720 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.477147 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.654816 (+177669us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:58.664961 (+ 10145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.698271 (+ 33310us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.671407 (+973136us) raft_consensus.cc:1685] finished
0709 12:13:59.671434 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.686744 (+ 15310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1539,"raft.queue_time_us":28090,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":164025,"threads_started":1,"wal-append.queue_time_us":875442}
I20260709 12:13:59.745697 11041 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.746284 11041 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:13:59.747351 11005 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.749337 11199 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.750038  9620 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:13:59.751163 11290 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:13:59.753093 11300 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:59.754722 11288 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.755374  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.756074  8996 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:13:59.756441 11240 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.756851 11240 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.756964  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:13:59.757225 11240 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.757545  8996 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.757727 11287 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.746007 11239 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.759537 11268 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.761374  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.762035  8992 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:13:59.733402  9000 rpcz_store.cc:276] 0709 12:13:58.602959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.603336 (+   377us) service_pool.cc:224] Handling call
0709 12:13:58.641554 (+ 38218us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:59.129121 (+487567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:59.129161 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:59.178515 (+ 49354us) log.cc:844] Serialized 52 byte log entry
0709 12:13:59.502664 (+324149us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:59.703101 (+200437us) log.cc:844] Serialized 14 byte log entry
0709 12:13:59.722311 (+ 19210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.722383 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.722614 (+   231us) raft_consensus.cc:1685] finished
0709 12:13:59.722629 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.722778 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45078,"prepare.queue_time_us":159400,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":159509,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":150653,"thread_start_us":790779,"threads_started":3,"wal-append.queue_time_us":316551}
W20260709 12:13:59.763476  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 173022us
I20260709 12:13:59.716514 11306 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.746817 11041 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.704227 11303 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:13:59.722584 11282 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.881260  8996 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:13:59.881237  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.883033  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.883553  8992 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:59.808549  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.756088 11295 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:13:59.889432  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 435) took 1365 ms. Trace:
I20260709 12:13:59.889968  8999 rpcz_store.cc:276] 0709 12:13:58.524903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.525122 (+   219us) service_pool.cc:224] Handling call
0709 12:13:58.557039 (+ 31917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:58.557491 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.557525 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:58.626738 (+ 69213us) log.cc:844] Serialized 52 byte log entry
0709 12:13:59.367024 (+740286us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:59.579357 (+212333us) log.cc:844] Serialized 14 byte log entry
0709 12:13:59.582545 (+  3188us) log.cc:844] Serialized 14 byte log entry
0709 12:13:59.587605 (+  5060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:59.587723 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.889146 (+301423us) raft_consensus.cc:1685] finished
0709 12:13:59.889175 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.889353 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3756,"prepare.queue_time_us":374758,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":145709,"raft.run_cpu_time_us":545,"raft.run_wall_time_us":232873,"thread_start_us":868891,"threads_started":2,"wal-append.queue_time_us":828490}
I20260709 12:13:59.897135 11240 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.883826  8996 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:13:59.803609  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:13:59.883492  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 317) took 1924 ms (client timeout 2076 ms). Trace:
W20260709 12:13:59.803225 11298 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:13:59.902119  8922 rpcz_store.cc:269] 0709 12:13:57.945360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.945488 (+   128us) service_pool.cc:224] Handling call
0709 12:13:59.869940 (+1924452us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400019354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:59.870107 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472518528}
I20260709 12:13:59.903211  8997 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:13:59.911542  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:13:59.912834  9000 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:13:59.912133 11306 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:13:59.872450 11313 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:13:59.775839 11005 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:13:59.864713 11263 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:13:59.871518 11312 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:59.942862  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 439) took 1319 ms. Trace:
I20260709 12:13:59.873083 11108 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:13:59.871974  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:13:59.971468  8992 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:59.979506  8998 rpcz_store.cc:276] 0709 12:13:58.625741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.641503 (+ 15762us) service_pool.cc:224] Handling call
0709 12:13:59.942553 (+1301050us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400324454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:13:59.942772 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565276544}
I20260709 12:13:59.911877 11239 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:59.962173 11228 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 12:13:59.985700 11108 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.014030  8998 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:13:59.918238 11306 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.014605  8998 pending_rounds.cc:85] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 2
I20260709 12:13:59.969491 11041 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:13:59.982131 11092 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.016847  8998 pending_rounds.cc:107] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:00.022135  8998 raft_consensus.cc:2889] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.022792  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.023957  8999 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:00.025990  8992 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:00.018474 11313 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.029613  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 210010us
I20260709 12:13:59.983213 11005 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:13:59.984336 11312 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.026674 11320 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:00.029170 11228 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.032099 10639 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.040249 11108 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.040378  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.041065  9624 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:00.041543  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.043571 10898 raft_consensus.cc:2764] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:00.045786 11312 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.030872 11317 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:13:59.987512 11239 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.032569 11313 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.051005  8999 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.089196  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.087580  9623 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:00.162051  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.166595  9000 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:00.067291  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.164083  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 436) took 1624 ms. Trace:
I20260709 12:14:00.089036  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.165660  8998 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.174242  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2041) took 1070 ms. Trace:
I20260709 12:14:00.189499  8992 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.191605  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:00.172093  8993 rpcz_store.cc:276] 0709 12:13:58.539804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.556429 (+ 16625us) service_pool.cc:224] Handling call
0709 12:14:00.145716 (+1589287us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540039add4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:00.164019 (+ 18303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747419392}
I20260709 12:14:00.189613  9066 rpcz_store.cc:276] 0709 12:13:59.103525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.304348 (+200823us) service_pool.cc:224] Handling call
0709 12:14:00.165334 (+860986us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001b6054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:00.174162 (+  8828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646344960}
I20260709 12:14:00.195024  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:00.196100 11009 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:00.192632 11199 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:00.196768 11009 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.197184 11199 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.037015 11320 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.199903 11288 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.200500 11288 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.201243 11320 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:00.075599 11246 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.004s
I20260709 12:14:00.161044 11005 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:00.203081  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.049494 11041 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.097347 11214 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:00.208179  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.075614 10854 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:00.093436  9616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 367) took 2035 ms (client timeout 1705 ms). Trace:
I20260709 12:14:00.091729 11217 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:00.213749  9069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2033) took 2183 ms (client timeout 2709 ms). Trace:
I20260709 12:14:00.089541  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:00.215626  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.053606 11240 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.192838 11283 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:00.221827  9069 rpcz_store.cc:269] 0709 12:13:58.030369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.227013 (+196644us) service_pool.cc:224] Handling call
0709 12:14:00.213525 (+1986512us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002d4bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:00.213678 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481387776}
W20260709 12:14:00.222985  9622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 365) took 2177 ms (client timeout 1660 ms). Trace:
I20260709 12:14:00.065079 11228 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:00.257712  9622 rpcz_store.cc:269] 0709 12:13:58.036619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.036792 (+   173us) service_pool.cc:224] Handling call
0709 12:14:00.214016 (+2177224us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54006ab8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:00.214136 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903499520}
I20260709 12:14:00.231731 11282 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:00.213090 11108 raft_consensus.cc:2764] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:00.213233 11214 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:00.270399  9615 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.257723 11264 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.209141 11246 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.255797 11199 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.259066 11240 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.270727 11321 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.289336  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.221593 11041 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.193523 11317 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.255009 10854 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.307173 11217 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.307731 11217 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.309257 10854 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.309859 11217 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:00.314538 11266 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.894s	user 0.005s	sys 0.015s
W20260709 12:14:00.221977  9616 rpcz_store.cc:269] 0709 12:13:58.057795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.116603 (+ 58808us) service_pool.cc:224] Handling call
0709 12:14:00.093177 (+1976574us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004cf754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:00.093336 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3282040064}
I20260709 12:14:00.303005 11240 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.317806 11240 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.260013 11283 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.322386  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.324376  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:00.325953 11315 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:14:00.325865  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.327209  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:00.327960  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:00.332063  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.290012 11282 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:00.329192  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.348654  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.349576  8919 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.305089 11199 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.351210  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.353410  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:00.305248 11264 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:00.354843  8916 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.355631  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.359738  8920 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 2: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:00.360668  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.361553  8925 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:00.365474  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:00.367255  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 175716us
I20260709 12:14:00.304397 11321 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.387742  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.388705  8921 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.364195 11005 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:00.440300  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.439225  8918 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.387027 11288 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.465384 11239 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.466802 11265 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:00.456990  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2510) took 2471 ms. Trace:
I20260709 12:14:00.388056 10639 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:00.387907 11199 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:00.487620 11283 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.356858 11108 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:14:00.468216  9068 rpcz_store.cc:276] 0709 12:13:57.980304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.980401 (+    97us) service_pool.cc:224] Handling call
0709 12:13:57.980665 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.981414 (+   749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.981441 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:57.986194 (+  4753us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.257682 (+271488us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:58.257739 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.257835 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.313795 (+2055960us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:00.437007 (+123212us) raft_consensus.cc:1685] finished
0709 12:14:00.437033 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.451971 (+ 14938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":373,"raft.queue_time_us":652,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7189,"spinlock_wait_cycles":54186752,"thread_start_us":59846,"threads_started":1,"wal-append.queue_time_us":142095}
I20260709 12:14:00.440594 11287 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:00.479688  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.490991 11207 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:00.491415 11207 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:00.492376 11207 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.473878 10854 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:14:00.484308 11041 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.474154 11265 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.485088 11317 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.476250 10639 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.485630 11282 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.478829 11246 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.503746  8924 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.486840 11005 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:00.358539 11214 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.479480 11197 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:00.506593  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.510316  9065 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 1.
I20260709 12:14:00.482231 11321 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.507833  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:00.506093 11207 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.507639  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.517514  9070 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:00.512084  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.513556  8916 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.514946  9066 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:00.503896  8821 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 5, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:00.483804 11228 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.487890 11199 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.520370  8821 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 4 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.529846  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:00.535741  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:00.536417  9072 raft_consensus.cc:2376] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5. Re-sending same reply.
I20260709 12:14:00.536655 10639 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.544667 11283 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:00.545259 11283 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:00.546334  8964 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.948s (SENT)
I20260709 12:14:00.546732  8918 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.547689 11283 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.547456  9066 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:00.546974  8964 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:00.547385 11092 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.521560 11214 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.479884 11264 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.533658  8821 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:00.566344  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:00.565431  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 114179us
I20260709 12:14:00.569854  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.581584  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.568542 11283 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:00.583410 11283 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.584002 11283 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.584481  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:00.553489 11092 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.591794  9068 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:00.586905 11283 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:00.579489  8821 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 3, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 3 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.607088  9068 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.609218  9040 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.609398  8821 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 4, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 4 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:00.611066  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 231380us
I20260709 12:14:00.611878  8916 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:00.612967  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:00.614868  8999 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:00.616537  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.617130  8991 raft_consensus.cc:2376] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5. Re-sending same reply.
I20260709 12:14:00.568789  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.622372  8821 catalog_manager.cc:5697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 2, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 2 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:00.624051  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53839.9us
W20260709 12:14:00.624101  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59888.4us
I20260709 12:14:00.628832  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:00.629357  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.629881  9066 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:00.598677 11327 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:00.624186 11326 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:00.628023  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.635684  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.632623  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.625624  9069 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:00.628134  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.625486  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:00.636740  8999 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:00.639089  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:00.636281  8992 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:00.640713  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.640782  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.641215  8992 raft_consensus.cc:2376] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6. Re-sending same reply.
I20260709 12:14:00.641613  8991 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:14:00.643642 11103 raft_consensus.cc:2764] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:00.644272 11289 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.644513  9620 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:00.644716 11289 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.645126 11289 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.605000 11005 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.647441  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.647869  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.650228  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.651453  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.652932  9069 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:00.658456  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.648051 11317 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:00.667412  9070 raft_consensus.cc:2368] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:14:00.629262 11333 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.672026  8991 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:00.648505 11197 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.648707 11176 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:00.673789  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.617552 11009 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.680135  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.681033  9622 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:00.681938  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.674562  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.670580 11103 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:00.649247 11335 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:00.697206  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.697651  8916 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:00.698115  8992 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:00.652782 11238 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:00.649571 11327 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:00.678074  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:00.712211  9074 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.684779  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:00.692137  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.714321  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.715423  9071 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:14:00.694159 11332 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:00.694526  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:00.720074  9623 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:00.694877 11297 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.058s	user 0.011s	sys 0.003s
I20260709 12:14:00.695528  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.725188  8991 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.695653  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.669544 11333 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.679937 11176 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.679365 11283 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.728778  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:00.658087 11041 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:00.678397 11092 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.746863  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.691263 11103 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.750623  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.753940  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.753940  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.755923  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.756572  8992 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.757360  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.757848  8992 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.759018  8999 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:00.760458  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.761530  8999 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:00.750720  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:00.713575  9037 connection.cc:256] RPC call timeout handler was delayed by -1.100306755000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 12:14:00.766722  9037 connection.cc:256] RPC call timeout handler was delayed by -1.029206755000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:14:00.771052  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.771832  8993 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:00.771872  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.772377 11103 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.772835  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.773401  8993 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.772585  9622 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.775727  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.775906  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.776875  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.776885  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:00.774232  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.778553  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.779137  9000 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:14:00.712806 11238 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.789685  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.786657  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:00.753027 11292 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.409s	user 0.000s	sys 0.006s
I20260709 12:14:00.792912  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.793808  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1069) took 1048 ms. Trace:
I20260709 12:14:00.795208  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.797158  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.799546  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.800525  8993 raft_consensus.cc:2376] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3. Re-sending same reply.
I20260709 12:14:00.800810  8999 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:00.793251  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.802438  9071 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:00.803231  8889 leader_election.cc:400] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:14:00.803277  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:00.803740  8889 leader_election.cc:403] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:00.803995  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:00.804454  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:00.806059 11308 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
I20260709 12:14:00.806846 11317 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:00.797763  8994 rpcz_store.cc:276] 0709 12:13:59.745382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.751329 (+  5947us) service_pool.cc:224] Handling call
0709 12:14:00.059466 (+308137us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:00.071917 (+ 12451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.072439 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:00.190225 (+117786us) log.cc:844] Serialized 14 byte log entry
0709 12:14:00.437738 (+247513us) log.cc:844] Serialized 14 byte log entry
0709 12:14:00.439566 (+  1828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.451813 (+ 12247us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.451946 (+   133us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:00.451987 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.452056 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.793532 (+341476us) raft_consensus.cc:1685] finished
0709 12:14:00.793566 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.793733 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1623,"prepare.queue_time_us":116924,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":2645,"raft.queue_time_us":80139,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":67121,"spinlock_wait_cycles":45718144,"thread_start_us":163309,"threads_started":1,"wal-append.queue_time_us":296971}
I20260709 12:14:00.810928  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.747100 11265 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:00.801815 11220 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:00.802409  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.823884  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.825083  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.785306 11108 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:00.837419  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.747637 11333 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.814725  9000 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.801815  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.815598  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.841184  8999 raft_consensus.cc:2376] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4. Re-sending same reply.
I20260709 12:14:00.817267  8991 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:00.815999  9074 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:00.842120  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.811983  8994 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.794402 11238 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.792449 11028 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:00.844337  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.845026  9623 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.842784  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.724086 11340 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:00.822846  8992 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.769711 11176 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:00.811827 11229 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:00.850963  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.850517  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.859588  8993 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:00.856387  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.764652 11283 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.859076  8991 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.864605  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 431) took 2344 ms. Trace:
I20260709 12:14:00.876089  8996 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:00.865034  8995 rpcz_store.cc:276] 0709 12:13:58.509472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.509592 (+   120us) service_pool.cc:224] Handling call
0709 12:13:58.525255 (+ 15663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:59.477479 (+952224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.853132 (+1375653us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54002373d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:00.853310 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091063040}
I20260709 12:14:00.840891 11317 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.837654 11108 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:00.881824  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.887712  8995 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:00.840025 11265 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.885130 11317 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.852741 11028 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.858049  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:00.902113  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.903000  8995 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:00.894655  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.906837  8994 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:00.878954 11111 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:00.920949  9040 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:00.895010  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 91804.8us
I20260709 12:14:00.890489 11108 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.855515 11246 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:14:00.898173  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.933007  8991 raft_consensus.cc:2376] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4. Re-sending same reply.
I20260709 12:14:00.899573 11317 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:00.937234  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.899204 11275 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.938066  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:00.948333 11287 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:00.937260  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.949405  8995 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:00.902045 11028 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.944684  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.946338  8918 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:00.947037 11353 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.954133  8994 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:00.954282 11353 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:00.955170  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.955331 11353 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.955963  8994 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.956640  9068 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:00.866333 11340 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.963274  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.964238  8991 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:00.969276  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 151320us
I20260709 12:14:00.939015  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:00.939507 11111 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:00.973631  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:00.971653  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:00.977896  8995 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:00.898890 11265 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:00.979193  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:00.984903  8991 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:00.856364 11327 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:00.989142  8997 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:00.979812 11331 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:14:00.970027 11229 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:00.993403  8995 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.016520 11313 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.019361  8998 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.011629  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:01.020718  9066 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:00.961859 11335 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:14:01.018811  9616 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:01.007503 11278 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:01.025291 11342 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:14:01.054551  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.056578  8994 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:01.060284  8998 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:01.061888  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.038834 11041 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.064076  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.064298  8998 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:14:01.067121  8998 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.068627  8998 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:01.064853  8994 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:01.084359  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 112844us
W20260709 12:14:01.084725 11344 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:14:01.058733 11278 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.072971 11041 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:01.087553  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.057490 11009 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.095146  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.039268 11313 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:14:01.062667 11287 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:01.102551  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:01.121892  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 193682us
I20260709 12:14:01.101727 11041 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.100539 11283 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:01.152009  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49537.2us
I20260709 12:14:01.162756  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.163509  8998 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:01.163787  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.060853 11111 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:01.161222  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 135533us
I20260709 12:14:01.141207  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 665) took 1106 ms. Trace:
I20260709 12:14:01.170490  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.151203 11361 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.159415 11360 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.184849 11360 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.171067  9617 rpcz_store.cc:276] 0709 12:14:00.033376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.033963 (+   587us) service_pool.cc:224] Handling call
0709 12:14:00.052223 (+ 18260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.188845 (+136622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.195317 (+  6472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.266806 (+ 71489us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.517517 (+250711us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:00.522725 (+  5208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.528318 (+  5593us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:01.105750 (+577432us) raft_consensus.cc:1685] finished
0709 12:14:01.105781 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.139841 (+ 34060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120226,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5513,"thread_start_us":202658,"threads_started":1,"wal-append.queue_time_us":299477}
I20260709 12:14:01.190975 11360 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:01.192131 11351 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.170s	user 0.003s	sys 0.000s
I20260709 12:14:01.105926 11229 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.167580 11365 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.206851  8995 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:01.183107 11265 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.187883 11359 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.191141 11103 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.225148 11283 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.242458 11358 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
I20260709 12:14:01.182637 11340 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.186275 11287 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:01.245203 11354 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 12:14:01.247342 11009 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.198609 11364 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:14:01.179853 11355 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:14:01.174011 11353 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:14:01.260668  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.311674  8993 raft_consensus.cc:2368] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4.
W20260709 12:14:01.311791  9615 consensus_meta.cc:287] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.003s
I20260709 12:14:01.312250  9615 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:01.312824  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 670) took 1224 ms. Trace:
I20260709 12:14:01.312923  8993 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:01.313211  9615 rpcz_store.cc:276] 0709 12:14:00.088569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.089236 (+   667us) service_pool.cc:224] Handling call
0709 12:14:01.312760 (+1223524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:01.313897 10639 raft_consensus.cc:2764] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:14:01.321266 11289 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260709 12:14:01.321784 11289 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.168943 11176 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.325593 11176 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.240828 11359 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:01.290385  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 672) took 1087 ms. Trace:
I20260709 12:14:01.360702  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:01.295025  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 346313us
W20260709 12:14:01.301730  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 124614us
I20260709 12:14:01.302579  9073 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.302769 11197 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:01.304404  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 133964us
I20260709 12:14:01.225382 11341 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.306456  8998 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:01.306604  9072 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:01.309497 11278 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.310226  9622 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.296162 11334 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:01.281095  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 159038us
I20260709 12:14:01.318384 11041 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.361928  8993 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:01.371803 11197 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.274106 11362 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 12:14:01.379580 11341 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.381903 11341 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.383212 11289 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.305269 11009 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.384052 11009 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.384517 11197 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.386847 11197 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.390998  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.392159  8924 raft_consensus.cc:2368] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
W20260709 12:14:01.327252 11214 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.000s
I20260709 12:14:01.361347  9624 rpcz_store.cc:276] 0709 12:14:00.202387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.203328 (+   941us) service_pool.cc:224] Handling call
0709 12:14:00.211183 (+  7855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.211430 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:00.216523 (+  5093us) log.cc:844] Serialized 14 byte log entry
0709 12:14:00.448440 (+231917us) log.cc:844] Serialized 14 byte log entry
0709 12:14:00.974794 (+526354us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b1800353260. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:01.285262 (+310468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.286106 (+   844us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:01.286665 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.287433 (+   768us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.289467 (+  2034us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6446,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":19627,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":22519,"spinlock_wait_cycles":43608448,"thread_start_us":539993,"threads_started":2,"wal-append.queue_time_us":290038}
I20260709 12:14:01.407632  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:01.422516  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:01.422875 11103 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:01.365926 11263 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.295917 11283 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.274219 11317 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.366132 11359 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:01.706454  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 340687us
W20260709 12:14:01.590591  8964 leader_election.cc:336] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.500s (SENT)
I20260709 12:14:01.806635  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:01.437729  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.633562  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:01.708185  8993 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.435765  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:01.425143  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:01.424024  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:01.731841  9590 leader_election.cc:400] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
I20260709 12:14:01.806618  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:01.807331  8998 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
W20260709 12:14:01.837970  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 129694us
W20260709 12:14:01.519168 11207 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.997s	user 0.013s	sys 0.000s
W20260709 12:14:01.571096 11028 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.003s
W20260709 12:14:01.510847 11333 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.003s
W20260709 12:14:01.688071 11108 consensus_meta.cc:287] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.000s
I20260709 12:14:01.555972  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:01.518395 11289 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.517530 11368 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:01.842311  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.843009  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.805683  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:01.856382  8994 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:01.836069 11377 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.561007  9615 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
W20260709 12:14:01.835582 11238 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.016s
I20260709 12:14:01.840550  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.435398  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.835726 11327 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:14:01.850171  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:01.808979 11382 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 12:14:01.705561 11225 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:01.855660  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.435307  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:01.856932  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51384.9us
I20260709 12:14:01.856472  8999 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:01.858843  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:01.862303  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.806456 11263 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.873664  8993 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:14:01.875769  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.875860  8998 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:01.903124  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:01.874464  8917 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:01.866168 11377 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.852392 11028 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.876973 11225 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:01.919109 11350 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.903s	user 0.003s	sys 0.000s
I20260709 12:14:01.867555 11375 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.856074 11233 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:01.854490 11108 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:01.863456 11238 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.923545 11108 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.924525 11377 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.911661 11378 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.925377 11238 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.851776 11333 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.890630  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.926668 10854 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:01.926792  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46417.5us
I20260709 12:14:01.927074 10854 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:01.890646  8996 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:01.927502 10854 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.928176  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.928566 11225 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.929423 11263 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.929778  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.930696 11135 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:01.931457 11135 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:01.931989 11135 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:01.932893 11135 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.863834 11041 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:01.860806 11207 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.934681 11207 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.935063 11207 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:01.907052  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 48300.6us
I20260709 12:14:01.935734 11028 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:01.891743  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.908188  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:01.910184  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.857784 11289 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:01.913781  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.916986  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2537) took 1218 ms. Trace:
I20260709 12:14:01.933459 11333 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:01.905818  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.938773  8994 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:01.939082  8920 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:01.938915  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.941294  9071 rpcz_store.cc:276] 0709 12:14:00.698980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.806694 (+107714us) service_pool.cc:224] Handling call
0709 12:14:00.807033 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.818235 (+ 11202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:00.850785 (+ 32550us) log.cc:844] Serialized 14 byte log entry
0709 12:14:01.244658 (+393873us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:01.381517 (+136859us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b48002601d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:01.916488 (+534971us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b18003e9740. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287
0709 12:14:01.916588 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:01.916637 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:01.916679 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.916749 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.916893 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38342,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":71796,"raft.run_cpu_time_us":2579,"raft.run_wall_time_us":354975,"spinlock_wait_cycles":74856704,"thread_start_us":190097,"threads_started":2,"wal-append.queue_time_us":140282}
I20260709 12:14:01.943507  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:01.948655  8995 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.948866 11374 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.950243  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:01.956939  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:01.957080  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:01.957793  8996 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:01.958506  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:01.949406 11374 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:01.962944  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.964884  8925 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.898218  9617 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:01.967015  8920 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:01.972069  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:01.937415  8917 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:01.973704  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2544) took 1173 ms. Trace:
I20260709 12:14:01.976352  8995 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:01.976995  9068 rpcz_store.cc:276] 0709 12:14:00.800610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.961669 (+161059us) service_pool.cc:224] Handling call
0709 12:14:00.962753 (+  1084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.183004 (+220251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.183034 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.183579 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:14:01.281863 (+ 98284us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:01.281903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.281983 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:01.973489 (+691506us) raft_consensus.cc:1685] finished
0709 12:14:01.973513 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.973642 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89079,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6450,"thread_start_us":272673,"threads_started":2,"wal-append.queue_time_us":234212}
I20260709 12:14:01.979046  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:01.979660  8996 raft_consensus.cc:2376] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:14:01.970779 11349 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:01.994056  8921 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:01.970985 11374 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.963021 11333 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.037482  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.065793  8995 raft_consensus.cc:2410] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:14:02.039176  8888 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.595s (SENT)
I20260709 12:14:01.973562  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:02.055800  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.056103  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.067067  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.038363  8925 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:02.067772  8996 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:02.067508  8993 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:02.065672 11333 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.087670 11333 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.089972 11288 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.090473 11288 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:02.090865 11288 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.092515  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.093461  8996 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:02.094937  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:02.100900 11263 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.144553 11263 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.098186  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:02.147398 11228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.502s	user 0.013s	sys 0.007s
I20260709 12:14:02.147555  8921 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
W20260709 12:14:02.147776 11228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.013s	sys 0.007s
I20260709 12:14:02.096987  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.151072  8999 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.096333  8993 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
W20260709 12:14:02.103945  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64824.6us
W20260709 12:14:02.104256 11390 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:14:02.104394 11367 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.102105 11343 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.106637  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2542) took 1358 ms. Trace:
I20260709 12:14:02.166507  9066 rpcz_store.cc:276] 0709 12:14:00.748810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.853771 (+104961us) service_pool.cc:224] Handling call
0709 12:14:00.854070 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.021206 (+167136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.106399 (+1085193us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001b6554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:02.106579 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330350464}
I20260709 12:14:02.095614  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.100059  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:02.127812  8966 connection.cc:256] RPC call timeout handler was delayed by -1.7645183939998788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:14:02.132592  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.168892  8995 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:02.148110  9587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.018s
W20260709 12:14:02.170069  9587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.018s
I20260709 12:14:02.094758  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.170696  8998 raft_consensus.cc:2376] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3. Re-sending same reply.
W20260709 12:14:02.170826  8888 leader_election.cc:336] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.893s (SENT)
I20260709 12:14:02.149279 11263 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.168155  8994 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:02.155508  8993 pending_rounds.cc:85] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 3
I20260709 12:14:02.181505  8993 pending_rounds.cc:107] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 2.4
I20260709 12:14:02.181842  8993 raft_consensus.cc:2889] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.148561  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.171460  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.184259 11366 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:02.171801  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 534323us
W20260709 12:14:02.186945  9587 leader_election.cc:336] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.540s (SENT)
I20260709 12:14:02.187547  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.188520 11028 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.193938 11366 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:02.172292  8966 connection.cc:256] RPC call timeout handler was delayed by -1.1615183939998133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2701s for a response
W20260709 12:14:02.196448  8966 connection.cc:256] RPC call timeout handler was delayed by -1.0418183939998471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28340000000000004s for a response
I20260709 12:14:02.197331  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.199103 11306 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:02.202147 11041 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:02.205021 11278 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:02.141104 11009 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.002s
I20260709 12:14:02.208863  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.138957 11340 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.077950 11317 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:02.138582  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:02.179569 11327 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.139469 11359 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.223078 11263 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.218899  8995 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:02.224103  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.220508 11283 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.177709  8999 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:02.247864  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.248488  8995 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.250099  8999 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:14:02.251641  8999 pending_rounds.cc:85] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 5
I20260709 12:14:02.252028  8999 pending_rounds.cc:107] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:14:02.252379  8999 raft_consensus.cc:2889] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.255838  9621 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:02.236877 11340 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.207994 11343 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.221254 11009 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.232673 11040 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:02.235867 11214 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:14:02.263361 11283 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:02.276840 11389 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.375s	user 0.001s	sys 0.001s
I20260709 12:14:02.268302 10854 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.243482 11327 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.253216 11108 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:02.265565 11238 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:02.283744 11289 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:02.241024  9619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.023s	sys 0.024s
W20260709 12:14:02.277796  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 319306us
I20260709 12:14:02.280046 11028 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:14:02.320978  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.311187  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.322141 11317 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.324246 11359 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.324712  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.325755 11207 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.326893  9066 raft_consensus.cc:2368] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5.
I20260709 12:14:02.327054 10854 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:02.330569  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1098) took 1544 ms (client timeout 1871 ms). Trace:
W20260709 12:14:02.331137  8997 rpcz_store.cc:269] 0709 12:14:00.786677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.797989 (+ 11312us) service_pool.cc:224] Handling call
0709 12:14:02.319689 (+1521700us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400290254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:02.330468 (+ 10779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345403648}
W20260709 12:14:02.310590  9619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.023s	sys 0.024s
I20260709 12:14:02.334100  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.337695  8995 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:02.322650 11317 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:02.316681 11349 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:02.341506  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.342756  9070 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:02.338696 11392 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 12:14:02.338547 11385 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 12:14:02.345925  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:02.347395  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 756809us
I20260709 12:14:02.340502  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:02.340531 11264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.644s	user 0.000s	sys 0.015s
I20260709 12:14:02.319751 11289 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:14:02.352574  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.352744  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.343636 11317 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.357749  9068 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:02.354102  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.359303  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.363147  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.363299  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.363896  9067 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:02.355460 11264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.000s	sys 0.016s
I20260709 12:14:02.365971  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.366567  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.367012  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.369160  9067 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:02.368345  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.370508  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.372368  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.373088  9074 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:02.356949 11214 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:02.376303  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.379793  9065 raft_consensus.cc:2368] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:14:02.372522  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.381049  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.358979 11367 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.381687  9069 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:02.384027  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:02.367542 11040 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.372080 11225 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:02.409986  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61192.6us
W20260709 12:14:02.433079  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 181909us
I20260709 12:14:02.404078  9071 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.377009 11207 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.444649  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.403952  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2533) took 1723 ms. Trace:
I20260709 12:14:02.378219 11378 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:02.448438  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.380992  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:02.456035  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.457196  8999 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:02.457458  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.458762  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.459573  8999 raft_consensus.cc:2376] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5. Re-sending same reply.
I20260709 12:14:02.460361  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.461131  8994 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.448087  9072 rpcz_store.cc:276] 0709 12:14:00.680263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.704606 (+ 24343us) service_pool.cc:224] Handling call
0709 12:14:02.403710 (+1699104us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54000e83d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:02.403886 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268703360}
I20260709 12:14:02.371899 11303 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:02.467547  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.470410  8998 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:02.392182 11377 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.392310 11321 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:02.479496  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.477770  8994 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:02.403663 11108 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.386430 11214 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:02.478609  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:02.505016  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:02.498539  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50213.1us
I20260709 12:14:02.559827  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.509887  8997 raft_consensus.cc:2368] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3.
I20260709 12:14:02.480396  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.392652 11040 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.591362  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:02.497459 11402 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:14:02.461895 11264 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.442651 11233 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:14:02.464937 11375 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.503760 11406 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:02.444574 11349 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.497890 11412 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.463475 11009 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.406104 11225 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.471323 11207 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:02.597831  8995 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:02.654857  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.552008 11409 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:02.624238  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.553750  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 677) took 1117 ms. Trace:
I20260709 12:14:02.615600  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.626320  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:02.637925  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 250257us
I20260709 12:14:02.660142  9624 rpcz_store.cc:276] 0709 12:14:01.436243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.436419 (+   176us) service_pool.cc:224] Handling call
0709 12:14:02.504851 (+1068432us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:02.553678 (+ 48827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9213184}
I20260709 12:14:02.547227 11327 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.463990 11374 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.462519 11333 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.641260  8996 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:02.642464  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.711s (SENT) [suppressed 45 similar messages]
I20260709 12:14:02.549168 11378 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:02.644102  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.675876  8997 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.507864 11312 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:14:02.636293 11375 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:02.496531 11398 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:14:02.627967 11040 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.623893 11321 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:02.622893  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:02.660458  8998 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.662102  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:02.665460  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:02.609133 11108 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.655903  8995 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:02.622383 10639 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:02.654196 11225 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.556283 10854 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:14:02.656109 11343 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.656916 11233 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:02.628746 11229 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:02.686292 11375 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.703794  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.664783 11009 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.639582 11264 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:02.705940 11275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.690s	user 0.029s	sys 0.082s
I20260709 12:14:02.711342  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.714962  9621 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:02.658108 11207 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:02.712664  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 50728.3us
I20260709 12:14:02.718425  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:02.718523  9070 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:02.709525 11233 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:02.722869 11408 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:14:02.714360 11275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.767s	user 0.029s	sys 0.083s
I20260709 12:14:02.726922  8998 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:02.727285 11418 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.673934 11409 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:02.727662 11401 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:14:02.761235 11338 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 2.065s	user 0.003s	sys 0.005s
I20260709 12:14:02.652486 11406 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.730436 11343 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:02.730695 11264 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.713567 11278 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.739730  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:02.723191 11405 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:14:02.768424  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 152918us
I20260709 12:14:02.770994  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1196) took 2462 ms. Trace:
I20260709 12:14:02.774286  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.743664 11275 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:02.710292 11214 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.755317 11418 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.770920 10854 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.778699  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:02.772836  8923 rpcz_store.cc:276] 0709 12:14:00.304812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.305001 (+   189us) service_pool.cc:224] Handling call
0709 12:14:00.540898 (+235897us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:00.541091 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.541490 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.541516 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.541993 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.630368 (+ 88375us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:00.630420 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.630486 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:02.723718 (+2093232us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:02.766942 (+ 43224us) raft_consensus.cc:1685] finished
0709 12:14:02.766966 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.767120 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1112,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":38073344,"thread_start_us":85278,"threads_started":1,"wal-append.queue_time_us":138682}
W20260709 12:14:02.775439 11288 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
I20260709 12:14:02.766628 11343 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.769558 11263 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.777566 11009 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.772343 11283 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:02.787930  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:14:02.798477  9037 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.542s (SENT)
I20260709 12:14:02.788985 11374 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.786211 11288 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.783026 11280 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.792841 11406 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.793426 11263 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.790586  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.784651 11353 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:02.799657  9037 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.723s (SENT)
I20260709 12:14:02.801101  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.756927 11321 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.799540  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.783855 11418 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.805756 11275 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.829659  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.804389 11404 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.810259  8992 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:02.839280  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.842687  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.810057  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.801810  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.794783 11233 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.785869 10854 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:02.817750  9616 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
W20260709 12:14:02.818991 11399 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.430s	user 0.002s	sys 0.002s
I20260709 12:14:02.723217 11378 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:02.820497 11263 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:02.824777  8997 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:02.825156  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.826057 11108 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:02.807044 11288 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.827275 11333 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.828393 11409 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.843858  8923 raft_consensus.cc:2376] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8. Re-sending same reply.
I20260709 12:14:02.841513 11404 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.863664  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.802953 11283 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.845818  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 381) took 1989 ms. Trace:
I20260709 12:14:02.863399 11233 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.865926  9623 rpcz_store.cc:276] 0709 12:14:00.856013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.856155 (+   142us) service_pool.cc:224] Handling call
0709 12:14:02.845576 (+1989421us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400770454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:02.845745 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301746432}
I20260709 12:14:02.849423  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.866498  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.830912  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.867543  8918 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:02.867712  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.868512  8921 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:02.868606  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.869268  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.869768  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.870268  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.871961  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.852473  9616 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:02.874224 10898 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.878171 11040 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.856336 11429 raft_consensus.cc:2764] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:02.858315  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:02.880144 11429 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.880764 11429 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.881229 11040 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.881829  8922 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:02.844213  8993 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.879230  8921 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:02.855710  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56084.4us
W20260709 12:14:02.889397  9037 leader_election.cc:336] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.871s (SENT)
I20260709 12:14:02.889802  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.891438  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.892031  9068 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.893460  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:02.893611  8993 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:02.856464 11353 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.897033  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2529) took 2241 ms. Trace:
I20260709 12:14:02.899693  9073 rpcz_store.cc:276] 0709 12:14:00.655916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.656055 (+   139us) service_pool.cc:224] Handling call
0709 12:14:00.656406 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.371537 (+715131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.896836 (+1525299us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54001b7454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:02.896981 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485520640}
I20260709 12:14:02.897173  9070 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:02.901094  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.902596  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.901506  9072 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.902829  9073 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:02.864166 11404 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.903493  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:02.911455  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:02.913589  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.913904  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.921232 11009 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:02.928433  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2347) took 1980 ms. Trace:
I20260709 12:14:02.929270 11288 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.931550 10854 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.936048 11374 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.936733  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.937747  9072 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:02.938585  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.938745 11283 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.928841  8991 rpcz_store.cc:276] 0709 12:14:00.947708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.015067 (+ 67359us) service_pool.cc:224] Handling call
0709 12:14:02.319905 (+1304838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.320184 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:02.536551 (+216367us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.801104 (+264553us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.803985 (+  2881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.804226 (+   241us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:02.804280 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.804339 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.928245 (+123906us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400290250. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:02.928370 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2638,"prepare.queue_time_us":361161,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":8321,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":184,"spinlock_wait_cycles":2951619968,"thread_start_us":459611,"threads_started":3,"wal-append.queue_time_us":222454}
I20260709 12:14:02.940438  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 340) took 1085 ms. Trace:
I20260709 12:14:02.900969 11207 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:02.901094 11135 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.940848  8919 rpcz_store.cc:276] 0709 12:14:01.854802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.854976 (+   174us) service_pool.cc:224] Handling call
0709 12:14:01.866812 (+ 11836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.938191 (+ 71379us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:01.957124 (+ 18933us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.311729 (+354605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.311795 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:02.311855 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.940206 (+628351us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540008b6d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:02.940249 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.940366 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5564,"prepare.queue_time_us":18701,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":11493,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14144,"spinlock_wait_cycles":163328256,"thread_start_us":348559,"threads_started":1,"wal-append.queue_time_us":394038}
I20260709 12:14:02.949175  9072 raft_consensus.cc:2410] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:02.948443  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.952239  8922 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.915506 11343 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:02.915676 11406 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:02.948083  9037 leader_election.cc:400] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3.
I20260709 12:14:02.963467  9070 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:02.962443  9037 leader_election.cc:403] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:02.960913  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:02.959748  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 87880.7us
I20260709 12:14:02.960561  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.966252  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:02.967183  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50307.5us
I20260709 12:14:02.961874  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:02.967985  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:02.969162  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.957068  9068 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 2.
I20260709 12:14:02.971431 11343 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.971578 11135 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.971823  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.972043 11135 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.972484 11135 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.972307 11353 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:02.974493 11343 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.975898  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:02.978667  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.979066  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.979261  8993 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.979851  8992 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:02.979728 11225 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.980790 11343 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.981158 11343 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.981479 11343 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.981900 11225 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:02.983562  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:02.984117  8997 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.984480 11327 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:02.986675 11135 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.987888  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.939033 11418 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:02.990031  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.998371  8922 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:03.001205  9072 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:03.001928  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:02.994889  8993 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:03.002064  8925 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:03.002751  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:03.003582  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:02.998425  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:03.004194  8992 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:03.006433  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:03.007382  8991 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.965797 11406 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:02.989647 11287 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.014755  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:03.015820  8919 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:02.997442  8997 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:03.016508  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:02.998225 11283 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:03.005945 11434 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.023852  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.015403 11406 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.033789  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:03.014098 11207 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.014277 11263 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.034466  8922 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:03.003104 11327 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:14:03.037664  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:03.044178 11377 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:14:03.044668 11377 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.045750  8920 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:03.038166  9000 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:03.011869 11341 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:14:03.047446 11341 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.048506 11341 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.048929 11341 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:03.049073  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:03.052803 11411 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.053699  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:03.053442 11375 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.037113  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.070770 11321 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:03.071595 11321 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.076221 11135 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.076383 11418 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.076861 11207 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.027505 11283 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.077849 11207 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.035113 11433 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.080718 11433 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:03.081099 11433 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.060842 11343 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.086094 11280 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:03.086603 11280 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.087646  8993 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:03.074452 11317 consensus_meta.cc:287] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.003s
W20260709 12:14:03.089731  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53440.9us
I20260709 12:14:03.095785 11343 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:03.074402 11321 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.101917  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 683) took 1287 ms. Trace:
I20260709 12:14:03.104632  9622 rpcz_store.cc:276] 0709 12:14:01.814687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.866965 (+ 52278us) service_pool.cc:224] Handling call
0709 12:14:03.101718 (+1234753us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004cf754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:03.101856 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312772352}
I20260709 12:14:03.094046  8991 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:03.100036  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:03.106443  8925 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.079919 11283 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.052721 11406 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:03.117398  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64979.8us
I20260709 12:14:03.119212  9040 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:03.099920 11375 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:03.136488  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:03.137288  8991 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.096524 11263 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.123581  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:03.141938  8925 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:03.143013  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:03.152383  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.155278  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:03.158509  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.163985  8991 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:03.096441 11317 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.165748  8925 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:03.156440 11327 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.159886 11353 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.194876  8921 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:03.166765 11374 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.172300 11287 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3.
I20260709 12:14:03.172155 11321 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.114203 11341 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.171778 11327 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:03.204866  8922 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:03.193960 11353 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.166419 11444 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.154454 11440 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:14:03.217458  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49720us
I20260709 12:14:03.204433 11418 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:03.207552 11327 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:03.223315  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65013.1us
I20260709 12:14:03.213551 11353 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.227160  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.215224 11341 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.221871 11283 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.217149 11444 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.252835  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 339) took 1769 ms. Trace:
I20260709 12:14:03.224141 11135 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:14:03.253258  8924 rpcz_store.cc:276] 0709 12:14:01.483614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.483805 (+   191us) service_pool.cc:224] Handling call
0709 12:14:01.515795 (+ 31990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:01.702435 (+186640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.702466 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:01.703066 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:14:03.088029 (+1384963us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b18001acec0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:03.115270 (+ 27241us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:03.115308 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.115380 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.248520 (+133140us) raft_consensus.cc:1685] finished
0709 12:14:03.248537 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.252755 (+  4218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24863,"raft.queue_time_us":186924,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":2209664,"thread_start_us":27010,"threads_started":1,"wal-append.queue_time_us":1412141}
I20260709 12:14:03.225244 11418 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.247772 11283 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.363318  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2044) took 1055 ms. Trace:
I20260709 12:14:03.379792  9066 rpcz_store.cc:276] 0709 12:14:02.308065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.320730 (+ 12665us) service_pool.cc:224] Handling call
0709 12:14:03.359220 (+1038490us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b54004227d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:03.363209 (+  3989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11856640}
I20260709 12:14:03.275213 11406 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.272500 11448 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:03.386037  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 158969us
I20260709 12:14:03.388429  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.390586  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:03.324084 11445 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:03.271971 11374 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.328998 11009 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.394833  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:03.318755 11317 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:03.357661  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:03.333727 11418 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.318719 11288 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:14:03.403985  8918 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:03.405646 11283 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:03.397205 11448 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.351218 11433 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.397506 11450 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.327493 11444 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.413784 11280 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.415576  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:03.395473 11383 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.332335 11404 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.419843 11009 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.420398 11449 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.435515 11406 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.432685 11334 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:03.435904 11374 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.437831 11334 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.425593 11383 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:03.425457 11450 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.433830  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:03.453368 11383 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.474694  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.475394  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.476281  9624 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:03.476382  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.476739  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 388) took 1010 ms. Trace:
I20260709 12:14:03.477133  9624 rpcz_store.cc:276] 0709 12:14:02.466020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.676632 (+210612us) service_pool.cc:224] Handling call
0709 12:14:03.475228 (+798596us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:03.476679 (+  1451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6141696}
I20260709 12:14:03.477823  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:03.479123  8920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2003) took 1247 ms (client timeout 1504 ms). Trace:
I20260709 12:14:03.479344  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:03.479755  8920 rpcz_store.cc:269] 0709 12:14:02.231700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.711031 (+479331us) service_pool.cc:224] Handling call
0709 12:14:03.478888 (+767857us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540020f8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:03.479051 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761014016}
I20260709 12:14:03.480630  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.481401  9066 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:03.481561  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:03.482661  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.483260  9066 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:03.483525  8916 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:03.484155  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.485204  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.485807  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 331) took 2095 ms. Trace:
I20260709 12:14:03.486709  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.488107  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.488564 10898 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.489056 10898 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.489135  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.489805  9066 raft_consensus.cc:2376] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6. Re-sending same reply.
I20260709 12:14:03.490703  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:03.491714 11459 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:14:03.491863  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.434336 11353 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.492529  9066 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:03.495651  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:03.496237  8999 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.496951  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:03.497603  8994 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:03.486212  8916 rpcz_store.cc:276] 0709 12:14:01.389974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.390538 (+   564us) service_pool.cc:224] Handling call
0709 12:14:03.247392 (+1856854us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:03.483346 (+235954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.483994 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.485618 (+  1624us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540020f8d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:03.485747 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545599488}
I20260709 12:14:03.497901  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:03.502242  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:03.504983  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.506781 11433 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:03.486716 11334 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.513134  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.514406  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.514565 11334 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:03.471549 11009 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.500219 11418 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.465170 11449 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.500384 11406 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:03.515205  9074 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 2: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:03.526187  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.526798  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:03.527443  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 901129us
I20260709 12:14:03.558625  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:03.528915  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.543684  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:03.561651  8994 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:03.531916  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.467070 11448 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.646509  8999 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:03.656107  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:03.520884  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.944710  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:03.688401  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.547833  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:04.405260  9622 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:04.405488  8998 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:03.532034  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.519212  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:04.314661  8992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.009s
W20260709 12:14:04.407222  8992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.010s
I20260709 12:14:03.674219  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:03.594005  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:04.408915  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2551) took 1017 ms. Trace:
I20260709 12:14:04.409376  9068 rpcz_store.cc:276] 0709 12:14:03.391262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.308523 (+917261us) service_pool.cc:224] Handling call
0709 12:14:04.308948 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.408614 (+ 99666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.408649 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.408688 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:04.408720 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.408768 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.408868 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.412590  8991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.003s	sys 0.001s
I20260709 12:14:03.941366  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:04.414402  9067 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:04.419982 11475 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.420768 11475 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:04.413138  8991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.003s	sys 0.001s
W20260709 12:14:04.004339  8996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.053s	sys 0.076s
W20260709 12:14:04.425169  8996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.061s	sys 0.095s
I20260709 12:14:03.544461  8995 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [4.5-5.6]
W20260709 12:14:04.127223  9590 leader_election.cc:336] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.794s (SENT)
W20260709 12:14:04.413769  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 881879us
W20260709 12:14:04.400342  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 841737us
I20260709 12:14:04.406068  9621 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:04.426740  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 299549us
I20260709 12:14:04.427332  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:04.427484  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:03.663158  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:04.429189  9074 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:04.430328  9068 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:04.431416  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2552) took 1039 ms. Trace:
I20260709 12:14:04.431835  8995 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.430699  8999 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:14:04.433604  8994 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:14:04.434513  9068 rpcz_store.cc:276] 0709 12:14:03.391676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.429802 (+1038126us) service_pool.cc:224] Handling call
0709 12:14:04.430149 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.430999 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.431343 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.431473  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:04.443514  8925 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.657351  8918 raft_consensus.cc:2410] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:04.440294  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2555) took 1047 ms. Trace:
I20260709 12:14:03.527364 11341 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.519770 11229 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.457752  9066 rpcz_store.cc:276] 0709 12:14:03.392551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.429977 (+1037426us) service_pool.cc:224] Handling call
0709 12:14:04.439772 (+  9795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.439969 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.439996 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.440038 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:04.440069 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.440126 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.440238 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:03.840330 11463 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:04.459779  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1131) took 1457 ms. Trace:
I20260709 12:14:03.517741  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 681) took 1942 ms. Trace:
I20260709 12:14:04.489584  9000 rpcz_store.cc:276] 0709 12:14:03.001977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.005806 (+  3829us) service_pool.cc:224] Handling call
0709 12:14:03.014418 (+  8612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.046359 (+ 31941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.459498 (+1413139us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54003dc054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:04.459710 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51463040}
W20260709 12:14:04.461027  9070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2059) took 1559 ms (client timeout 1933 ms). Trace:
W20260709 12:14:04.491426  9070 rpcz_store.cc:269] 0709 12:14:02.901626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.902393 (+   767us) service_pool.cc:224] Handling call
0709 12:14:04.460769 (+1558376us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b54000e7ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:04.460948 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137426688}
I20260709 12:14:03.502722 11340 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.529801  9615 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:03.834806 11349 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:04.471324  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:04.100698 11429 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.969030 11108 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.519454 11412 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.526510  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:03.969352 11367 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:03.614488 11283 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:03.611994 11456 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.786729 11280 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:04.477203  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:03.522398 11353 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.477885  9067 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:03.729723 11433 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.526724 11376 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.770385 11334 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.538614 11406 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.531690  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:03.524303 11404 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.067350 11375 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:03.587415 11028 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:03.527210  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.188553 11263 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:04.413146 11233 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:04.538039  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 655) took 1008 ms. Trace:
I20260709 12:14:04.440107 11457 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.535506 11327 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:03.543406 10898 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.527530  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:04.482179 11229 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:04.494642  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2020) took 1087 ms. Trace:
I20260709 12:14:04.471618 11341 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:04.541679  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 114441us
I20260709 12:14:04.565757  9617 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:03.536262 11449 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:03.534551  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:04.504976 11349 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:04.500214 11475 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.486827  9065 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:04.588182  9068 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:04.588557  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2553) took 1196 ms. Trace:
I20260709 12:14:04.588913  9065 rpcz_store.cc:276] 0709 12:14:03.391983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.518850 (+126867us) service_pool.cc:224] Handling call
0709 12:14:04.588489 (+1069639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.538946 11450 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:04.535048 11411 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:04.555526  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:04.533041 11378 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:04.497126  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:04.541204 11333 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:04.661487  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.034s	sys 0.029s
I20260709 12:14:04.568427  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 395) took 1038 ms. Trace:
W20260709 12:14:04.594388 11275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.014s	sys 0.034s
I20260709 12:14:04.529706 11429 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.573698  9074 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:04.575098  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:04.568241 11431 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.549s	user 0.002s	sys 0.004s
I20260709 12:14:04.550458 11433 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.563560 11233 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.581245  9073 raft_consensus.cc:2410] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:04.578279  9618 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:04.571413  8918 rpcz_store.cc:276] 0709 12:14:03.407218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.421065 (+ 13847us) service_pool.cc:224] Handling call
0709 12:14:04.489165 (+1068100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.662608  9622 rpcz_store.cc:276] 0709 12:14:03.529975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.527164 (+997189us) service_pool.cc:224] Handling call
0709 12:14:04.568345 (+ 41181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.531756 11108 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.577121 11341 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:04.664359  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.035s	sys 0.029s
W20260709 12:14:04.671947 11275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.015s	sys 0.035s
W20260709 12:14:04.664598 11111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.042s	sys 0.083s
W20260709 12:14:04.707986 11111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.043s	sys 0.083s
W20260709 12:14:04.671342  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.090s	sys 0.116s
W20260709 12:14:04.709899  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.091s	sys 0.116s
I20260709 12:14:04.672864  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2557) took 1277 ms. Trace:
W20260709 12:14:04.711133  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 136081us
I20260709 12:14:04.711946  9074 rpcz_store.cc:276] 0709 12:14:03.395932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.558528 (+1162596us) service_pool.cc:224] Handling call
0709 12:14:04.571337 (+ 12809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.672591 (+101254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.672806 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.713748  9074 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:04.714401 11480 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:04.711472  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.715350 11480 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.561654 11028 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.721258 11028 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:04.722172 11028 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:04.561036 11375 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:04.722988  9588 connection.cc:256] RPC call timeout handler was delayed by -1.1539186490001612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:14:04.723548  9588 connection.cc:256] RPC call timeout handler was delayed by -1.1431186490001437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:14:04.725221 11375 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:04.725775 11375 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.576710 11477 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.561826 11263 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:04.559640  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 652) took 1033 ms. Trace:
I20260709 12:14:04.543711 11456 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.553251 11376 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.547569 11412 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:04.562620  9615 rpcz_store.cc:276] 0709 12:14:03.526987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.528996 (+  2009us) service_pool.cc:224] Handling call
0709 12:14:03.529306 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.506592 (+977286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.535360 (+ 28768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.587319  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 654) took 1060 ms. Trace:
I20260709 12:14:04.677531  9067 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:04.756475  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2560) took 1337 ms. Trace:
I20260709 12:14:04.756906  9067 rpcz_store.cc:276] 0709 12:14:03.419460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.648815 (+1229355us) service_pool.cc:224] Handling call
0709 12:14:04.677400 (+ 28585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.756221 (+ 78821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.756419 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.698572  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 271142us
I20260709 12:14:04.714525  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2564) took 1284 ms. Trace:
I20260709 12:14:04.757918  9074 rpcz_store.cc:276] 0709 12:14:03.430694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.713047 (+1282353us) service_pool.cc:224] Handling call
0709 12:14:04.713505 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.714241 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.714468 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.539602 11367 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.729091  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:04.744290  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.762732  9622 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:04.758545  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:04.734128  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:04.680877  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2009) took 2345 ms (client timeout 1711 ms). Trace:
I20260709 12:14:04.767663  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 394) took 1238 ms. Trace:
I20260709 12:14:04.768092  9622 rpcz_store.cc:276] 0709 12:14:03.529670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.744029 (+1214359us) service_pool.cc:224] Handling call
0709 12:14:04.767599 (+ 23570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.768976  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.764940  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:04.672868 11333 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.726289 11375 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.672120 11378 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.750521 11477 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:04.789170  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 657) took 1106 ms. Trace:
I20260709 12:14:04.755021 11275 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.750171 10639 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:04.754218  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 391) took 1224 ms. Trace:
W20260709 12:14:04.752457 11009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.014s	sys 0.028s
I20260709 12:14:04.791991  9622 rpcz_store.cc:276] 0709 12:14:03.663792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.768731 (+1104939us) service_pool.cc:224] Handling call
0709 12:14:04.769672 (+   941us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.794656  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65634.4us
I20260709 12:14:04.775976 11111 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:04.800680  8993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.018s	sys 0.061s
I20260709 12:14:04.747148  9616 rpcz_store.cc:276] 0709 12:14:03.526066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.526262 (+   196us) service_pool.cc:224] Handling call
0709 12:14:04.557002 (+1030740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.805148  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:04.780524 11040 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:14:04.750211 11349 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:04.803272  8993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.018s	sys 0.061s
I20260709 12:14:04.776387 11457 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.813357  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2080) took 1319 ms. Trace:
I20260709 12:14:04.834028  9073 rpcz_store.cc:276] 0709 12:14:03.494233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.944403 (+450170us) service_pool.cc:224] Handling call
0709 12:14:04.813162 (+868759us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000ac654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:04.813297 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404240256}
I20260709 12:14:04.812301  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.835006  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:04.835057  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 658) took 1160 ms. Trace:
I20260709 12:14:04.835625  9073 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.835592  9622 rpcz_store.cc:276] 0709 12:14:03.674639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.811953 (+1137314us) service_pool.cc:224] Handling call
0709 12:14:04.834999 (+ 23046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.496268  9619 rpcz_store.cc:276] 0709 12:14:01.575169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.625332 (+ 50163us) service_pool.cc:224] Handling call
0709 12:14:01.625837 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.626139 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:02.350914 (+724775us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.632501 (+281587us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.789536 (+157035us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b18001544e0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e522 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:03.517167 (+727631us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b18001544e0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:03.517335 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.517389 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:03.517448 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.517532 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.517674 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6561,"prepare.queue_time_us":740719,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5910,"raft.queue_time_us":876897,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":72669,"spinlock_wait_cycles":28518400,"thread_start_us":886640,"threads_started":2,"wal-append.queue_time_us":294543,"wal-append.run_cpu_time_us":2032,"wal-append.run_wall_time_us":1100137}
I20260709 12:14:04.777630 11476 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.680673 11229 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.756049  9617 rpcz_store.cc:276] 0709 12:14:03.526679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.526960 (+   281us) service_pool.cc:224] Handling call
0709 12:14:04.581608 (+1054648us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.803776 11009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.015s	sys 0.029s
W20260709 12:14:04.808710 11464 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.379s	user 0.002s	sys 0.000s
W20260709 12:14:04.767524  8917 rpcz_store.cc:269] 0709 12:14:02.335721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.534199 (+1198478us) service_pool.cc:224] Handling call
0709 12:14:04.676707 (+1142508us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:04.811861 11468 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.388s	user 0.002s	sys 0.000s
W20260709 12:14:04.809751 11465 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.381s	user 0.001s	sys 0.001s
I20260709 12:14:04.810366 11478 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.780213 11280 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:14:04.780790 11176 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:14:04.777254 11411 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:14:04.806694 11111 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:04.800972  9618 rpcz_store.cc:276] 0709 12:14:03.528720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.531408 (+  2688us) service_pool.cc:224] Handling call
0709 12:14:04.752912 (+1221504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.803789 11480 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.994298  9066 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.971728 11349 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:04.806526 11466 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:14:04.998159  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:04.805495 11429 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.004642  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.810035 11496 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:04.814366 11433 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.810181 11477 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:05.004228 11040 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:05.008024  9073 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:04.799386 11275 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.791267 11481 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.202s
I20260709 12:14:05.006719  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2547) took 1617 ms. Trace:
I20260709 12:14:04.806548  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:04.759853 11412 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:04.811352 11378 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:04.993999 11229 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.851612 11028 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:14:04.812162 11491 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.250s
I20260709 12:14:05.003741 11476 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:05.120702  9072 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.801941 10639 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.237459  9071 rpcz_store.cc:276] 0709 12:14:03.389267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.389487 (+   220us) service_pool.cc:224] Handling call
0709 12:14:04.460932 (+1071445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.461121 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.461147 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.461184 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:04.461213 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.461263 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.006466 (+545203us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000e7ed0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:05.006638 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463380352}
I20260709 12:14:05.190670  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1129) took 2189 ms. Trace:
I20260709 12:14:05.125255  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:05.240164  9073 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:05.183051  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.024044 11479 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:05.256217  9622 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:05.239970  8996 rpcz_store.cc:276] 0709 12:14:03.001345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.008888 (+  7543us) service_pool.cc:224] Handling call
0709 12:14:03.009178 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.014020 (+  4842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.014063 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.017185 (+  3122us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.477884 (+460699us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18004261c0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:04.425613 (+947729us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:04.425649 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.425708 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.808169 (+382461us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:05.190368 (+382199us) raft_consensus.cc:1685] finished
0709 12:14:05.190398 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.190577 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3352,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5635,"spinlock_wait_cycles":18433536,"thread_start_us":947547,"threads_started":1,"wal-append.queue_time_us":1407349}
I20260709 12:14:05.099967 11482 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.116660  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.063454 11485 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.237s
I20260709 12:14:05.139797 11280 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:05.118784 11327 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.189519  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:05.266968 11108 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.189458 10898 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.252463  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:05.261672 11378 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:05.067700 11111 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.256970 11479 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.124298 11450 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:05.276165  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 461609us
W20260709 12:14:05.271368  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 266643us
I20260709 12:14:05.018790 11478 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.256918 11233 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.266301  9073 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:05.266346 11481 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.275688 11367 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:05.282191  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 480298us
I20260709 12:14:05.264520 11482 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.297719  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 660) took 1622 ms. Trace:
I20260709 12:14:05.299675 11111 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.272585 11280 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.277086  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 386) took 2819 ms. Trace:
I20260709 12:14:05.274819  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 659) took 1599 ms. Trace:
I20260709 12:14:05.281549  9618 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.282460 11378 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.123031 11496 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.283089 11376 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.292243 11479 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.323701 11263 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.311751 11481 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.259202 11476 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.331634 11456 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.324210 11450 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:05.340559 11486 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:14:05.342178 11376 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:14:05.303514 11477 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.357960 11482 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.359275 11482 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:05.360453 11469 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:14:05.349752 11378 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.362537 11378 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.363019 11496 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.365272 11412 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.363785 11481 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.367044 11481 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.367758 11476 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.368954 11478 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.372277 11450 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:05.408012  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 553385us
W20260709 12:14:05.281629  8998 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.007s
W20260709 12:14:05.411909  8998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.003s	sys 0.007s
W20260709 12:14:05.414458  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.419468  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.427956  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.003s	sys 0.012s
W20260709 12:14:05.428759  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.004s	sys 0.012s
W20260709 12:14:05.429050  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.006s	sys 0.007s
W20260709 12:14:05.429520  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.007s
W20260709 12:14:05.429956  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 655191us
I20260709 12:14:05.321889  9073 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:05.433110  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 113204us
I20260709 12:14:05.317975  9619 rpcz_store.cc:276] 0709 12:14:03.675457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.072351 (+1396894us) service_pool.cc:224] Handling call
0709 12:14:05.297635 (+225284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.344712 11280 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.356493 11375 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.446391 11476 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:05.370959 11383 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.815s	user 0.009s	sys 0.004s
I20260709 12:14:05.434513  9617 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:05.441308 11111 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:14:05.461598  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 149149us
I20260709 12:14:05.456944 11275 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.443523 10639 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.473281  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 441) took 1733 ms. Trace:
I20260709 12:14:05.473984  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 693) took 1066 ms. Trace:
I20260709 12:14:05.473832  9073 rpcz_store.cc:276] 0709 12:14:03.739925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.321184 (+1581259us) service_pool.cc:224] Handling call
0709 12:14:05.321643 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.472602 (+150959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.473049 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.326071  9620 rpcz_store.cc:276] 0709 12:14:02.451603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.681695 (+230092us) service_pool.cc:224] Handling call
0709 12:14:02.710792 (+ 29097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.521176 (+810384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.521229 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.521836 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.712941 (+191105us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:03.724396 (+ 11455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.765878 (+ 41482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.259120 (+1493242us) raft_consensus.cc:1685] finished
0709 12:14:05.259141 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.271051 (+ 11910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":797042,"raft.queue_time_us":798567,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":149799,"threads_started":1,"wal-append.queue_time_us":1021345}
I20260709 12:14:05.485110  8923 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:05.474520  9617 rpcz_store.cc:276] 0709 12:14:04.407281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.016862 (+609581us) service_pool.cc:224] Handling call
0709 12:14:05.473632 (+456770us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400479854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:05.473831 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375055232}
I20260709 12:14:05.499579  9617 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:05.499928  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2549) took 2109 ms. Trace:
I20260709 12:14:05.500522  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 695) took 1059 ms. Trace:
I20260709 12:14:05.500423  9072 rpcz_store.cc:276] 0709 12:14:03.390564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.390695 (+   131us) service_pool.cc:224] Handling call
0709 12:14:03.399851 (+  9156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.252627 (+1852776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.499388 (+246761us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54003f0554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.499733 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948618496}
I20260709 12:14:05.501293  9617 rpcz_store.cc:276] 0709 12:14:04.440880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.498058 (+1057178us) service_pool.cc:224] Handling call
0709 12:14:05.498752 (+   694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.500143 (+  1391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.500430 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.502768  9072 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.503996  9069 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:14:05.329895  9615 rpcz_store.cc:276] 0709 12:14:03.675046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.793333 (+1118287us) service_pool.cc:224] Handling call
0709 12:14:05.273099 (+479766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.509400 11506 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:05.510973  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48255.7us
I20260709 12:14:05.511353 11476 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:14:05.511019 11517 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:14:05.536720  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.002s	sys 0.003s
W20260709 12:14:05.537379  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.003s	sys 0.003s
W20260709 12:14:05.537899  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 765588us
I20260709 12:14:05.513716  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2566) took 1088 ms. Trace:
I20260709 12:14:05.515689 11513 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:14:05.555770 11135 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:05.556074  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2396) took 2013 ms. Trace:
I20260709 12:14:05.556650  8991 rpcz_store.cc:276] 0709 12:14:03.542907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.433142 (+890235us) service_pool.cc:224] Handling call
0709 12:14:04.433430 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:04.540046 (+106616us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:04.540077 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:04.540730 (+   653us) log.cc:844] Serialized 52 byte log entry
0709 12:14:04.707525 (+166795us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:04.707617 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.497026 (+789409us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400196754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.514965 (+ 17939us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.555306 (+ 40341us) raft_consensus.cc:1685] finished
0709 12:14:05.555331 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.555756 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2263,"spinlock_wait_cycles":238615424,"thread_start_us":142466,"threads_started":1,"wal-append.queue_time_us":458028}
I20260709 12:14:05.529224  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:05.561986  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:05.529282 11383 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.562765 11333 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.564945 11383 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.565130 11334 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:05.565737 11334 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.565994  9065 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:05.568154  9073 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:05.568092  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:05.569052  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2567) took 1151 ms. Trace:
I20260709 12:14:05.569296  8922 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.569834  8922 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.569540  9073 rpcz_store.cc:276] 0709 12:14:04.417873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.515078 (+1097205us) service_pool.cc:224] Handling call
0709 12:14:05.567726 (+ 52648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.568723 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.568949 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.532173 11506 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.548847  9072 rpcz_store.cc:276] 0709 12:14:04.417527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.501827 (+1084300us) service_pool.cc:224] Handling call
0709 12:14:05.502401 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.503198 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.506292 (+  3094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.546586 11514 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:05.547737 11504 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:14:05.559026  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 397) took 1941 ms. Trace:
I20260709 12:14:05.572400  8922 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.578588 11028 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:05.582408 11028 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:05.568127  8917 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:05.578749  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:05.554993 11406 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:14:05.615808  8923 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:14:05.617455 11283 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.618005 11135 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.618245 11283 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.619645 11404 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.619913 11028 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.620270 11404 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.622812 11404 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:05.623402 11367 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:05.623586 11429 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.624357 11367 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.627846 11375 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:05.624401 11429 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.630638 11429 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.632586 11283 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:05.633304  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53767.1us
I20260709 12:14:05.634238 11404 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:05.641449  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 277150us
I20260709 12:14:05.644861 11135 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:05.648379 11516 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:14:05.651954 11447 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.652475 11447 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:05.652696  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:05.653573 11447 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.654608  8963 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:05.599701  9617 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:05.655962  8922 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.655174 11447 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.656967 11456 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:05.687219 11456 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:05.659864 11367 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.655812  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 696) took 1201 ms. Trace:
I20260709 12:14:05.688323  9617 rpcz_store.cc:276] 0709 12:14:04.454299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.502561 (+1048262us) service_pool.cc:224] Handling call
0709 12:14:05.503151 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.655476 (+152325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.655725 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:05.690815 11349 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.008s
I20260709 12:14:05.680190 10639 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:05.691859 10639 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:05.691901  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:05.693439 10639 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.696950 11334 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.697672  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2565) took 2262 ms. Trace:
W20260709 12:14:05.679497  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 211306us
I20260709 12:14:05.686996 11283 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:05.579948  9619 rpcz_store.cc:276] 0709 12:14:03.530566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.465378 (+1934812us) service_pool.cc:224] Handling call
0709 12:14:05.466384 (+  1006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.466946 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.466996 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:05.467087 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:05.467135 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.467223 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.472009 (+  4786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.634944 11404 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.678443 11506 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:05.706795  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 66777.3us
I20260709 12:14:05.730535  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.731669  9624 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:05.731413  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:05.731997  9073 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:14:05.732687  9072 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:05.698202  9067 rpcz_store.cc:276] 0709 12:14:03.434801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.766863 (+1332062us) service_pool.cc:224] Handling call
0709 12:14:04.796688 (+ 29825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.429473 (+632785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.429526 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:05.430722 (+  1196us) log.cc:844] Serialized 26 byte log entry
0709 12:14:05.599457 (+168735us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:05.599491 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.605002 (+  5511us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.697318 (+ 92316us) raft_consensus.cc:1685] finished
0709 12:14:05.697347 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.697566 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198695,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9026,"thread_start_us":800334,"threads_started":2,"wal-append.queue_time_us":180008}
I20260709 12:14:05.733495  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2562) took 2311 ms. Trace:
I20260709 12:14:05.734740  9073 pending_rounds.cc:85] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 3
W20260709 12:14:05.739663  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58125.8us
I20260709 12:14:05.738442  9073 pending_rounds.cc:107] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:05.743574  9073 raft_consensus.cc:2889] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:05.744302  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2079) took 2119 ms. Trace:
I20260709 12:14:05.744896  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.713469 11429 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:05.747722  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 93246.2us
I20260709 12:14:05.748318 11289 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:05.748687  8963 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:05.749125  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:05.753530 11515 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:05.754102 11515 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:05.756235  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:05.757799 11378 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:05.758435 11378 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:05.760293  8918 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:05.761005  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.761870 11514 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:05.735409  9066 rpcz_store.cc:276] 0709 12:14:03.422400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.663891 (+1241491us) service_pool.cc:224] Handling call
0709 12:14:04.673292 (+  9401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.019940 (+346648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.732997 (+713057us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54001b6a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.733289 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737777536}
I20260709 12:14:05.767197  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2556) took 2353 ms. Trace:
I20260709 12:14:05.750895 11289 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:05.773540  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.774394  9623 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:05.774127 11383 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:05.775512  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:05.776007 11229 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.521s	user 0.015s	sys 0.000s
I20260709 12:14:05.777355  8917 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:05.777891  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2548) took 2387 ms. Trace:
I20260709 12:14:05.778179 11334 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.783354 11493 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:05.784291 11448 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:14:05.785568 11448 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.786098 11448 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:05.780454  9069 rpcz_store.cc:276] 0709 12:14:03.390202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.390320 (+   118us) service_pool.cc:224] Handling call
0709 12:14:03.402434 (+ 12114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.504484 (+2102050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.777517 (+273033us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400368b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.777826 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4831375232}
I20260709 12:14:05.787693 11478 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:05.788239  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.788611 11478 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:05.790220  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:05.791406 11341 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.947s	user 0.010s	sys 0.006s
I20260709 12:14:05.791945 11341 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.792634  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:05.794276 11341 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:05.795552  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.796250  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.759953 11378 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.797408  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.798619  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.798920 11476 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:05.778247 11349 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:14:05.800746  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.801467  9070 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 2.
I20260709 12:14:05.770291  9068 rpcz_store.cc:276] 0709 12:14:03.392917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.435696 (+1042779us) service_pool.cc:224] Handling call
0709 12:14:04.435981 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.588594 (+152613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.745901 (+1157307us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54003b83d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.746232 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349525888}
I20260709 12:14:05.808987  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.765148 11406 consensus_queue.cc:1243] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:05.810036  9070 raft_consensus.cc:2393] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:05.811110  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.812399  9069 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:05.815478  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2559) took 2413 ms. Trace:
I20260709 12:14:05.790303 11478 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.821600  9065 rpcz_store.cc:276] 0709 12:14:03.401935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.646360 (+1244425us) service_pool.cc:224] Handling call
0709 12:14:04.646795 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.566455 (+919660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.813422 (+246967us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540028b9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.815419 (+  1997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113120000}
I20260709 12:14:05.744824  9071 rpcz_store.cc:276] 0709 12:14:03.494080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.257054 (+1762974us) service_pool.cc:224] Handling call
0709 12:14:05.257510 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:05.257940 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.257980 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:05.262148 (+  4168us) log.cc:844] Serialized 52 byte log entry
0709 12:14:05.433747 (+171599us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:05.496097 (+ 62350us) log.cc:844] Serialized 14 byte log entry
0709 12:14:05.602879 (+106782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.613427 (+ 10548us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.613515 (+    88us) raft_consensus.cc:1685] finished
0709 12:14:05.613532 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.613710 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102688,"prepare.queue_time_us":156248,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":53833,"raft.queue_time_us":249640,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":3939,"thread_start_us":202913,"threads_started":2,"wal-append.queue_time_us":84597}
I20260709 12:14:05.827111  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.828419  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:05.832702  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 76658.1us
I20260709 12:14:05.820081 11429 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:05.845043  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:05.863317  9068 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:05.825975  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:05.806092 11515 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.844005 11429 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.877389  9069 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.872394  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:05.877274 11308 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:14:05.889415 11515 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.890231 11308 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:05.890743 11308 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:05.901528  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.910435  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2391) took 2361 ms. Trace:
I20260709 12:14:05.910961  8993 rpcz_store.cc:276] 0709 12:14:03.541525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.993327 (+451802us) service_pool.cc:224] Handling call
0709 12:14:03.993681 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.833779 (+840098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.833809 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.834268 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:14:05.278306 (+444038us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:05.415470 (+137164us) log.cc:844] Serialized 14 byte log entry
0709 12:14:05.867969 (+452499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.875566 (+  7597us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.875625 (+    59us) raft_consensus.cc:1685] finished
0709 12:14:05.875645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.903182 (+ 27537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164399,"prepare.queue_time_us":161294,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":635616,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":248,"thread_start_us":1338499,"threads_started":3,"wal-append.queue_time_us":333024}
I20260709 12:14:05.915962 11308 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:05.916464 11263 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:05.917658 11308 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.917505 11263 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.927556  9071 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:05.880337 11429 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:05.902200  9590 connection.cc:256] RPC call timeout handler was delayed by -1.0277155179999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:14:05.943483  8922 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:05.933000  9618 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:05.945792 11289 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:05.946027  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 694) took 1538 ms. Trace:
I20260709 12:14:05.946491  9618 rpcz_store.cc:276] 0709 12:14:04.407837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.098331 (+690494us) service_pool.cc:224] Handling call
0709 12:14:05.945927 (+847596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:05.853983 11448 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:05.956892  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:05.958174 11526 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:14:05.958999  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:05.959671 11471 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 12:14:05.959956  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2078) took 2465 ms. Trace:
I20260709 12:14:05.960323  9074 rpcz_store.cc:276] 0709 12:14:03.493911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.758804 (+1264893us) service_pool.cc:224] Handling call
0709 12:14:04.791753 (+ 32949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.791981 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.792002 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:05.504872 (+712870us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b2c00078738. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:14:05.505512 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 12:14:05.677698 (+172186us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:05.677737 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.683349 (+  5612us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.959456 (+276107us) raft_consensus.cc:1685] finished
0709 12:14:05.959479 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.959784 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7942912,"thread_start_us":171611,"threads_started":1,"wal-append.queue_time_us":370146}
I20260709 12:14:05.962029  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2390) took 2420 ms. Trace:
I20260709 12:14:05.962483  8992 rpcz_store.cc:276] 0709 12:14:03.541234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.544569 (+  3335us) service_pool.cc:224] Handling call
0709 12:14:03.544968 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.548153 (+  3185us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:03.675822 (+127669us) log.cc:844] Serialized 14 byte log entry
0709 12:14:04.188166 (+512344us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:04.407650 (+219484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.415947 (+  8297us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.416095 (+   148us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:04.416281 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 12:14:04.416435 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.416498 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.570257 (+1153759us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b1800378400. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3989b0f58f 00007f3982b4e571 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd
0709 12:14:05.658946 (+ 88689us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800378400. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:05.961643 (+302697us) raft_consensus.cc:1685] finished
0709 12:14:05.961663 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.961833 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1068156,"prepare.queue_time_us":135809,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":1814,"raft.queue_time_us":304768,"raft.run_cpu_time_us":3155,"raft.run_wall_time_us":543342,"spinlock_wait_cycles":33867648,"thread_start_us":643436,"threads_started":1,"wal-append.queue_time_us":818862}
I20260709 12:14:05.958043  8917 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:05.969496  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.987607  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.988087  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.976686  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 131698us
I20260709 12:14:05.977593  9619 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:05.977387 11505 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:05.955219  9617 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:05.979857  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:05.983301  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:05.977880  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2570) took 1526 ms. Trace:
I20260709 12:14:05.994674  9073 rpcz_store.cc:276] 0709 12:14:04.451495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.570763 (+1119268us) service_pool.cc:224] Handling call
0709 12:14:05.576351 (+  5588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.744181 (+167830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.977615 (+233434us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400368654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:05.977819 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319083392}
I20260709 12:14:06.016881  8923 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:06.021935  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.022887  8925 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:14:06.022339  9616 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:06.032040  9623 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.997716 11341 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.047623  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:06.048543  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46403.6us
W20260709 12:14:06.049372  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 66298us
I20260709 12:14:06.050748 11353 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:06.051714 11353 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:06.019035 11280 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.053243 11353 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:06.055619  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 55573.1us
I20260709 12:14:06.050670 11525 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:06.027647 11283 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.062441 11473 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:06.065114  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:06.068027 11475 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.068900 11475 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.071822  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:06.072638 11482 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.012s
I20260709 12:14:06.073474 11448 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.079488 11341 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.082664 11341 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.083415 11283 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.085664 11283 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:06.087056  8920 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:06.089052  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.090518  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 393) took 2561 ms. Trace:
W20260709 12:14:06.092803  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.092983  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:06.095952 11447 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:06.096130 11367 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.096799 11367 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:06.097056  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:06.097362 11367 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.079499  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.100152  8918 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:06.100579 11456 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.102349 11456 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.032883 11404 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.107270 11491 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:06.107563 11334 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:06.114917 11482 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:06.115227  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:06.115744  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:06.117228 11334 consensus_queue.cc:1243] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:06.117857 11334 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:06.118234 11334 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:06.118501 11481 consensus_meta.cc:287] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.003s
I20260709 12:14:06.091029  9616 rpcz_store.cc:276] 0709 12:14:03.529387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.180446 (+1651059us) service_pool.cc:224] Handling call
0709 12:14:06.021600 (+841154us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:06.021896 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.039849 (+ 17953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.090420 (+ 50571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23432448}
I20260709 12:14:06.120471 11491 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.120954 11491 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:06.122123 11491 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.122789  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:06.120410 11333 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:06.127588 11333 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:06.128768 11333 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.129550  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 656) took 2602 ms. Trace:
I20260709 12:14:06.138993  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:06.139938  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 45134.1us
I20260709 12:14:06.142624  9623 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:06.130069  9622 rpcz_store.cc:276] 0709 12:14:03.532083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.125862 (+1593779us) service_pool.cc:224] Handling call
0709 12:14:05.214699 (+ 88837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.256674 (+ 41975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.129019 (+872345us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b54001301d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:06.129331 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95322368}
I20260709 12:14:06.130350 11334 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.144610  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2395) took 2602 ms. Trace:
I20260709 12:14:06.149578 11340 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.149628 11176 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:14:06.152976 11479 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.811s	user 0.005s	sys 0.011s
I20260709 12:14:06.132164 11473 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.126485 11525 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.166307 11528 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:14:06.148121  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:06.175846 11491 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.170740 11481 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:06.208441  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.209813  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 87130.3us
I20260709 12:14:06.202812 11333 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.168283 11135 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:06.220785  9073 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.176425 11429 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:06.225484  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 334319us
I20260709 12:14:06.168069  8998 rpcz_store.cc:276] 0709 12:14:03.542641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.432192 (+889551us) service_pool.cc:224] Handling call
0709 12:14:04.432696 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:04.451630 (+ 18934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.451657 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:04.452210 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 12:14:04.700900 (+248690us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:05.412831 (+711931us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.045915 (+633084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.138528 (+ 92613us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.144291 (+  5763us) raft_consensus.cc:1685] finished
0709 12:14:06.144307 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.144549 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1251724,"prepare.queue_time_us":103997,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":342325,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":13415,"thread_start_us":1258548,"threads_started":3,"wal-append.queue_time_us":178642}
W20260709 12:14:06.253036  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.024s	sys 0.039s
I20260709 12:14:06.214324 11334 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:06.253593  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.024s	sys 0.039s
I20260709 12:14:06.210242 11475 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.212212 11481 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:06.201062 11479 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.224128 11383 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.296727  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:06.261869 11028 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.305377  9071 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:06.307145  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.309001  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.310528  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48935.7us
I20260709 12:14:06.246133 11308 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 12:14:06.318243  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 364557us
I20260709 12:14:06.328775  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:06.294101 11383 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.339547  8923 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.339676 11367 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:06.318967  9620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.016s	sys 0.068s
I20260709 12:14:06.303689 11493 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:06.321005 11475 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:06.356020 11525 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.356725 11367 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:06.357650  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:06.357908 11135 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:06.358520  9000 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:06.360522  9000 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:06.360970 11404 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.361578 11404 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.362149  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.362286  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.363006  8999 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 1.
I20260709 12:14:06.363063  8991 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:06.363932 11528 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.364315  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:06.364544 11528 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.364980  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.365701  8991 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:06.365756 11529 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.366703  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:06.366904 11528 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.361582  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:06.358681 11135 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.358664  8995 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:06.365082  8999 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:06.347420  9620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.017s	sys 0.068s
I20260709 12:14:06.361588  8993 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:06.366531 11529 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.372524 11479 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.374910  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:06.373975  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:06.315570 11028 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:06.387270  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.389328 11530 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.389350  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2388) took 2800 ms. Trace:
I20260709 12:14:06.390542  8994 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.391109 11532 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:06.391857 11493 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.392278  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:06.392845 11527 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.373301 11481 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.396775  9000 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:06.392360 11534 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:06.412038  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:06.414492  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.416283  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 323407us
I20260709 12:14:06.446135  8998 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:06.454564  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 80701.7us
I20260709 12:14:06.456032 11135 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:06.407923 11447 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:06.508469  8999 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:06.510756  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:06.513025  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 120946us
I20260709 12:14:06.854609  9069 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:06.818089  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.021s
W20260709 12:14:06.718832  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.654100  8919 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:06.512099  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.586505  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:06.772294  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.654688  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:06.863879  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.021s
I20260709 12:14:06.865572  8993 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:06.866298  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:06.860610  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:06.869473 11514 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:06.870359  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.560935  9000 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:06.693295  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.457901  8997 rpcz_store.cc:276] 0709 12:14:03.540625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.540748 (+   123us) service_pool.cc:224] Handling call
0709 12:14:03.541147 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:03.548036 (+  6889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.548070 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:04.413807 (+865737us) log.cc:844] Serialized 52 byte log entry
0709 12:14:04.700511 (+286704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:04.753948 (+ 53437us) log.cc:844] Serialized 14 byte log entry
0709 12:14:05.337239 (+583291us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:05.915508 (+578269us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.301788 (+386280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.301955 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.320089 (+ 18134us) raft_consensus.cc:1685] finished
0709 12:14:06.320272 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.341162 (+ 20890us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1148626,"prepare.queue_time_us":109633,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":917459,"raft.run_cpu_time_us":2904,"raft.run_wall_time_us":1685826,"spinlock_wait_cycles":12789120,"thread_start_us":817513,"threads_started":3,"wal-append.queue_time_us":186965,"wal-append.run_cpu_time_us":2876,"wal-append.run_wall_time_us":1135737}
I20260709 12:14:06.758399 11409 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.799503 11477 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:06.867396  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.652221  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:06.607934 11530 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:06.586138  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:06.861287  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.885836  8993 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:14:06.511153  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:06.610059 11551 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:14:06.887979  8920 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:06.890298  9000 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.852778 11040 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:06.905592  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.897706  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:06.915786  8995 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:06.903748  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:06.801002 11111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.002s	sys 0.024s
I20260709 12:14:06.921128  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.514200 11528 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.924878  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:06.564471 11429 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:06.859661 11263 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.879134 11404 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:06.938145  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:06.474880 11475 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:06.933355  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 422349us
I20260709 12:14:06.937606 11409 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:06.944716  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.944532  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 292443us
I20260709 12:14:06.952975  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:06.931178 11506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.024s	sys 0.047s
I20260709 12:14:06.945516 11495 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.512315 11527 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:06.946790 11530 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:06.938858  8916 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:06.903519  8918 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:06.948937 11176 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.953446 11404 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:06.927222 11111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.031s
W20260709 12:14:06.954178  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 65281.4us
I20260709 12:14:06.967729  8991 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.560511 11532 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:06.947598 11448 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.004s
I20260709 12:14:06.940510 11525 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.948462 11493 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:06.886111 11477 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:06.981503  8923 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 12:14:06.957995 11506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.024s	sys 0.048s
W20260709 12:14:07.079813 11535 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.578s	user 0.002s	sys 0.000s
W20260709 12:14:07.074357  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.117202 11506 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:07.053855  8916 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:07.021641 11530 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:06.978435 11176 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:07.120692 11176 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.104715  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:07.122043  8916 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.124953  8923 pending_rounds.cc:85] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 2
W20260709 12:14:07.022130  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 69299.7us
W20260709 12:14:06.966357 11547 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 12:14:07.125468  8923 pending_rounds.cc:107] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 12:14:07.035856  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 74018.8us
I20260709 12:14:07.139632 11135 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.142016 11447 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:07.142568 11447 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:07.142148 11135 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.129410  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:06.977981 11411 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:07.144769 11411 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:07.133424  8924 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.146384 11411 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.148226 11411 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.972486 11263 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.141206 11520 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.144601 11340 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:07.149538 11520 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:07.149801 11340 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:07.151043 11340 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.151051 11520 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.124351 11028 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.152868 11520 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.139690  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:07.033401 11542 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:14:07.156075 11448 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:07.157887 11491 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.948s	user 0.007s	sys 0.003s
I20260709 12:14:07.139194  8923 raft_consensus.cc:2889] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:07.136806  8916 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:07.160543  8916 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:07.161733  8916 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.162896  8916 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.149101  8924 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:07.164749 11333 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.002s
I20260709 12:14:07.165383 11333 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:07.166096 11333 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:07.167419 11545 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.417s	user 0.003s	sys 0.000s
I20260709 12:14:07.170476  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:07.171784 11530 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:07.172812 11530 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:07.180080 11475 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:07.184459 11539 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 12:14:07.174185 11530 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.186301 11492 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.186883 11492 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:06.960309 11514 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:07.216144  8916 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:14:07.189455  9620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.048s	sys 0.057s
W20260709 12:14:07.224732  9620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.049s	sys 0.059s
I20260709 12:14:07.233368  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:07.235410  9624 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:07.235666  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65346.2us
I20260709 12:14:07.207902 11514 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:07.237066  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:07.237448  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:07.238549  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:07.239998  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:07.241077  9615 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.241715 11409 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.245997 11527 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.058457 11529 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:07.258488  8921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.037s	sys 0.041s
I20260709 12:14:07.226154 11280 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:07.328956  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.257627 11514 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.966410 11495 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:07.316802  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 94610.4us
I20260709 12:14:07.247164 11263 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:07.307658 11543 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:14:07.188239 11492 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.333243 11280 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:07.315876 11456 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.213s	user 0.016s	sys 0.003s
I20260709 12:14:07.193817 11525 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.312497  9617 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:07.358752  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1139) took 1008 ms. Trace:
I20260709 12:14:07.327287 11409 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:07.366048  8992 rpcz_store.cc:276] 0709 12:14:06.339630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.351934 (+ 12304us) service_pool.cc:224] Handling call
0709 12:14:06.385107 (+ 33173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.130845 (+745738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.130894 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.130957 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:07.131000 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.347141 (+216141us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000f5ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:07.347197 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.347388 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714342656}
I20260709 12:14:07.358668  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:07.368757  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.367004 11456 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.377681 11492 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:07.458154  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.385797  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 690) took 3829 ms. Trace:
W20260709 12:14:07.459743  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.460809  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.457207  8999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.011s	sys 0.015s
W20260709 12:14:07.462949  8999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.011s	sys 0.015s
W20260709 12:14:07.464943  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 448969us
W20260709 12:14:07.479810  8925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.010s
I20260709 12:14:07.457258 11529 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.376933 11176 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.560314  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1150) took 1201 ms. Trace:
W20260709 12:14:07.460202  9618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.019s
W20260709 12:14:07.563516  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 101164us
I20260709 12:14:07.462915 11493 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.462641 11411 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.565871  8999 rpcz_store.cc:276] 0709 12:14:06.358505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.559882 (+201377us) service_pool.cc:224] Handling call
0709 12:14:06.611702 (+ 51820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.539065 (+927363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.539108 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.559927 (+ 20819us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:07.559992 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.560087 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.560238 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165100,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":26168,"thread_start_us":602446,"threads_started":1}
I20260709 12:14:07.537407 11333 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:07.460201 11456 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:07.568775  9618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.007s	sys 0.019s
I20260709 12:14:07.539848 11475 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:07.568590 11334 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.309s	user 0.014s	sys 0.006s
I20260709 12:14:07.375402 11477 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.463126 11409 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.596222  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 452) took 1947 ms. Trace:
I20260709 12:14:07.561131 11527 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:07.614017 11527 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:07.616962  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.617851  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.619923  8991 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:07.579303  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1261) took 1570 ms. Trace:
I20260709 12:14:07.575394 11375 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.625411  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:07.622963  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.014s	sys 0.028s
W20260709 12:14:07.628837  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.014s	sys 0.028s
W20260709 12:14:07.604808  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 448372us
I20260709 12:14:07.557439 11280 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.578228 11529 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.621306 11135 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:07.586369 11493 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:07.641795  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 744125us
I20260709 12:14:07.644229 11457 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.607890 11411 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.645138 11457 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.646003 11449 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:07.646564 11333 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.646638 11411 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.647298 11333 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.650113 11333 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.632988 11375 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.644330 11571 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.651942 11571 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.652851 11375 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.654796 11571 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.642199 11491 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:07.661314 11493 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.459287  9620 rpcz_store.cc:276] 0709 12:14:03.547111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.484770 (+1937659us) service_pool.cc:224] Handling call
0709 12:14:05.485482 (+   712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.486647 (+  1165us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:06.461685 (+975038us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.313580 (+851895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.315368 (+  1788us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:07.342848 (+ 27480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.356551 (+ 13703us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.376838 (+ 20287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580764,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2622,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":86,"thread_start_us":1515375,"threads_started":2,"wal-append.queue_time_us":784239}
I20260709 12:14:07.669189 11529 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.597806 11028 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:14:07.675650  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:07.667137 11447 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 12:14:07.638269 11477 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.638652  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 402) took 1638 ms. Trace:
I20260709 12:14:07.630312 11475 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.669639 11176 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.647161 11457 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:07.694888  8997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.034s
W20260709 12:14:07.731462  8997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.018s	sys 0.034s
I20260709 12:14:07.733764  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:07.677587  8888 connection.cc:256] RPC call timeout handler was delayed by -2.09308758200018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:14:07.735682  8888 connection.cc:256] RPC call timeout handler was delayed by -1.9067875820001063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 12:14:07.736147  8888 connection.cc:256] RPC call timeout handler was delayed by -1.8455875820000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:14:07.736524  8888 connection.cc:256] RPC call timeout handler was delayed by -1.7690875820001111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 12:14:07.736894  8888 connection.cc:256] RPC call timeout handler was delayed by -1.7519875820000834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:14:07.737272  8888 connection.cc:256] RPC call timeout handler was delayed by -1.6826875819999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:14:07.730751  8965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.012s	sys 0.018s
W20260709 12:14:07.738569  8965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.013s	sys 0.018s
I20260709 12:14:07.733814  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1265) took 1711 ms. Trace:
W20260709 12:14:07.698657 11520 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.005s
W20260709 12:14:07.693569 11530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.017s
I20260709 12:14:07.696480 10639 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:07.768707  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 93108.1us
W20260709 12:14:07.779006  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45333.5us
I20260709 12:14:07.740440 11280 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.754437 11495 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:07.697048 11447 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:07.784144  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:07.775873 11530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.018s
W20260709 12:14:07.802090  8888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.651s (SENT) [suppressed 21 similar messages]
I20260709 12:14:07.780375 11573 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.827505  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 190763us
I20260709 12:14:07.817415 11493 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:07.825286 11573 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:07.831321 11562 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 12:14:07.853447  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 75241.3us
I20260709 12:14:07.766299  8921 rpcz_store.cc:276] 0709 12:14:06.022491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.022713 (+   222us) service_pool.cc:224] Handling call
0709 12:14:06.023165 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.039697 (+ 16532us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:06.581163 (+541466us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.733154 (+1151991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.733362 (+   208us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:07.733505 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.733587 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.733739 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18109,"prepare.queue_time_us":331550,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":1463170,"threads_started":3,"wal-append.queue_time_us":769821}
I20260709 12:14:07.828812  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:07.830617 10639 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:07.854578  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 296905us
I20260709 12:14:07.813040 11520 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:07.829120 11456 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:07.869977  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 251064us
W20260709 12:14:07.870698  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 390976us
I20260709 12:14:07.871477  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:07.855168 11525 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:07.889149  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.890038  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.890786  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.891723  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.892870  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.869705 11481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.005s	sys 0.020s
I20260709 12:14:07.855470 11493 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:07.863204 10639 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:07.859192 11571 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:07.901139 11584 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.901849 11584 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.904855 11584 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:07.905339 11567 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:14:07.853725 11457 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:14:07.907313  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2407) took 1544 ms. Trace:
I20260709 12:14:07.864984 11340 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:07.916055 11333 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:07.909862  8998 rpcz_store.cc:276] 0709 12:14:06.391534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.916738 (+525204us) service_pool.cc:224] Handling call
0709 12:14:06.943645 (+ 26907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:06.944235 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.944270 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:06.944984 (+   714us) log.cc:844] Serialized 52 byte log entry
0709 12:14:07.390523 (+445539us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:07.778529 (+388006us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.802372 (+ 23843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.802464 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.907001 (+104537us) raft_consensus.cc:1685] finished
0709 12:14:07.907024 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.907225 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31584,"raft.queue_time_us":45514,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":25143,"thread_start_us":747022,"threads_started":2,"wal-append.queue_time_us":834962}
I20260709 12:14:07.917989  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 455) took 2081 ms. Trace:
I20260709 12:14:07.909727  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:07.918769 11475 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:07.883635 11409 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.918102  9070 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:07.923326 11576 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.923524 11565 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.923854 11576 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:07.918485  9069 rpcz_store.cc:276] 0709 12:14:05.837128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.878299 (+ 41171us) service_pool.cc:224] Handling call
0709 12:14:05.878673 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.887305 (+1008632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.917746 (+1030441us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:07.917927 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2243667840}
W20260709 12:14:07.897125 11481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.005s	sys 0.020s
I20260709 12:14:07.922381 11568 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.922818 11040 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:08.035808  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.113276  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1270) took 1238 ms. Trace:
I20260709 12:14:08.105369  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.120611  9072 raft_consensus.cc:2410] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:08.118705  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 193187us
W20260709 12:14:07.969470  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 54597.2us
W20260709 12:14:08.122960  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 320901us
I20260709 12:14:07.968075  9073 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:08.109369  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 255679us
I20260709 12:14:07.924367  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:07.952105  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.128866  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1155) took 1477 ms. Trace:
I20260709 12:14:08.130162  8997 rpcz_store.cc:276] 0709 12:14:06.651294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.921166 (+269872us) service_pool.cc:224] Handling call
0709 12:14:06.949332 (+ 28166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.957570 (+  8238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.957601 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:06.990366 (+ 32765us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.117888 (+127522us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:07.732055 (+614167us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:08.083501 (+351446us) log.cc:844] Serialized 14 byte log entry
0709 12:14:08.088219 (+  4718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.088327 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.088388 (+    61us) raft_consensus.cc:1685] finished
0709 12:14:08.128349 (+ 39961us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.128665 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":373329,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":9765,"raft.run_cpu_time_us":2552,"raft.run_wall_time_us":169023,"spinlock_wait_cycles":10373504,"thread_start_us":928590,"threads_started":2,"wal-append.queue_time_us":833332}
I20260709 12:14:07.695991  9618 rpcz_store.cc:276] 0709 12:14:05.997273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.999099 (+  1826us) service_pool.cc:224] Handling call
0709 12:14:06.108414 (+109315us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:06.124138 (+ 15724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:06.124188 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:06.125106 (+   918us) log.cc:844] Serialized 78 byte log entry
0709 12:14:06.444705 (+319599us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.713049 (+268344us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.604092 (+891043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.620941 (+ 16849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.626644 (+  5703us) raft_consensus.cc:1685] finished
0709 12:14:07.626664 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.635890 (+  9226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14660,"prepare.queue_time_us":192726,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":10167,"raft.queue_time_us":125220,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":3436,"thread_start_us":913346,"threads_started":2,"wal-append.queue_time_us":390531}
I20260709 12:14:07.623749  8917 rpcz_store.cc:276] 0709 12:14:06.000994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.027894 (+ 26900us) service_pool.cc:224] Handling call
0709 12:14:06.073704 (+ 45810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.074016 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:06.446117 (+372101us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.460466 (+1014349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.463641 (+  3175us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:07.480953 (+ 17312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.541561 (+ 60608us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.567859 (+ 26298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33952,"prepare.queue_time_us":316386,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":47370,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":113840,"thread_start_us":1200704,"threads_started":3,"wal-append.queue_time_us":668952}
I20260709 12:14:07.908268 10639 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.144240  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.152153  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:08.117194 11040 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.117529  8919 rpcz_store.cc:276] 0709 12:14:06.874761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.937902 (+ 63141us) service_pool.cc:224] Handling call
0709 12:14:06.944447 (+  6545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.444547 (+500100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.444592 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.563101 (+118509us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.781162 (+218061us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:07.781207 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.781280 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.108729 (+327449us) raft_consensus.cc:1685] finished
0709 12:14:08.108750 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.113208 (+  4458us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12048,"raft.queue_time_us":171764,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"thread_start_us":683145,"threads_started":2,"wal-append.queue_time_us":533569}
I20260709 12:14:07.964797 11573 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:07.965495 11475 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:08.156034  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.927986 11447 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:08.134582  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.926571 11576 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:07.912317 11571 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:08.157652 11593 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:14:08.104874 11566 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:14:08.167377  9065 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:08.243579  9065 pending_rounds.cc:85] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 2
I20260709 12:14:08.243896  9065 pending_rounds.cc:107] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:08.163687 11028 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.244166  9065 raft_consensus.cc:2889] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:08.085549 11495 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 12:14:08.186236 11233 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:14:08.163276 11491 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.933749 11493 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.143184 11565 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:14:08.199322 11333 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.196358 11456 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:08.197315 11576 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.197868 11575 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:08.200726 11492 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
W20260709 12:14:08.239931  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 94404.4us
I20260709 12:14:07.924427 11340 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.216064  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.205907  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1268) took 1332 ms. Trace:
I20260709 12:14:08.168906 11530 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.231194 10639 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:08.255259  8888 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.030s (SENT)
I20260709 12:14:08.157306 11568 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.263648  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1273) took 1300 ms. Trace:
I20260709 12:14:08.254664 11457 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.269277 11456 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.264484 11576 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.262274 11333 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.279633 10639 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.272056  8918 rpcz_store.cc:276] 0709 12:14:06.963450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.008114 (+ 44664us) service_pool.cc:224] Handling call
0709 12:14:07.055827 (+ 47713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.626640 (+570813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.629863 (+  3223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.639485 (+  9622us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.858156 (+218671us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:07.858293 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.858507 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.263402 (+404895us) raft_consensus.cc:1685] finished
0709 12:14:08.263422 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.263566 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39160,"spinlock_wait_cycles":91639168,"thread_start_us":652535,"threads_started":2,"wal-append.queue_time_us":314892}
I20260709 12:14:08.244057 11475 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.275892 11457 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.282315 11475 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.282503 11333 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.273274  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:08.265259  8920 rpcz_store.cc:276] 0709 12:14:06.873872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.897939 (+ 24067us) service_pool.cc:224] Handling call
0709 12:14:06.928553 (+ 30614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:07.445186 (+516633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.445228 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:07.556445 (+111217us) log.cc:844] Serialized 52 byte log entry
0709 12:14:07.855704 (+299259us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:07.855747 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.855824 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.205252 (+349428us) raft_consensus.cc:1685] finished
0709 12:14:08.205288 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.205800 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4888,"raft.queue_time_us":171765,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":78089,"thread_start_us":731027,"threads_started":2,"wal-append.queue_time_us":492555}
W20260709 12:14:08.285100  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 69170.4us
I20260709 12:14:08.267160 11525 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.256520 11028 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:08.289808  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.259193 11491 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.277444 11575 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:08.298509 11568 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.293219 11573 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.303900  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.291802 11527 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.310344 11575 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.311488 11529 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.310823 11340 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.311535 11576 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:08.321915  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.322655  9616 raft_consensus.cc:2376] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7. Re-sending same reply.
W20260709 12:14:08.334424  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.344544  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.345157  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.346937  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.347635  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.348520  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.350061  9623 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:08.350445  9623 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:08.350440  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:07.613586  9068 rpcz_store.cc:276] 0709 12:14:05.648543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.868327 (+219784us) service_pool.cc:224] Handling call
0709 12:14:05.888285 (+ 19958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:05.940030 (+ 51745us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:05.991299 (+ 51269us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.119873 (+1128574us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b1800396c40. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:14:07.595793 (+475920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.595856 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:07.595907 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.595986 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.596125 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44222,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":13280,"raft.queue_time_us":83,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8661,"spinlock_wait_cycles":5543680,"thread_start_us":475642,"threads_started":1}
I20260709 12:14:08.354667  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.325539  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:08.343464 11514 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.983s	user 0.012s	sys 0.002s
I20260709 12:14:08.362237  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:08.366008  8921 raft_consensus.cc:2410] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:08.357632  9623 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.376444  9623 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.351122  9618 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:08.379122  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 351) took 2031 ms. Trace:
I20260709 12:14:08.371459 11514 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.386453  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.387701  9070 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:08.399200  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:08.415934  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 167827us
I20260709 12:14:08.379523  8922 rpcz_store.cc:276] 0709 12:14:06.347745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.375938 (+ 28193us) service_pool.cc:224] Handling call
0709 12:14:06.376360 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.460316 (+ 83956us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:06.513312 (+ 52996us) log.cc:844] Serialized 14 byte log entry
0709 12:14:08.371518 (+1858206us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18003be5a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a
0709 12:14:08.378795 (+  7277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:08.378846 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:08.378887 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.378956 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.379068 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53952,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"spinlock_wait_cycles":15699200,"thread_start_us":409111,"threads_started":1,"wal-append.queue_time_us":725970,"wal-append.run_cpu_time_us":1253,"wal-append.run_wall_time_us":1004448}
I20260709 12:14:08.419770  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.421094  9624 raft_consensus.cc:2410] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:14:08.424463  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 91968.3us
I20260709 12:14:08.425318  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.426187  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.426290  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.429694  8992 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:08.432149  9037 connection.cc:256] RPC call timeout handler was delayed by -1.8811423420002029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 12:14:08.394979 11532 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.434758  8997 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.435920  8995 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.438351  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.441629  9623 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:08.442287 11383 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:08.430541 11280 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.004s
I20260709 12:14:08.431569  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.443051  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:08.445494 11603 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:14:08.447227 11477 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
W20260709 12:14:08.447867 11602 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:14:08.442391  8921 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.449901  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.450359  8918 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:08.451584  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.455104  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.458314  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.459192  8920 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:08.459440  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.459208  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.460089  8924 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:08.454583  9617 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:08.461943  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:08.462720 11546 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.338s	user 0.002s	sys 0.000s
I20260709 12:14:08.465538  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 457) took 2481 ms. Trace:
I20260709 12:14:08.466750 11375 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:08.467883  9623 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:08.465905  9066 rpcz_store.cc:276] 0709 12:14:05.984205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.984401 (+   196us) service_pool.cc:224] Handling call
0709 12:14:05.984811 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:05.985381 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.985411 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:05.985970 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:14:06.404986 (+419016us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:06.405032 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:06.405116 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.462105 (+2056989us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:08.465252 (+  3147us) raft_consensus.cc:1685] finished
0709 12:14:08.465274 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.465478 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":756,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":4829952,"thread_start_us":418577,"threads_started":1,"wal-append.queue_time_us":1025864}
I20260709 12:14:08.452435 11573 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.478328  9071 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:08.478931  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:08.479555  9068 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.479862  9065 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.481345  9069 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:08.482961  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.483806  9617 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:08.485442 11571 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.486007  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.487380 10639 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:14:08.489472  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.491746  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.492872  9624 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.493000  9000 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:08.453799 11456 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.467382 11375 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:08.495589  8918 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:08.496752  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.498370 11473 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.498714  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.497968  9068 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:08.520126 10639 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.536254 11485 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:14:08.536865  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.537559  9068 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:08.535969 10639 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.539898  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:08.536761  9620 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:08.498817 11383 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.538718  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.543651  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.544029  8921 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.471283  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.544245  8918 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.545245  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.547386 10639 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.548521  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.551059  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:08.551781  9624 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:08.468344 11491 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.501616  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.557494  8993 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:08.509624  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.553905  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55274.9us
I20260709 12:14:08.556432  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.556910 11448 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:08.559029  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.559180 11448 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.559631 11448 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.559860  9621 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:08.560705  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:08.562229  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.557744  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.557642  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.564163  8920 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.501329  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:08.569772 11404 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:08.577984 11572 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:08.578054 11404 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.568014  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:08.562880  8921 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:08.580035 11572 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.580433 11572 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:08.580693  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.581820 11457 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:08.566249  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.567060  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:08.583132  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.583820  8916 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 2.
I20260709 12:14:08.584713 11327 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:08.586910  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.587610  9622 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:08.588806 11514 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:08.568722  9587 connection.cc:256] RPC call timeout handler was delayed by -1.1081902890000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 12:14:08.583248 11404 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:08.600080  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.600518  9587 connection.cc:256] RPC call timeout handler was delayed by -1.0133191939999051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3139s for a response
W20260709 12:14:08.600749  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.600937  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.604676 11514 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:08.604867 11449 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:08.605194 11327 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.605468 11449 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.605679 11327 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.606070 11327 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.604681  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:08.609395  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.614862  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.615542  9621 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:08.615674  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:08.616559  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.617221  8993 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:08.535291 11573 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.623090  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.625504  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.622767  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.624850  9072 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.618000 11456 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.570137  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.635404  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:08.636489 11456 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.622666 11229 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:08.639498  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.640223  8993 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.643570  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.643647 11375 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.644953 11375 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.645017  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.605279 11514 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:08.649222  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.639354 11456 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.646351  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.652245  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.653110  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.654771  8994 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:08.655957  8920 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:08.656062  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1279) took 1449 ms. Trace:
I20260709 12:14:08.650329  9621 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:08.656273  8919 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.635746 11111 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.660629  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.663100 10639 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:08.577036 11040 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.664268  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.646310 11491 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:14:08.646348  8917 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:08.665058 11333 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.651624 11514 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.662324  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.668725  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:08.622880 11412 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:14:08.671480  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.662233  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:08.656527  8923 rpcz_store.cc:276] 0709 12:14:07.206925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.207112 (+   187us) service_pool.cc:224] Handling call
0709 12:14:07.230393 (+ 23281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.230774 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.230814 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.258883 (+ 28069us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.626707 (+367824us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:07.626745 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.629304 (+  2559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.644078 (+1014774us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18003f7480. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:08.646868 (+  2790us) raft_consensus.cc:1685] finished
0709 12:14:08.646888 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.655994 (+  9106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":502581,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":27493,"spinlock_wait_cycles":11534208,"thread_start_us":270180,"threads_started":1,"wal-append.queue_time_us":442706}
I20260709 12:14:08.677778  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.677923  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:08.648262  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47073.5us
I20260709 12:14:08.676018  9070 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:08.665736 11573 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.636021 11457 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:08.678486  8920 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:08.679401  8991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2404) took 2310 ms (client timeout 2011 ms). Trace:
W20260709 12:14:08.683490  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.683290  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:08.683635  8991 rpcz_store.cc:269] 0709 12:14:06.362354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.366448 (+  4094us) service_pool.cc:224] Handling call
0709 12:14:08.672769 (+2306321us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003dbb54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:08.672890 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380627840}
I20260709 12:14:08.685478  8996 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.682150 11383 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:14:08.685755  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.687086  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.687935  8917 raft_consensus.cc:2410] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:08.681304 11404 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.689507 11404 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:08.689873 11404 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.669998 11229 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:08.691413 11229 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.691807 11229 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.692535  8993 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:08.693624  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.698858  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.699679  8997 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:08.700590  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.700768 11525 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.701391  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.701745  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.702389  8997 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:14:08.703047  8966 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60214 dropped due to backpressure: service queue is full with 50 items
I20260709 12:14:08.698921  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:08.708395  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.709595  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.711304  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.712410 10639 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:08.716612 10639 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.717065 10639 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:08.712297  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50138us
I20260709 12:14:08.714659  8994 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.690613 11327 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.721400  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.718636  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.723770  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.724973  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.728320  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.680523 11492 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:08.722481  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:08.726622  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.680866 11447 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.728904  8997 raft_consensus.cc:2376] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:14:08.682027 11595 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:08.730512  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:08.732193  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.731755  8994 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.732673  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.736928  8921 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:08.738025  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.713083 11573 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.673818 11111 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.675180 11473 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:14:08.720657 11571 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:08.754061 11404 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.754837  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.755465 11447 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.728531 11233 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:08.760715  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.680819 11448 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.769019  8919 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:08.769410  8994 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:08.759863 11457 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.713383  8966 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60214 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 482)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 474)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2409)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1158)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1161)
I20260709 12:14:08.782298  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.738520 11595 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:08.782793  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.768741 11573 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.783648  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.794210  8998 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:08.783771 11473 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.784373 11028 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.787088  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.787616  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.788271  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.789101 11040 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.800246 10639 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.791440  8921 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 2.
I20260709 12:14:08.766767  8992 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:08.793577  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.730340 11492 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:08.797400 11457 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.814337  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.814780 11457 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.827410  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.815347  9067 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:08.819860  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:08.820279  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.830425  8994 raft_consensus.cc:2376] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7. Re-sending same reply.
I20260709 12:14:08.831622  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.832350  8994 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:08.821240  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.822541 10639 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:08.813031  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.823195  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.825219  8993 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:08.835305  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.849973  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.778947 11447 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:08.854362  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.854272  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.857802  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.859549  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.859992  8916 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:08.854229  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:08.861822  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65416.1us
I20260709 12:14:08.810511 11595 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.863878 11449 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:08.865082  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 74377.9us
I20260709 12:14:08.867383  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.896189  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.868503 11573 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.869422 11594 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.869474 11229 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.871978  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.904214  9074 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:08.873191 11327 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:08.874079  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:08.897528  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:08.878366 11111 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.881815  8920 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:08.883005  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.853982 11040 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:08.890089  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.910656  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:08.891949 11611 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:08.892053  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:08.921919  9623 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:08.923825  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:08.917963  9624 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:08.892863  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.799559 11473 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:08.896569  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.898012  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.906999  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.862680 11447 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.905519  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1142) took 2561 ms. Trace:
I20260709 12:14:08.812268 11571 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.909663  8922 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:08.919106  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:08.920621  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.934687  9622 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:08.928182  8999 raft_consensus.cc:2393] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:08.837229 11028 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:14:08.799288 11233 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:08.855536 11375 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:14:08.950742  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.933072  8996 rpcz_store.cc:276] 0709 12:14:06.343954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.388191 (+ 44237us) service_pool.cc:224] Handling call
0709 12:14:08.680479 (+2292288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.685939 (+  5460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.902905 (+216966us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54003dbb50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:08.905456 (+  2551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5253763968}
I20260709 12:14:08.954039  9070 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:08.952032  9069 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:08.902223 11485 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:08.952195  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:08.963986  8920 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.960966  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.951918  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.965456  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.964139  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.970784  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.971426  8999 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:08.972829  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.972222  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.974726  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.976985  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.976339 11280 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:08.978107  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.978559  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:08.979158  9000 raft_consensus.cc:2376] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:14:08.979494  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.980014  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.980600  9000 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:08.981401  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.981523  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.982388  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.982604  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.983223  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:08.983645  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1272) took 2045 ms. Trace:
I20260709 12:14:08.984115  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.984532 11571 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.984784  8995 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:08.985590  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:08.986755  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.988193  9069 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:08.988013 11514 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.990723 11493 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:08.990989  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.993544 11448 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:08.993705 11229 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.994817  9624 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.933898 11040 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.995663 11473 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.996307  9618 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:08.997227  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.997558 11040 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:09.000752 11233 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:08.950456 11383 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:09.002714 11383 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:09.003721 11383 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.992328 11449 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:08.982976  9000 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:09.008105 11456 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.009647  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:08.998878  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:08.992431 11404 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:09.004081  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:08.991272 11493 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:08.975417  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:08.919481 11594 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:08.986275  8995 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:14:09.041941  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.173960  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.073449  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.309029  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.468420  9070 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:09.020761  8920 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:09.127681  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:09.469672  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.469940  9624 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:09.471024  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.471669  9073 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:09.472527  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.051975  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53152.8us
I20260709 12:14:09.481254  8918 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.482012  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:09.474977 11594 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:09.476643  8996 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:09.380861  9616 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:09.354034 11447 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.487648  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 474) took 1037 ms. Trace:
I20260709 12:14:09.488217  8996 rpcz_store.cc:276] 0709 12:14:08.450042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.476153 (+1026111us) service_pool.cc:224] Handling call
0709 12:14:09.476456 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.487316 (+ 10860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.487566 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.072659 11229 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:09.489876  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.490993  9074 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:09.124064  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:09.124545 11511 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.984043  8925 rpcz_store.cc:276] 0709 12:14:06.938600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.947220 (+  8620us) service_pool.cc:224] Handling call
0709 12:14:06.947604 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.539567 (+591963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.539625 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.631214 (+ 91589us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.889347 (+258133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:07.889389 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.889463 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.977028 (+1087565us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b2400135f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8cfb0 00007f3985803488 00007f3985803be8 00007f39857db398 00007f39857d676a 00007f39857d5bb6
0709 12:14:08.983311 (+  6283us) raft_consensus.cc:1685] finished
0709 12:14:08.983342 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.983582 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16952,"raft.queue_time_us":168966,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":106,"spinlock_wait_cycles":47481600,"thread_start_us":801030,"threads_started":2,"wal-append.queue_time_us":506290}
I20260709 12:14:09.042726  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.466861  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.475663  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:09.508143  8999 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:09.480100  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 479) took 1004 ms. Trace:
W20260709 12:14:09.482613  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 478571us
W20260709 12:14:09.483632  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.010s	sys 0.007s
I20260709 12:14:09.487803  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:09.493000 11229 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:09.490118 11111 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.127334 11457 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:09.502182 11456 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:09.528335  9065 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:09.479859 11493 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.465961  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.509768  8918 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.510239  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:09.510742  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.007s
W20260709 12:14:09.531742  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.510962  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.512382  8919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.003s
W20260709 12:14:09.513597  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.509227  8995 rpcz_store.cc:276] 0709 12:14:08.475630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.985359 (+509729us) service_pool.cc:224] Handling call
0709 12:14:09.480024 (+494665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.517572  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:09.531795  8920 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 3: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:09.511798  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:09.534910  8995 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:09.535087  9073 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:09.535349  8919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.008s	sys 0.003s
I20260709 12:14:09.516551 11111 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:09.536859 11111 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.538097 11229 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:09.543922  9071 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:09.545687  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 481) took 1069 ms. Trace:
I20260709 12:14:09.546247  8995 rpcz_store.cc:276] 0709 12:14:08.476244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.534216 (+1057972us) service_pool.cc:224] Handling call
0709 12:14:09.534590 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.545336 (+ 10746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.545556 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.516186  8996 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:14:09.563890 11511 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:09.564319 11511 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:09.565213 11511 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:09.566061 11595 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.663s	user 0.003s	sys 0.003s
I20260709 12:14:09.566465 11511 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:09.567713  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:09.568357  8925 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:09.568496  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 475) took 1099 ms. Trace:
I20260709 12:14:09.568960  8996 rpcz_store.cc:276] 0709 12:14:08.450450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.489160 (+1038710us) service_pool.cc:224] Handling call
0709 12:14:09.515900 (+ 26740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.549302 (+ 33402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.549570 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.569267  8918 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
W20260709 12:14:09.562489  9623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.019s
W20260709 12:14:09.572412  9623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.019s
I20260709 12:14:09.514569 11375 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.576858 11447 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:09.581384  9072 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:09.577158  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 490) took 1096 ms. Trace:
I20260709 12:14:09.582222  8993 rpcz_store.cc:276] 0709 12:14:08.481019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.693336 (+212317us) service_pool.cc:224] Handling call
0709 12:14:09.576974 (+883638us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400325854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:09.577099 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300662144}
I20260709 12:14:09.582825  8964 leader_election.cc:400] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:09.583129  8964 leader_election.cc:403] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:09.583660  8993 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:09.584205  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2411) took 1101 ms. Trace:
I20260709 12:14:09.584491  8993 rpcz_store.cc:276] 0709 12:14:08.482590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.583058 (+1100468us) service_pool.cc:224] Handling call
0709 12:14:09.583362 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.583985 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.584157 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:09.508718  8924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.010s
W20260709 12:14:09.585733  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.010s
I20260709 12:14:09.572854  9073 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:09.580312  8998 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.584539  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:09.599992  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2414) took 1102 ms. Trace:
I20260709 12:14:09.600548  8993 rpcz_store.cc:276] 0709 12:14:08.483437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.585259 (+1101822us) service_pool.cc:224] Handling call
0709 12:14:09.585528 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.585696 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.585719 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.585762 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:09.585795 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.585844 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.585935 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:09.587298  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.006s	sys 0.032s
I20260709 12:14:09.603425  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2409) took 1121 ms. Trace:
I20260709 12:14:09.603729  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2410) took 1106 ms. Trace:
W20260709 12:14:09.603447  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.006s	sys 0.032s
I20260709 12:14:09.604183  8998 rpcz_store.cc:276] 0709 12:14:08.481886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.579829 (+1097943us) service_pool.cc:224] Handling call
0709 12:14:09.580149 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.587644 (+  7495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.587821 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.604482  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:09.603881  8996 rpcz_store.cc:276] 0709 12:14:08.481601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.570202 (+1088601us) service_pool.cc:224] Handling call
0709 12:14:09.587688 (+ 17486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.588036 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.588070 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.603106 (+ 15036us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:09.603152 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.603213 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.603369 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.606552  8998 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:09.607139  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2419) took 1122 ms. Trace:
W20260709 12:14:09.607704  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.000s	sys 0.011s
W20260709 12:14:09.604988  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 681197us
I20260709 12:14:09.607520  8998 rpcz_store.cc:276] 0709 12:14:08.484804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.605470 (+1120666us) service_pool.cc:224] Handling call
0709 12:14:09.605759 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.606898 (+  1139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.607086 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:09.608208  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.001s	sys 0.011s
I20260709 12:14:09.609110  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:09.609894  8998 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:09.612213  8996 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:09.612809  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1156) took 1037 ms. Trace:
I20260709 12:14:09.613147  8996 rpcz_store.cc:276] 0709 12:14:08.575204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.605876 (+1030672us) service_pool.cc:224] Handling call
0709 12:14:09.611918 (+  6042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.612571 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.612759 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.615206  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1157) took 1035 ms. Trace:
I20260709 12:14:09.618191  8998 rpcz_store.cc:276] 0709 12:14:08.575587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.608541 (+1032954us) service_pool.cc:224] Handling call
0709 12:14:09.608797 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.610329 (+  1532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.610804 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.620570  8998 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:14:09.621863  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2416) took 1137 ms. Trace:
I20260709 12:14:09.622357  8993 rpcz_store.cc:276] 0709 12:14:08.483991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.601766 (+1117775us) service_pool.cc:224] Handling call
0709 12:14:09.606655 (+  4889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.613338 (+  6683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.613378 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.621515 (+  8137us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:09.621577 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.621656 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.621798 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.624255  8993 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:09.624922  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1160) took 1035 ms. Trace:
I20260709 12:14:09.625312  8993 rpcz_store.cc:276] 0709 12:14:08.589258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.623513 (+1034255us) service_pool.cc:224] Handling call
0709 12:14:09.623868 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.624653 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.624862 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.626685  8993 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:09.613754  9615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.021s	sys 0.055s
I20260709 12:14:09.613816 11404 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:14:09.627776  9615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.021s	sys 0.055s
I20260709 12:14:09.628343  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1158) took 1052 ms. Trace:
I20260709 12:14:09.628762  8996 rpcz_store.cc:276] 0709 12:14:08.588604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.613989 (+1025385us) service_pool.cc:224] Handling call
0709 12:14:09.627786 (+ 13797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.627997 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.628029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.628075 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:09.628112 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.628172 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.628288 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.630213  8996 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:09.566479 11595 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.635463 11495 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.636978 11595 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:09.640367 11457 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:09.620993  8998 pending_rounds.cc:85] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 1
I20260709 12:14:09.651328  8998 pending_rounds.cc:107] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:14:09.651762  8998 raft_consensus.cc:2889] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:09.653605  8965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.000s	sys 0.011s
W20260709 12:14:09.655207  8965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.012s
I20260709 12:14:09.474058  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:09.673873  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 84383.6us
I20260709 12:14:09.614682 11620 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.680190  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 373) took 1193 ms. Trace:
I20260709 12:14:09.683329  8924 rpcz_store.cc:276] 0709 12:14:08.486529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.535486 (+ 48957us) service_pool.cc:224] Handling call
0709 12:14:08.547709 (+ 12223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.598226 (+ 50517us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:08.897586 (+299360us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.654260 (+756674us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.679742 (+ 25482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.679813 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:09.679865 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.679951 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.680119 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76420,"prepare.queue_time_us":1009654,"raft.queue_time_us":47320,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"spinlock_wait_cycles":4292864,"thread_start_us":872889,"threads_started":2}
I20260709 12:14:09.680709  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1159) took 1091 ms. Trace:
I20260709 12:14:09.656025 11457 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:09.686923  8998 rpcz_store.cc:276] 0709 12:14:08.588956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.619755 (+1030799us) service_pool.cc:224] Handling call
0709 12:14:09.620151 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.673080 (+ 52929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.680630 (+  7550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.687335 11457 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:09.617556 11514 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:09.695065  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 177552us
I20260709 12:14:09.696307  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:09.702109  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1161) took 1112 ms. Trace:
I20260709 12:14:09.702662  8993 rpcz_store.cc:276] 0709 12:14:08.589540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.626180 (+1036640us) service_pool.cc:224] Handling call
0709 12:14:09.626486 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.627084 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.702017 (+ 74933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.705725 11457 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:09.717294 11111 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.719795  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:09.720677  9620 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:09.721110  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 680) took 1161 ms. Trace:
I20260709 12:14:09.721434  9620 rpcz_store.cc:276] 0709 12:14:08.559315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.719515 (+1160200us) service_pool.cc:224] Handling call
0709 12:14:09.721049 (+  1534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:09.723735  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:09.689695 11620 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:09.737687  9066 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:09.738155  9066 pending_rounds.cc:85] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:09.738427  9066 pending_rounds.cc:107] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:14:09.738715  9066 raft_consensus.cc:2889] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:09.704991 11624 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.743673  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.737475 11620 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.741568 11628 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.740057 11629 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:09.793078  9066 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.792765  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:09.793293  8992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 473) took 1321 ms (client timeout 1601 ms). Trace:
W20260709 12:14:09.799273  8992 rpcz_store.cc:269] 0709 12:14:08.432826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.453020 (+ 20194us) service_pool.cc:224] Handling call
0709 12:14:09.752457 (+1299437us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:09.752598 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550808832}
I20260709 12:14:09.752897  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:09.804250  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51469.7us
I20260709 12:14:09.805749  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:09.742916 11624 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:09.818204  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.751820 11632 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.818831 11571 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.859697  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:09.864287 11111 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:09.865844  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.866541 11404 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
W20260709 12:14:09.859478  8821 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 330) took 13997 ms (client timeout 15000 ms). Trace:
I20260709 12:14:09.792902 11233 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.796401 11629 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.882148  9074 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:09.828246 11624 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.884806  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.884537 11629 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.887372  8997 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:09.888226 11572 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:09.879222  8821 rpcz_store.cc:269] 0709 12:13:55.826019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.845411 (+ 19392us) service_pool.cc:224] Handling call
0709 12:14:09.817814 (+13972403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:00.889686 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:01.037494 (+147808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:01.043974 (+  6480us) write_op.cc:435] Acquired schema lock
0709 12:14:01.046912 (+  2938us) tablet.cc:662] Decoding operations
0709 12:14:01.183977 (+137065us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:01.186884 (+  2907us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:01.194563 (+  7679us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:14:01.256185 (+ 61622us) tablet.cc:701] Row locks acquired
0709 12:14:01.256215 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:14:01.256428 (+   213us) write_op.cc:270] Start()
0709 12:14:01.256607 (+   179us) write_op.cc:276] Timestamp: P: 1783599241256368 usec, L: 0
0709 12:14:01.256640 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:14:01.257622 (+   982us) log.cc:844] Serialized 2422 byte log entry
0709 12:14:02.373899 (+1116277us) op_driver.cc:464] REPLICATION: finished
0709 12:14:02.706253 (+332354us) write_op.cc:301] APPLY: starting
0709 12:14:02.708159 (+  1906us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:02.723300 (+ 15141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:02.727560 (+  4260us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:02.728425 (+   865us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:02.728681 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:14:02.728730 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:02.729005 (+   275us) log.cc:844] Serialized 53 byte log entry
0709 12:14:02.729185 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.729297 (+   112us) write_op.cc:454] Released schema lock
0709 12:14:02.729343 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:02.729772 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.729820 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3578,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":307560,"apply.run_cpu_time_us":3128,"apply.run_wall_time_us":38147,"num_ops":6,"prepare.queue_time_us":162938,"prepare.run_cpu_time_us":28465,"prepare.run_wall_time_us":593597,"raft.queue_time_us":360451,"raft.run_cpu_time_us":11243,"raft.run_wall_time_us":210273,"replication_time_us":1099037,"thread_start_us":587601,"threads_started":4,"wal-append.queue_time_us":613167,"wal-append.run_cpu_time_us":27361,"wal-append.run_wall_time_us":1862849}]]}
I20260709 12:14:09.898798  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.892926 11111 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.874922 11571 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:09.905642 11571 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.908996  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1301) took 1296 ms. Trace:
W20260709 12:14:09.899791  9617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.031s
I20260709 12:14:09.909582  8921 rpcz_store.cc:276] 0709 12:14:08.607904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.921415 (+313511us) service_pool.cc:224] Handling call
0709 12:14:08.965104 (+ 43689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.009897 (+ 44793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.009930 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.043186 (+ 33256us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.725371 (+682185us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:09.725427 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.725514 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:09.903649 (+178135us) raft_consensus.cc:1685] finished
0709 12:14:09.903677 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.903844 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11072,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"thread_start_us":313387,"threads_started":1,"wal-append.queue_time_us":438712}
I20260709 12:14:09.919480 11572 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.897555  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 706) took 2627 ms. Trace:
W20260709 12:14:09.899820  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 407375us
I20260709 12:14:09.925174  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.926692  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:09.875211 11632 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.929582 11632 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:09.934814 11629 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:09.938727 11629 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:09.948787  9623 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:09.917604  9617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.000s	sys 0.032s
I20260709 12:14:09.924105  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:09.956704  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.899019 11404 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:14:09.961628  8963 leader_election.cc:336] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Timed out: RequestConsensusVote RPC to 127.7.137.4:33071 timed out after 1.696s (SENT)
W20260709 12:14:09.972577  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48594.1us
I20260709 12:14:09.978099  9616 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:09.979673  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:09.956780  9590 leader_election.cc:336] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.857s (SENT)
W20260709 12:14:09.987771  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.990314  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:09.990114 11511 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.984285 11565 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:09.990846 11626 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:14:10.010948  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:10.014353  8916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.011s	sys 0.022s
W20260709 12:14:10.014878  8916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.011s	sys 0.022s
I20260709 12:14:09.995012 11495 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:09.994681  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:10.016395  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1299) took 1455 ms. Trace:
I20260709 12:14:10.012136  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 684) took 1448 ms. Trace:
I20260709 12:14:10.017643  8916 rpcz_store.cc:276] 0709 12:14:08.561306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.863411 (+302105us) service_pool.cc:224] Handling call
0709 12:14:08.874886 (+ 11475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.875111 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:09.158515 (+283404us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.015582 (+857067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:10.016088 (+   506us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:10.016142 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.016219 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.016340 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":847139,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":40,"raft.queue_time_us":616,"thread_start_us":1139415,"threads_started":2}
I20260709 12:14:10.023736  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 472) took 1592 ms. Trace:
I20260709 12:14:10.024211  9000 rpcz_store.cc:276] 0709 12:14:08.431353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.008036 (+576683us) service_pool.cc:224] Handling call
0709 12:14:09.008393 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.008747 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.008773 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.047003 (+ 38230us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.899519 (+852516us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:09.899573 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.899664 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.023479 (+123815us) raft_consensus.cc:1685] finished
0709 12:14:10.023506 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.023669 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":488217,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":106,"thread_start_us":487273,"threads_started":1,"wal-append.queue_time_us":712759}
W20260709 12:14:10.029610 11280 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.004s
I20260709 12:14:10.015893 11565 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:10.009299 11511 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.032159 11565 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.034044 11511 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:10.034857 11493 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.017414 11514 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.036311  8995 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 7. Ops: []
I20260709 12:14:10.037624 11571 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:10.037866 11492 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.039738 11571 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:10.040866  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 474) took 1216 ms. Trace:
I20260709 12:14:10.041270 11493 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:10.041424  9072 rpcz_store.cc:276] 0709 12:14:08.823962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.960413 (+136451us) service_pool.cc:224] Handling call
0709 12:14:10.040547 (+1080134us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54003f02d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:10.040741 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376649984}
W20260709 12:14:10.045382  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.045053  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.047400 11514 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.049721 11514 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:10.055594  9619 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.056035  9619 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:10.056836  9619 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.057866  9619 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.059875 11624 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.061141  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 372) took 1596 ms. Trace:
I20260709 12:14:09.923647  9615 rpcz_store.cc:276] 0709 12:14:07.258732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.345152 (+ 86420us) service_pool.cc:224] Handling call
0709 12:14:07.345778 (+   626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.346217 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.346253 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.346819 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:14:08.298786 (+951967us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b180007c600. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9
0709 12:14:08.789787 (+491001us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b180007c600. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:09.628231 (+838444us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:09.628274 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.628364 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:09.867550 (+239186us) raft_consensus.cc:1685] finished
0709 12:14:09.869068 (+  1518us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.885779 (+ 16711us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9753,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":16664,"spinlock_wait_cycles":12045312,"thread_start_us":838245,"threads_started":1,"wal-append.queue_time_us":2439484}
I20260709 12:14:10.061525  8922 rpcz_store.cc:276] 0709 12:14:08.464369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.469740 (+  5371us) service_pool.cc:224] Handling call
0709 12:14:08.700398 (+230658us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:08.909457 (+209059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:08.933942 (+ 24485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.060948 (+1127006us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540015ac50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:10.061083 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483126016}
W20260709 12:14:10.062309  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 443286us
W20260709 12:14:10.066674  9065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2084) took 1288 ms (client timeout 1542 ms). Trace:
W20260709 12:14:10.073586  9065 rpcz_store.cc:269] 0709 12:14:08.778702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.779102 (+   400us) service_pool.cc:224] Handling call
0709 12:14:10.066392 (+1287290us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54000abc54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:10.066597 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580871552}
I20260709 12:14:10.072181  9073 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:10.075376  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85172.7us
I20260709 12:14:10.068341  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:10.088439  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:10.089623  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:10.090839  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:10.092356 11620 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:10.094866 11620 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:10.082551 11492 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.095367  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1291) took 1536 ms. Trace:
I20260709 12:14:10.095732  8919 rpcz_store.cc:276] 0709 12:14:08.559104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.862905 (+303801us) service_pool.cc:224] Handling call
0709 12:14:08.903378 (+ 40473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.001440 (+ 98062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.001469 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.001979 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.535781 (+533802us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:09.535833 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.094951 (+559118us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b5400245754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:10.095002 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.095052 (+    50us) raft_consensus.cc:1685] finished
0709 12:14:10.095066 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.095308 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225014656,"thread_start_us":533453,"threads_started":1,"wal-append.queue_time_us":585071}
W20260709 12:14:10.096971  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.097841  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:10.098392  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:10.098654  8991 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:10.098774  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:10.099510  8991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 496) took 1459 ms (client timeout 1819 ms). Trace:
W20260709 12:14:10.100019  8991 rpcz_store.cc:269] 0709 12:14:08.640061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.097563 (+1457502us) service_pool.cc:224] Handling call
0709 12:14:10.099437 (+  1874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.103137  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:10.124217  9587 connection.cc:256] RPC call timeout handler was delayed by -1.3802458440000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:14:10.130205  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 324490us
I20260709 12:14:10.131772  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.101063 11591 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.145630  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.119228 11515 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:10.158934  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 549865us
I20260709 12:14:10.118873 11645 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.160487  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.163376  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:10.164260  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:10.164676  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.010s
I20260709 12:14:10.129528 11375 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:10.138628 11575 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:10.166965  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.011s
I20260709 12:14:10.168772  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:10.169902  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 487) took 1692 ms. Trace:
I20260709 12:14:10.165292  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.137821 11511 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:10.177945  8995 rpcz_store.cc:276] 0709 12:14:08.477956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.548331 (+1070375us) service_pool.cc:224] Handling call
0709 12:14:09.548723 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.036672 (+487949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.169672 (+133000us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54002d7b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:10.169843 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120912768}
I20260709 12:14:10.127139 11233 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:10.177841  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 693155us
I20260709 12:14:10.233618  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:10.159760 11495 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.166047 11645 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.144325 11620 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:14:10.179636 11594 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.176898 11575 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.279795  9623 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:14:10.272545  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.029s
W20260709 12:14:10.277186  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 112001us
I20260709 12:14:10.159677 11411 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:14:10.233448 11263 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.285077  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 477) took 1821 ms. Trace:
I20260709 12:14:10.186209 11375 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:10.285833 11630 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.293139 11447 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:10.321761 11624 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:10.299211 11233 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.061326  9617 rpcz_store.cc:276] 0709 12:14:08.560412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.751939 (+191527us) service_pool.cc:224] Handling call
0709 12:14:08.752325 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.752552 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:08.975977 (+223425us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.982666 (+1006689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.984550 (+  1884us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:09.987564 (+  3014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.993436 (+  5872us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.009083 (+ 15647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5247,"prepare.queue_time_us":245575,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":8503,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":1413,"thread_start_us":1081395,"threads_started":2,"wal-append.queue_time_us":1014759}
W20260709 12:14:10.303781  9587 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.788s (SENT)
I20260709 12:14:10.349625  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:10.304764 11635 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.556s	user 0.004s	sys 0.000s
I20260709 12:14:10.304939 11473 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.284010 11575 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.168839 11457 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:14:10.182683 11135 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:14:10.245620 11111 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.184269  9621 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:10.248049 11645 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.246727  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:10.275175 11594 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:10.371515  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 138010us
W20260709 12:14:10.373765  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70023.4us
I20260709 12:14:10.329008  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1304) took 1461 ms. Trace:
W20260709 12:14:10.331733  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.007s	sys 0.032s
W20260709 12:14:10.376214  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 698882us
I20260709 12:14:10.377308  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:10.377954  8995 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:10.378724  9619 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:10.332444 11655 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:10.379839  9615 raft_consensus.cc:2410] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:14:10.379628 11655 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:10.332937  8888 connection.cc:256] RPC call timeout handler was delayed by -1.2689769510000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 12:14:10.325192  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 223297us
I20260709 12:14:10.183995 11511 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.341579  8999 rpcz_store.cc:276] 0709 12:14:08.463695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.532391 (+1068696us) service_pool.cc:224] Handling call
0709 12:14:09.567853 (+ 35462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.579303 (+ 11450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.579335 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.603559 (+ 24224us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.986222 (+382663us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:10.284391 (+298169us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.284674 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.284761 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.284807 (+    46us) raft_consensus.cc:1685] finished
0709 12:14:10.284823 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.285000 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3732,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":50802,"thread_start_us":634783,"threads_started":2,"wal-append.queue_time_us":464825}
W20260709 12:14:10.295894 11652 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:14:10.396423 11374 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:10.396826 11374 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:10.397594 11374 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.398785 11374 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.275753 11596 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:14:10.392704  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:10.365147  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 473) took 1541 ms. Trace:
I20260709 12:14:10.368259 11375 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.324172  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2114) took 1324 ms. Trace:
I20260709 12:14:10.405128  9068 rpcz_store.cc:276] 0709 12:14:09.000102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.503864 (+503762us) service_pool.cc:224] Handling call
0709 12:14:09.504224 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.504488 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:09.955666 (+451178us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.323763 (+368097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:10.323819 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:10.323865 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.323934 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.324099 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600,"prepare.queue_time_us":512531,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":116,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2717,"thread_start_us":789437,"threads_started":2}
W20260709 12:14:10.324584  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.407140  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.407634  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.381114  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:10.332772  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.375113  8917 rpcz_store.cc:276] 0709 12:14:08.867650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.466564 (+598914us) service_pool.cc:224] Handling call
0709 12:14:09.466871 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.467066 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:09.869473 (+402407us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.328528 (+459055us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:10.328608 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:10.328671 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.328764 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.328932 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272362,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1657,"raft.queue_time_us":481,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1379,"spinlock_wait_cycles":35456,"thread_start_us":834146,"threads_started":2,"wal-append.queue_time_us":506766}
W20260709 12:14:10.384132  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.384677  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:10.385078  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:10.387768 11655 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:10.391430 11108 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:14:10.371376 11638 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.394126  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:10.366091 11447 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:10.411366  8992 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 5: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:10.412833  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:10.404090  9067 rpcz_store.cc:276] 0709 12:14:08.823591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.978965 (+155374us) service_pool.cc:224] Handling call
0709 12:14:09.010076 (+ 31111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.486511 (+476435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.486541 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.504842 (+ 18301us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.910371 (+405529us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:09.910433 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.346061 (+435628us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002d46d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:10.346114 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.346168 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:10.346181 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.365058 (+ 18877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34621,"raft.queue_time_us":13456,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":18596,"spinlock_wait_cycles":1065629568,"thread_start_us":405106,"threads_started":1,"wal-append.queue_time_us":525503}
I20260709 12:14:10.380692 11594 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.392704 11511 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:10.416342  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.421384  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:10.430999  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 98308.7us
I20260709 12:14:10.424309  8992 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:10.425614  8993 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:10.424633  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:10.453342  8999 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.454603  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.412675 11514 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:10.458976  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46218.8us
I20260709 12:14:10.416165  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 678) took 1859 ms. Trace:
I20260709 12:14:10.419111 11655 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.417060 11495 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.417579 11333 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:10.461396 11263 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.467212  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2408) took 1985 ms (client timeout 1956 ms). Trace:
W20260709 12:14:10.470237  8997 rpcz_store.cc:269] 0709 12:14:08.481328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.749729 (+1268401us) service_pool.cc:224] Handling call
0709 12:14:10.466936 (+717207us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b54000f4bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:10.467120 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203762944}
W20260709 12:14:10.469444  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 298701us
I20260709 12:14:10.471704  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.473308  9067 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:10.473341  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:10.475888 10639 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.476507 10639 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:10.477573  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.471771  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.487670  9074 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:10.422588 11571 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.492336  9623 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.494796  9067 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:10.461402  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.418380 11280 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:14:10.418606 11624 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:14:10.422263 11661 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:10.518662  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.460935 11514 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:10.520279  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:10.520927  9069 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:10.497786  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.504908  9067 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:10.430454  9620 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:10.516891  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:10.466796 11655 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:10.523490  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.467911 11333 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:10.531488  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70171.2us
I20260709 12:14:10.532974  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:10.537562  8999 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:10.467710 11485 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:10.465138 11660 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:10.540699  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 134731us
I20260709 12:14:10.545596  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:10.494439 11650 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.494261 11135 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.551081  9623 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:10.551659  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57839.2us
W20260709 12:14:10.524447 11663 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:10.559286 10639 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:10.493187 11638 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:10.554912  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.489409 11495 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.539680 11655 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.519308 11532 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.557819  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:10.576710  8964 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.502s (SENT)
I20260709 12:14:10.577162  9622 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:10.577350  8964 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.506s (SENT)
I20260709 12:14:10.577782  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.466475  9619 rpcz_store.cc:276] 0709 12:14:08.556665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.639538 (+ 82873us) service_pool.cc:224] Handling call
0709 12:14:08.639878 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.055484 (+1415606us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b5400771b20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb2dc0 00007f3985c3d1c0 00007f3985c3e231 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c
0709 12:14:10.381980 (+326496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.414770 (+ 32790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144476032}
I20260709 12:14:10.550671 11485 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.540576 11333 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:10.524574 11572 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:14:10.579999  8964 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.538s (SENT)
W20260709 12:14:10.586629  8964 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.562s (SENT)
I20260709 12:14:10.587052  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.588434 11135 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:10.517263 11571 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:10.569309 11657 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:14:10.490540 11263 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.585263 11630 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.580771 11638 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.561364 11527 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.527798 11447 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:10.589917  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 174433us
I20260709 12:14:10.592317  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.572293 11677 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:10.602792  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47967us
W20260709 12:14:10.594022  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 134186us
I20260709 12:14:10.606626  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.593382 11660 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.611799  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.614992  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:10.604568 11527 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:10.649780 11656 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:14:10.676033 11673 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:10.649227 11527 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.649434 11677 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:10.725412  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 113707us
I20260709 12:14:10.620779 11532 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.801752 11495 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:10.805102  9618 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:10.805986 11672 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.008s
I20260709 12:14:10.609504 11411 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:10.806566  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.624264 11650 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:10.812417 11263 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:10.815357  8994 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:10.817873 11514 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.930837 11674 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:10.931036 11514 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.818184 11655 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.935315 11650 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:10.935833 11650 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.936919 11655 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:10.937542 11655 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:10.589303 11666 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:14:10.938874  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.821372 11638 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:10.683549 11135 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:10.822549  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.824985  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.830533  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:10.830932  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:10.943815  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.832047 11457 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:10.832792  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.803217 11594 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:10.839427  8964 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.199s (SENT)
I20260709 12:14:10.949206  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.806442  9622 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:10.855100  9623 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:10.859205  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:10.861531  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 247752us
I20260709 12:14:10.951011  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.912235  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:10.844383 11645 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:10.916708  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 366381us
I20260709 12:14:10.844947 11571 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:10.922901  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:10.819706 11671 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.198s	user 0.004s	sys 0.013s
W20260709 12:14:10.939600  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.947250  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.949391  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 124483us
I20260709 12:14:10.950058  9069 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:10.928069 11411 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:10.965106  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.964249  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 140980us
I20260709 12:14:10.970628  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:10.972594  8964 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.228s (SENT)
I20260709 12:14:10.973192  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.916116 11333 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:10.965240  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 358613us
I20260709 12:14:10.922730 11591 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:14:10.983055  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.993196  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:10.948745 11511 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:10.995493  9065 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:10.999514  9068 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:10.975520  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 116451us
W20260709 12:14:10.996246  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.008846  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.016039  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44713.9us
I20260709 12:14:10.960707 11677 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.037663  8823 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 4 to 5, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.017138  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.034926 11511 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.016963  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:11.015726 11374 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:14:11.034564 11485 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.974275 11263 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:10.999311 11456 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:14:10.960538 11457 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.974062 11492 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:14:10.999493 11661 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:10.918677 11575 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:10.998311 11532 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:10.963665 11108 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:14:10.981092 11411 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.184214  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:10.938009 11655 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:10.980821 11233 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:10.960934 11682 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:10.979347 11660 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:11.228662  8964 leader_election.cc:336] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.644s (SENT)
W20260709 12:14:11.252844  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 259752us
W20260709 12:14:11.255807  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.300743  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.256263  8823 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.221446 11473 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.000655 11659 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
W20260709 12:14:11.262678  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 267342us
I20260709 12:14:11.309778  8823 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 4 to 7, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:11.310599  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.272945 11591 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.031497 11596 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 12:14:11.247167  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 427) took 1288 ms. Trace:
W20260709 12:14:11.306792  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 78162.7us
I20260709 12:14:11.287670 11678 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:11.316910  8994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1168) took 2719 ms (client timeout 2008 ms). Trace:
I20260709 12:14:11.279747  9071 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:11.309953 11233 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:11.329207 11694 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:11.329736 11594 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.329031  8823 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:11.331105  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 147198us
I20260709 12:14:11.448261  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:11.449122 11620 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.227392 11688 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.451457  8925 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:11.452636  8918 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.452721  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.453624  8925 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:11.333230  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 316299us
I20260709 12:14:11.305779 11571 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.454414  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.268429 11532 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:11.247030  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:14:11.455621  8917 raft_consensus.cc:606] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:11.456020  8917 raft_consensus.cc:614] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:11.457666  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.382771  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1177) took 1004 ms. Trace:
I20260709 12:14:11.458184  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.458318  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.458846  9622 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:11.458387  8995 rpcz_store.cc:276] 0709 12:14:10.378704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.378873 (+   169us) service_pool.cc:224] Handling call
0709 12:14:10.379382 (+   509us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:10.380033 (+   651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:10.380094 (+    61us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:10.382312 (+  2218us) log.cc:844] Serialized 78 byte log entry
0709 12:14:10.493526 (+111214us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:10.553185 (+ 59659us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.555932 (+  2747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.556009 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.825787 (+269778us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b18003ebf00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:11.332445 (+506658us) raft_consensus.cc:1685] finished
0709 12:14:11.382547 (+ 50102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.382708 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2407,"prepare.queue_time_us":63429,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2375,"raft.queue_time_us":3933,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":5658,"spinlock_wait_cycles":20832640,"thread_start_us":103636,"threads_started":1,"wal-append.queue_time_us":196189}
W20260709 12:14:11.382746  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.460399 11688 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:11.309880 11665 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:11.316236 11661 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.461939 11688 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:11.315943 11263 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.462458 11688 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:11.393994  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.462855  8918 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:11.404841 11691 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:14:11.408445 11649 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.409355  9099 heartbeater.cc:646] Failed to heartbeat to 127.7.137.62:33577 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.137.62:33577 timed out after 15.000s (SENT)
I20260709 12:14:11.463922 11649 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.463402 11688 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.409101 11703 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:11.420487  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 717) took 1248 ms. Trace:
I20260709 12:14:11.467089  9621 rpcz_store.cc:276] 0709 12:14:10.171600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.171813 (+   213us) service_pool.cc:224] Handling call
0709 12:14:10.183889 (+ 12076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:10.184110 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:10.804220 (+620110us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.995131 (+190911us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.231734 (+236603us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.420002 (+188268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:11.420075 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:11.420138 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.420235 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.420405 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261440,"prepare.queue_time_us":71592,"prepare.run_cpu_time_us":6207,"prepare.run_wall_time_us":200631,"raft.queue_time_us":227240,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11099,"spinlock_wait_cycles":67276160,"thread_start_us":337684,"threads_started":2}
I20260709 12:14:11.461970 11665 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.410028 11645 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.476902 11575 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.478396 11665 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.466666 11649 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:11.479887 11693 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:14:11.479964  8925 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.481369  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.455442 11532 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.394115  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.335819 11678 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:11.332055 11591 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:11.335901  8994 rpcz_store.cc:269] 0709 12:14:08.597850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.964708 (+366858us) service_pool.cc:224] Handling call
0709 12:14:11.316741 (+2352033us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400324454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:11.316843 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4220555520}
I20260709 12:14:11.390616 11659 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.460160  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:14:11.276684 11666 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:11.466426 11688 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.482059  8925 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:11.491101  8823 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.482715  8922 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.310087 11682 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.485040  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:11.486213  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 469105us
I20260709 12:14:11.486819  8917 raft_consensus.cc:606] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:11.475531 11670 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.410197 11333 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:11.475263 11684 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:14:11.454813 11571 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.331808  9618 rpcz_store.cc:276] 0709 12:14:09.948227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.951570 (+  3343us) service_pool.cc:224] Handling call
0709 12:14:11.049707 (+1098137us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540069f354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:11.232655 (+182948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684447104}
I20260709 12:14:11.493566  8917 raft_consensus.cc:614] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:11.412245 11473 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.400076 11374 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 12:14:11.499115  8888 connection.cc:256] RPC call timeout handler was delayed by -1.1539703109999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:14:11.440680  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.508817  8916 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:11.510763  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 197624us
W20260709 12:14:11.511264  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.511775  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.513134  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.513691  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.519948 11457 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.519447  8823 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 5 to 6, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 6 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.520310 11233 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.522349 11111 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.523028 11111 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:11.509915  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.523118  9066 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:11.489578 11666 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:11.525545  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.529973  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.524619 11571 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.532392  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.533025 11666 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.534157  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.534637 11620 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.535691  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.536757  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.537595  9068 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:11.522380  8823 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.539393  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.540539  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:11.544025  9068 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:11.525481 11527 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 12:14:11.559300  9069 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.525710 11473 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.561066  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.560935  8823 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.562143  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.562536  8823 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.526254 11374 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:11.560431 11263 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.563759  9073 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:11.568233  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.566829  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.568902  9069 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:11.524259 11655 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.524394 11591 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.570077  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:11.564460 11485 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.577543 11686 raft_consensus.cc:2764] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:11.579298  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.580531  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.581405  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:11.567291  8823 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.570380 11620 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.571560  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:11.594918  8998 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.572180  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:11.595626  8992 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.523129 11682 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.574323  8995 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:11.599128  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.575480  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:11.601321  9000 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.564563 11511 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.583388  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566f7a1027e341e88b14a77db605c154"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
W20260709 12:14:11.604290  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.582449  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:11.586737  8964 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.583009  8994 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:14:11.567620 11650 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.006s
W20260709 12:14:11.607954  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 61633.4us
I20260709 12:14:11.608508  8992 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:14:11.612154  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.563216 11233 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:11.525871 11411 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.604424  8924 raft_consensus.cc:606] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:11.582425 11565 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.562562 11473 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.669595  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:11.670354  8993 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:11.598497 11695 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:14:11.674976  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:11.675138  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77499us
I20260709 12:14:11.624394  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.675540  9073 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:11.625031  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:11.625116  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:11.626513  8823 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:11.603583 11495 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:11.628615  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:11.620882 11515 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.567844 11374 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:11.662958  8919 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.666050  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.667593  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:11.542580  8922 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:11.682615  9622 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:11.682788  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.679759  8924 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:11.671999  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 135303us
I20260709 12:14:11.675897  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:11.627978  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:11.678992  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 253682us
I20260709 12:14:11.621552 11689 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.567461 11527 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.681830  9616 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:14:11.699174  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 159914us
I20260709 12:14:11.708418  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.709139  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:11.699368  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 157810us
W20260709 12:14:11.710158  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 82958.5us
I20260709 12:14:11.710427  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.698055  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.698657  9072 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.718560  9000 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:11.524602 11678 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.622870 11233 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:11.720331  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:11.772308  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 63607.2us
W20260709 12:14:11.780952  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 105133us
I20260709 12:14:11.781203  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.721395  8993 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:11.775337  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.782315  9616 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:11.782784  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.720855  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.721344  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:11.776007  8823 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.785794  8993 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:11.662142 11263 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.776825  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:11.662644 11645 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:11.679594 11495 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:11.633298 11630 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 12:14:11.662034 11575 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.783483 10639 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:11.784631  9068 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:11.720841  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:11.789073  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 74401.4us
I20260709 12:14:11.620998 11661 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.791318 11678 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:11.793845  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.631785 11707 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.707957 11689 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:11.781685  8924 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:11.806797  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.677073 11565 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.603744 11620 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.624295 11650 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.812489  8823 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:11.816556  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 305706us
W20260709 12:14:11.835367  8888 connection.cc:256] RPC call timeout handler was delayed by -1.07747031100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:14:11.708173 11473 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:14:11.787451 11111 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.790032  9000 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:11.791721 11404 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.829574  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.719892 11515 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.697000 11670 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 12:14:11.801455 11495 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.771766 11660 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
W20260709 12:14:11.832101  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 118394us
I20260709 12:14:11.800359 11645 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:11.836004  8888 connection.cc:256] RPC call timeout handler was delayed by -1.0630703110000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:14:11.790781 11710 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:11.830883 11263 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.875733  9624 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:11.874182  8997 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:11.802004 11709 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:11.827637 11630 consensus_queue.cc:1243] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:11.881095  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.847465  8823 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 2 to 3, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 3 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.873829  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:11.882987  8919 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:11.878664  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 193395us
W20260709 12:14:11.885353  8888 leader_election.cc:336] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.926s (SENT)
I20260709 12:14:11.886812  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:11.892127  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47230us
I20260709 12:14:11.893051  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:11.897553  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.826663 11575 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:11.914005  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:11.853001 11477 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:11.928984  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43674.7us
W20260709 12:14:11.930698  8888 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.011s (SENT)
I20260709 12:14:11.931367  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:11.929160  8963 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:11.873929 11710 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:11.933971  9073 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:11.881253 11709 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.912741 11682 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.823398 11374 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.948140 11374 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.951403 11711 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:11.951680  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:11.934378  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:11.856738 11706 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:14:11.956847  9074 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:11.957201 11515 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:11.858644 11714 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:14:11.957702  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.958863  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:11.960536 11620 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:11.858664 11703 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:14:11.909720 11661 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:11.916141 11660 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:11.981513  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50862.6us
W20260709 12:14:11.982712  8888 leader_election.cc:336] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.107s (SENT)
I20260709 12:14:11.847282 11111 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.917949 11457 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:14:11.913108 11670 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:11.930334 11473 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.916347  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:11.941628 11709 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.946933 11630 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:11.852442 11404 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.932838 11700 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.965596  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:11.966127 11620 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.959018 11650 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:11.931924  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:11.889678 11263 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:11.992143  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.996008  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.997471  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:11.997525  9073 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:12.039166  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 194872us
I20260709 12:14:11.945245 11575 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:11.942338 11682 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:12.004606 11411 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:12.010957  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.852416 11233 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.937638 11477 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:11.981177 11660 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:12.039351  9622 raft_consensus.cc:2376] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7. Re-sending same reply.
I20260709 12:14:11.993340 11698 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.840864 11707 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.025377  9619 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.041571  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:12.041432  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.001585 11473 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:11.937578 11710 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.091658  8993 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:12.059870  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.092703  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.092784  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.062402  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.095597  9000 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:11.986858 11515 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:14:12.036592 11527 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.039906  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:12.071188 11659 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.005s
I20260709 12:14:12.100584  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:12.102476  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.107511  8993 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:12.106709  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 52643.9us
I20260709 12:14:12.074965 11650 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:11.987448 11661 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.109649  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.116631  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:12.120927  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.118114  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.121726  8993 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:12.104352 11233 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.961333 11689 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.124590  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:12.005684 11670 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.108944 11659 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.137255  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:12.066985 11726 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:14:12.137777  8998 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.004s
I20260709 12:14:12.139891  8998 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:12.140575  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:12.127573 11666 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:14:12.105453 11280 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:12.128696 11527 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.152552  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.156438  8993 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:12.116945 11655 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:14:12.142992 11565 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.144418 11689 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.171460 11527 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.177481  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:12.175096 11700 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:12.173108 11732 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:14:12.132863 11735 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.146737 11473 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.177140 11714 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:12.175870  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.177023  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:12.132557 11653 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:14:12.195400 11700 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.183982 11263 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.230228 11700 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:12.181440 11721 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:14:12.189755 11111 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.188447 11404 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.231400  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.148855 11729 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:12.232299 11729 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:12.232702  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.141386 11645 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:12.158337 11650 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:12.180601  9069 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.237898 11650 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.187850  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:12.191823  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.181092  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.149055 11666 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.233577  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:12.233675  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 268391us
I20260709 12:14:12.203564  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:12.209952  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:12.188649 11738 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.174764  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:12.192727  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.221685  8924 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:12.224427  8993 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:12.266162  8923 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:12.173511  8998 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.249192  9622 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:12.252031  9623 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:14:12.188197 11739 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:14:12.252784  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:12.194519 11688 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
W20260709 12:14:12.205416 11532 consensus_meta.cc:287] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.003s
I20260709 12:14:12.282979  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.276219  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.195565 11565 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.220695  9619 raft_consensus.cc:2410] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:14:12.278568  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.199859 11477 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.279314  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.233134 11729 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:12.275651  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 138496us
I20260709 12:14:12.186455 11527 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.212765 11473 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.196631 11661 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.207113 11714 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:12.284412  8992 raft_consensus.cc:2376] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6. Re-sending same reply.
W20260709 12:14:12.283777  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 80296.3us
W20260709 12:14:12.459208  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.456633  8921 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:12.285084  9065 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.204016 11707 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:12.292850  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.660760  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.196581 11670 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.298936  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:12.297016 11630 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.219686 11710 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:12.669274  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.324412  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:12.278038 11738 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.278797  9618 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:12.355950 11753 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.320541 11725 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:12.525143  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.561617 11689 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.212554 11495 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.675607 11756 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:12.662618  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.680145  9000 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:12.660812  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.681406  9622 raft_consensus.cc:2410] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:12.658443  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.667584  8998 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:12.375746 11746 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:14:12.672857  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:12.673934  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 349585us
W20260709 12:14:12.668069 11709 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 12:14:12.468034  9623 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:12.457711 11404 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.296868 11565 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.357481  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.295847 11532 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.699846  9622 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:12.700485  9622 pending_rounds.cc:85] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 5
I20260709 12:14:12.700783  9622 pending_rounds.cc:107] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:12.701084  9622 raft_consensus.cc:2889] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:12.701576 11532 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:12.379705  9587 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.819s (SENT)
I20260709 12:14:12.702338  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:12.702618 11677 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.703070  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2617) took 1171 ms. Trace:
W20260709 12:14:12.703195  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 323528us
I20260709 12:14:12.693974 11711 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:12.704419  9587 leader_election.cc:336] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.079s (SENT)
I20260709 12:14:12.704365 11711 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.704888  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.703107 11677 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:12.705461  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.705663 11738 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.706147  8994 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:12.705915 11677 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.682644  8923 raft_consensus.cc:2410] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:12.707811 11374 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.708065  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.708330 11374 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.708832  8923 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:12.709414  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 377) took 1259 ms. Trace:
I20260709 12:14:12.709694  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:12.709761  8920 rpcz_store.cc:276] 0709 12:14:11.450220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.451774 (+  1554us) service_pool.cc:224] Handling call
0709 12:14:11.452157 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.563379 (+111222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:11.563408 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:11.563860 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:14:11.835077 (+271217us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:11.835114 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.690660 (+855546us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b540015a254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:12.690703 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:12.690746 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:12.690758 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.709359 (+ 18601us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106111,"raft.queue_time_us":36256,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":29067,"spinlock_wait_cycles":177475968,"thread_start_us":270847,"threads_started":1,"wal-append.queue_time_us":344954}
I20260709 12:14:12.683161  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:12.683733  8993 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:14:12.715659  9587 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.123s (SENT)
I20260709 12:14:12.703487  9066 rpcz_store.cc:276] 0709 12:14:11.531359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.536916 (+  5557us) service_pool.cc:224] Handling call
0709 12:14:11.564473 (+ 27557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.564699 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:11.807662 (+242963us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.702812 (+895150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.702855 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:12.702891 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.702940 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.703022 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718627,"prepare.queue_time_us":359499,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":714205,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":20124928,"thread_start_us":380658,"threads_started":2,"wal-append.queue_time_us":309967}
I20260709 12:14:12.716725 11477 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.684561  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.719422 11280 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:12.719470 11653 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:12.721448 11374 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.719538  9000 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:12.722944  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:12.688051  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 793568us
I20260709 12:14:12.723737  9620 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:12.724252  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:12.725155  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.725991  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:12.726485  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.687703 11263 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.689057  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2612) took 1813 ms. Trace:
I20260709 12:14:12.362507 11666 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:12.672277 11679 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:12.675714 11630 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:12.698313  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 376) took 1240 ms. Trace:
I20260709 12:14:12.699626 11565 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.674083  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.714560  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.716117  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:12.685207  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 482) took 1176 ms. Trace:
I20260709 12:14:12.682538  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.733780  8916 rpcz_store.cc:276] 0709 12:14:11.449910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.454151 (+  4241us) service_pool.cc:224] Handling call
0709 12:14:12.690269 (+1236118us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b5400019354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:12.690403 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123494144}
I20260709 12:14:12.734244  8923 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:12.736177  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.709204 11404 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.732797 11411 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:12.739889  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.734246  9067 rpcz_store.cc:276] 0709 12:14:11.509366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.509496 (+   130us) service_pool.cc:224] Handling call
0709 12:14:11.509817 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.510016 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:11.837298 (+327282us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.684755 (+847457us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800396880. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:12.684885 (+   130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.684932 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:12.684971 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.685037 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.685155 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28175,"prepare.queue_time_us":365760,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4441,"raft.queue_time_us":766438,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3983,"spinlock_wait_cycles":18084224,"thread_start_us":379415,"threads_started":2,"wal-append.queue_time_us":165514}
I20260709 12:14:12.741036  8998 raft_consensus.cc:2368] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7.
I20260709 12:14:12.680780 11753 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:12.739303  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.728850  9072 rpcz_store.cc:276] 0709 12:14:10.875580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.875714 (+   134us) service_pool.cc:224] Handling call
0709 12:14:10.924398 (+ 48684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.712794 (+788396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.688849 (+976055us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54001b6f54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:12.689002 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780080000}
I20260709 12:14:12.727129  9620 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:12.681236 11689 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.748175  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.764614  8998 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:12.775597  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.829137  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:12.732388 11679 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:12.738521 11374 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:12.783155  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:12.748277 11411 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:12.777240  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.792064 11565 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.738540 11630 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.738654 11708 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:14:12.781039 11670 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:14:12.798969  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.811143  8992 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:12.811851  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1313) took 1481 ms. Trace:
I20260709 12:14:12.873508  8921 rpcz_store.cc:276] 0709 12:14:11.330818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.331205 (+   387us) service_pool.cc:224] Handling call
0709 12:14:12.811706 (+1480501us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54000c9c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:12.811796 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887453440}
I20260709 12:14:12.741276 11714 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.813962  9617 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:12.814298  9072 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.816944  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1191) took 1202 ms. Trace:
I20260709 12:14:12.875500  8994 rpcz_store.cc:276] 0709 12:14:11.614053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.626125 (+ 12072us) service_pool.cc:224] Handling call
0709 12:14:11.679170 (+ 53045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.706553 (+1027383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.816630 (+110077us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540039b2d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:12.816866 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361383680}
I20260709 12:14:12.820526 11689 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.822836 11495 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:12.825479  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.696878 11709 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.830912  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.867362  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:12.872690  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.877123  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:12.872159 11759 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:14:12.888927  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:12.890475  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.892194  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:14:12.893306  8920 raft_consensus.cc:606] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:12.893582  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.893896  8920 raft_consensus.cc:614] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.867607 11374 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:12.887357  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.882017  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.895052  8994 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.896107  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.897135  8998 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:12.868794  9618 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:12.878710 11565 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.907779  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.910955  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:12.914204  8998 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:12.920186  8922 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:12.912163  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35278 (request call id 32) took 1078 ms. Trace:
I20260709 12:14:12.922686  8916 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.923555  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1324) took 1407 ms. Trace:
I20260709 12:14:12.923870  8916 rpcz_store.cc:276] 0709 12:14:11.516277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.891789 (+1375512us) service_pool.cc:224] Handling call
0709 12:14:12.922453 (+ 30664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.923226 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.923487 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:12.922343  8920 rpcz_store.cc:276] 0709 12:14:11.816539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.892030 (+1075491us) service_pool.cc:224] Handling call
0709 12:14:12.894909 (+  2879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:12.892992 11473 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:12.892194 11751 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.931994  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:12.897174 11714 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.908172 11477 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.876235 11753 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.908367 11738 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:12.939152  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 223507us
I20260709 12:14:12.920908 11532 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:12.942633  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1325) took 1426 ms. Trace:
I20260709 12:14:12.949827  8916 rpcz_store.cc:276] 0709 12:14:11.516515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.924555 (+1408040us) service_pool.cc:224] Handling call
0709 12:14:12.942007 (+ 17452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.942232 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.942269 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.942325 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:12.942369 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.942437 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.942565 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:12.921181 11710 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.944849  8923 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.910486 11263 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.919730 11650 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.921339  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 724) took 1019 ms. Trace:
I20260709 12:14:12.939301  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:12.946853  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 436) took 1055 ms. Trace:
W20260709 12:14:12.947355  9587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.199s (SENT) [suppressed 46 similar messages]
I20260709 12:14:12.920087 11404 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:12.956946  8994 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:12.959987  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2052) took 1177 ms. Trace:
I20260709 12:14:12.961292  9621 rpcz_store.cc:276] 0709 12:14:11.891016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.891167 (+   151us) service_pool.cc:224] Handling call
0709 12:14:12.242175 (+351008us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:12.242361 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.242730 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.242756 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.244272 (+  1516us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.609291 (+365019us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:12.609351 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.609449 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:12.946563 (+337114us) raft_consensus.cc:1685] finished
0709 12:14:12.946590 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:12.946796 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":24867,"spinlock_wait_cycles":61838080,"thread_start_us":311878,"threads_started":1,"wal-append.queue_time_us":509245}
I20260709 12:14:12.964633  8923 rpcz_store.cc:276] 0709 12:14:11.782390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.926110 (+1143720us) service_pool.cc:224] Handling call
0709 12:14:12.944662 (+ 18552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.959679 (+ 15017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.959915 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:12.965538  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 1.03115e+06us
I20260709 12:14:12.966172  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.927695 11565 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.970912  8994 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:12.972714  8916 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:12.973234  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.974521  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1330) took 1190 ms. Trace:
I20260709 12:14:12.975662  8923 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:12.978085  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1334) took 1160 ms. Trace:
I20260709 12:14:12.958076 11111 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:12.978578  8923 rpcz_store.cc:276] 0709 12:14:11.817808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.965424 (+1147616us) service_pool.cc:224] Handling call
0709 12:14:12.975468 (+ 10044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.976525 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.978001 (+  1476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:12.976807  8916 rpcz_store.cc:276] 0709 12:14:11.784311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.951315 (+1167004us) service_pool.cc:224] Handling call
0709 12:14:12.969929 (+ 18614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.974184 (+  4255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.974451 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:12.938890 11473 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.983453  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:12.963973 11495 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:12.969497 11280 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:12.970470 11404 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:12.990473  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
W20260709 12:14:12.985344  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 259324us
I20260709 12:14:12.992311  8923 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:12.992645  8923 raft_consensus.cc:614] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.993265  8998 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.993429  9040 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:12.993747  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:12.995736  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:12.988258 11233 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.851s	user 0.003s	sys 0.009s
I20260709 12:14:12.987002  8994 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:14:12.935393 11411 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:12.987372  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 240931us
I20260709 12:14:12.969254  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:12.947256 11679 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:12.985510 11477 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.023995  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:13.025637  9074 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:12.995348 11404 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.996598 11707 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.960879  9617 rpcz_store.cc:276] 0709 12:14:11.891788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.908685 (+ 16897us) service_pool.cc:224] Handling call
0709 12:14:12.813479 (+904794us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:12.813687 (+   208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.884450 (+ 70763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.911109 (+ 26659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9693952}
I20260709 12:14:13.033852  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.016729 11674 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.984671 11111 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.037103  8923 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:13.045470  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:13.046599  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:12.988565 11708 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:14:13.016983 11670 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.047757 11670 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.050028 11670 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.051065  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.042994  8998 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:13.051836  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:13.025372 11677 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:13.022783 11280 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:12.992784 11495 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:12.975550 11374 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:13.030305 11760 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:14:13.058347  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 143322us
I20260709 12:14:13.032080 11676 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.037607 11404 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.069337  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1329) took 1289 ms. Trace:
I20260709 12:14:13.070755  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:13.073208  9617 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:13.074106 11700 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.843s	user 0.003s	sys 0.007s
I20260709 12:14:13.087798  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.089033  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.056196 11630 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:13.092801  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.080298  8920 rpcz_store.cc:276] 0709 12:14:11.780092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.925232 (+1145140us) service_pool.cc:224] Handling call
0709 12:14:12.925624 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.925805 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:13.028968 (+103163us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.068259 (+ 39291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.068341 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:13.068410 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.068977 (+   567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.069239 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":287,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":123861,"threads_started":2}
I20260709 12:14:13.096519  8920 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:13.032562 11477 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.102180  8923 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:13.122864  8923 pending_rounds.cc:85] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 7
I20260709 12:14:13.123276  8923 pending_rounds.cc:107] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:13.123673  8923 raft_consensus.cc:2889] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:13.140420  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.140447  8920 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:13.069288 11679 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.135453 11677 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:13.142305 11769 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:13.143543  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 148266us
I20260709 12:14:13.056540 11674 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.081226 11676 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.154722  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:13.155325  9068 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:13.156389  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:13.156941  9068 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:13.157255  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.154652  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:13.158958  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:13.162197  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:13.163493  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:13.164263  9072 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:13.164590  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:13.165061 11710 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:13.165544 11710 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:13.170786  9067 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:13.171456  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:13.173435  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:13.179394  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.140054 11630 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:13.181948  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.183351  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.094408 11700 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.170529 11511 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.190748 11689 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.191305 11670 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.192018  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 440) took 1254 ms. Trace:
I20260709 12:14:13.187885 11703 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:13.193869  9587 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.112s (SENT)
I20260709 12:14:13.197364  9622 rpcz_store.cc:276] 0709 12:14:11.937796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.703202 (+765406us) service_pool.cc:224] Handling call
0709 12:14:12.712871 (+  9669us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:12.981953 (+269082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.981987 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:12.982985 (+   998us) log.cc:844] Serialized 52 byte log entry
0709 12:14:13.033698 (+ 50713us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:13.033736 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.033800 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.191780 (+157980us) raft_consensus.cc:1685] finished
0709 12:14:13.191812 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.191952 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15255,"raft.queue_time_us":30698,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":21208,"thread_start_us":299292,"threads_started":2,"wal-append.queue_time_us":177203}
I20260709 12:14:13.188015  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:13.177028 11447 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.222662  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:13.154989  9620 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:13.198076  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1335) took 1373 ms. Trace:
I20260709 12:14:13.170949 11280 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:13.231186  8924 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:13.178730 11709 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:13.232842  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51850.3us
I20260709 12:14:13.232100  8916 rpcz_store.cc:276] 0709 12:14:11.824500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.981950 (+1157450us) service_pool.cc:224] Handling call
0709 12:14:12.990901 (+  8951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.991092 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:13.037696 (+ 46604us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.197772 (+160076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.197820 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:13.197864 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.197923 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.198026 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7699,"prepare.queue_time_us":146819,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":5706,"raft.queue_time_us":76,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":21496,"thread_start_us":199524,"threads_started":2}
I20260709 12:14:13.187798  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 435) took 1305 ms. Trace:
I20260709 12:14:13.238075  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.222978 11591 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:13.242195  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.199074 11689 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.227756 11473 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.230388 11708 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:13.228561 11670 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.241272 11717 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.247895 11674 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:13.248184 11767 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:14:13.223433 11764 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:13.253058  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.260459  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:13.261363  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:13.150739 11769 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.195506 11630 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.237102 11565 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.269634  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:13.272615  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:13.276465  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:13.243573 11703 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:13.259368 11689 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:13.284122  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.269392 11763 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:14:13.233345 11447 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.262794 11333 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.269213 11775 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.273787 11473 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:13.274796 11532 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:13.320395  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:13.243446 11709 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:14:13.280287 11485 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.268447 11738 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:14:13.287426 11762 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:13.261880 11670 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.329509  9073 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:13.196727 11677 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.294912 11764 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.261941 11774 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.269519 11575 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:14:13.279688 11753 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:14:13.243868 11710 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.336263  9616 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:14:13.337471  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.449015  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 437) took 1536 ms. Trace:
I20260709 12:14:13.336877  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:13.323107 11473 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.320806 11333 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:13.447291 11527 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.114s	user 0.009s	sys 0.010s
I20260709 12:14:13.330156 11485 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.434581  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:13.441531  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 1.19556e+06us
I20260709 12:14:13.602044  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:13.335889 11280 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.322512 11630 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.449529  9616 rpcz_store.cc:276] 0709 12:14:11.912378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.922853 (+ 10475us) service_pool.cc:224] Handling call
0709 12:14:13.330295 (+1407442us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:13.330484 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.448619 (+118135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.448938 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11559168}
I20260709 12:14:13.612586  9616 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:13.615705 11280 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.618651 11280 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.618980  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2627) took 1757 ms. Trace:
I20260709 12:14:13.606562 11485 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.619560  9069 rpcz_store.cc:276] 0709 12:14:11.861874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.862036 (+   162us) service_pool.cc:224] Handling call
0709 12:14:11.862415 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.237649 (+375234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.618675 (+1381026us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400422cd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:13.618893 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678619520}
W20260709 12:14:13.621409  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1197) took 1922 ms (client timeout 2150 ms). Trace:
W20260709 12:14:13.621930  8997 rpcz_store.cc:269] 0709 12:14:11.699204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.699422 (+   218us) service_pool.cc:224] Handling call
0709 12:14:13.621205 (+1921783us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b540039b7d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:13.621337 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204348672}
W20260709 12:14:13.625183 11714 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 12:14:13.478582 11473 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:13.630939 11794 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:14:13.435124 11738 consensus_queue.cc:1243] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:13.634192  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:13.361732 11771 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:13.471618  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:13.324826 11111 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.475034 11333 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.640254 11800 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:13.642107 11660 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.434962 11762 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:13.438284 11709 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.643864 11709 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.644006 11762 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.645848  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1322) took 2130 ms. Trace:
I20260709 12:14:13.646194 11709 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.438808 11532 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:13.646212  8919 rpcz_store.cc:276] 0709 12:14:11.515778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.681453 (+165675us) service_pool.cc:224] Handling call
0709 12:14:11.773046 (+ 91593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.883428 (+110382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.645651 (+1762223us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:13.645793 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237737344}
I20260709 12:14:13.646896 11532 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.647573 11660 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.648173 11333 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.649027 11532 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.438481 11495 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.445899 11789 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:13.649972 11789 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:13.650086  8992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 498) took 1578 ms (client timeout 2079 ms). Trace:
W20260709 12:14:13.484136 11756 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.802s	user 0.015s	sys 0.005s
I20260709 12:14:13.482106  9617 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:13.491602  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 438) took 1564 ms. Trace:
I20260709 12:14:13.488490 11713 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:13.496304 11676 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:13.582113  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.560354 11772 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 12:14:13.505656 11700 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:13.561318 11785 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:14:13.561899 11788 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:14:13.333848 11375 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:14:13.603668  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:13.603900  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.445380 11764 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:13.610921 11404 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.002s
I20260709 12:14:13.651197 11753 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:13.324373 11775 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.650794  8996 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:14:13.651216  8992 rpcz_store.cc:269] 0709 12:14:12.072025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.660499 (+588474us) service_pool.cc:224] Handling call
0709 12:14:13.649920 (+989421us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002350d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:13.650029 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343906688}
W20260709 12:14:13.669502  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65945.2us
W20260709 12:14:13.669827  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66029.3us
W20260709 12:14:13.677601  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 443013us
I20260709 12:14:13.678046  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:13.679813  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:13.638636  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2056) took 1852 ms (client timeout 2426 ms). Trace:
W20260709 12:14:13.680694  8924 rpcz_store.cc:269] 0709 12:14:11.786156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.279038 (+492882us) service_pool.cc:224] Handling call
0709 12:14:13.638291 (+1359253us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54000ca3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:13.638557 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153956736}
I20260709 12:14:13.240257  9615 rpcz_store.cc:276] 0709 12:14:11.882344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.890031 (+  7687us) service_pool.cc:224] Handling call
0709 12:14:11.967552 (+ 77521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.008682 (+ 41130us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:12.293664 (+284982us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.098789 (+805125us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.139945 (+ 41156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.142843 (+  2898us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:13.150289 (+  7446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.165899 (+ 15610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.181695 (+ 15796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":760,"prepare.queue_time_us":489471,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":55184,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"thread_start_us":891245,"threads_started":4,"wal-append.queue_time_us":541812}
I20260709 12:14:13.606038 11527 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.655824 11756 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:13.667901 11786 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:14:13.684407  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:13.687507  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:13.690152  9621 raft_consensus.cc:2376] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7. Re-sending same reply.
I20260709 12:14:13.676434  8992 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:13.690719  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.691401  8924 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:14:13.691846  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1331) took 1891 ms (client timeout 2150 ms). Trace:
W20260709 12:14:13.692256  8922 rpcz_store.cc:269] 0709 12:14:11.800047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.232464 (+432417us) service_pool.cc:224] Handling call
0709 12:14:13.691677 (+1459213us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540008b1d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:13.691796 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575943936}
I20260709 12:14:13.653843 11771 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.729590  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 434) took 1870 ms. Trace:
I20260709 12:14:13.731583  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2613) took 2855 ms. Trace:
I20260709 12:14:13.734637  9071 rpcz_store.cc:276] 0709 12:14:10.876029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.876167 (+   138us) service_pool.cc:224] Handling call
0709 12:14:10.923914 (+ 47747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.279596 (+355682us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:11.536467 (+256871us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.989521 (+453054us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.973793 (+984272us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.974812 (+  1019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.974878 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:12.974944 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.354905 (+379961us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b48002601d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:13.731351 (+376446us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54000ab754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:13.731405 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.731521 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":726721,"prepare.queue_time_us":429047,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":721178,"raft.run_cpu_time_us":22372,"raft.run_wall_time_us":1533045,"spinlock_wait_cycles":825832960,"thread_start_us":671787,"threads_started":3,"wal-append.queue_time_us":430625}
I20260709 12:14:13.674152 11709 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.680243 11495 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:13.740093  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.670077 11764 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.674363 11447 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:13.743547  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:13.743950  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.755635  9624 rpcz_store.cc:276] 0709 12:14:11.858764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.858949 (+   185us) service_pool.cc:224] Handling call
0709 12:14:11.859652 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.876334 (+ 16682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.692457 (+1816123us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400770454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:13.729486 (+ 37029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36209408}
I20260709 12:14:13.744946  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.682607 11714 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.756206  8923 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:13.764550  9000 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:13.756259  8919 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:13.745800  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.663460 11713 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.728010 11280 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.772909  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.685503 11795 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.680364 11404 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:13.778618  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.763054 11793 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:14:13.759837  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:13.682605 11753 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.688265 11800 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:14:13.763226 11738 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.769820 11674 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.728772 11689 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.771206 11495 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:13.777187 11280 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.654887  9619 rpcz_store.cc:276] 0709 12:14:11.923198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.700535 (+777337us) service_pool.cc:224] Handling call
0709 12:14:12.700906 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.701298 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.701331 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.701841 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.982646 (+280805us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:12.989947 (+  7301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.993302 (+  3355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.468511 (+475209us) raft_consensus.cc:1685] finished
0709 12:14:13.468536 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.487774 (+ 19238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":273809,"threads_started":1,"wal-append.queue_time_us":366660}
I20260709 12:14:13.794243 11805 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.797156 11333 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.804266 11674 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.832393 11689 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:13.833868 11682 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.835404 11682 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.837181 11753 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.838550  8916 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:13.844188 11775 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:13.849406  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 412840us
I20260709 12:14:13.852321 11771 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.855291  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:13.728930 11789 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.808579 11280 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.858328  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:13.859166  8925 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:13.859297 11333 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:13.860080 11333 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:13.862435  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.863163  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:13.856920  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:13.864809  9621 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:13.862828 11333 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.813910  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 696) took 1600 ms. Trace:
I20260709 12:14:13.805994 11738 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:13.869040 11798 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:14:13.871865 11789 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.873772 11775 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.822325 11805 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.873095 11447 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:13.875316  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:13.889298 11775 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.889251 11495 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.891259 11404 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.892094  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1193) took 2270 ms. Trace:
I20260709 12:14:13.895498  8995 rpcz_store.cc:276] 0709 12:14:11.621964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.622115 (+   151us) service_pool.cc:224] Handling call
0709 12:14:11.622463 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.633597 (+ 11134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:11.633639 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:11.668702 (+ 35063us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.358109 (+1689407us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b180033f3a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:13.468617 (+110508us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:13.499890 (+ 31273us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:13.499953 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.500565 (+   612us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.891889 (+391324us) raft_consensus.cc:1685] finished
0709 12:14:13.891907 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.892035 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10722,"raft.queue_time_us":10942,"raft.run_cpu_time_us":30119,"raft.run_wall_time_us":1808500,"spinlock_wait_cycles":32238080,"thread_start_us":64755,"threads_started":1,"wal-append.queue_time_us":1955251}
I20260709 12:14:13.898558  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:13.899976  8995 raft_consensus.cc:2410] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:13.888841 11447 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.902525 11447 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:13.918467 11807 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:14:13.921063 11805 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.932922 11775 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.939476 11800 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.940294 11800 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.945917 11799 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:13.946537 11799 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:13.952062  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2630) took 1921 ms. Trace:
I20260709 12:14:13.952636  9074 rpcz_store.cc:276] 0709 12:14:12.031085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.031300 (+   215us) service_pool.cc:224] Handling call
0709 12:14:12.031692 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.027728 (+996036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.951702 (+923974us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b540026dc54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:13.951973 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267939712}
W20260709 12:14:13.956560  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.955971 11473 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.958194 11705 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:13.958631 11705 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:13.958753 11473 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.960271 11738 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.961508 11411 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:13.962188 11713 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:13.962608 11704 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:13.963132 11762 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:13.965132 11705 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.966334 11705 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:13.940747 11736 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.792s	user 0.005s	sys 0.016s
I20260709 12:14:13.968569 11456 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:13.969007 11456 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:13.968850 11799 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:13.965592  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:13.969970 11456 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:13.971410 11333 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:13.969970 11799 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.869073  9618 rpcz_store.cc:276] 0709 12:14:12.212287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.945323 (+733036us) service_pool.cc:224] Handling call
0709 12:14:12.978355 (+ 33032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.018026 (+ 39671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.022852 (+  4826us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.071065 (+ 48213us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.228732 (+157667us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:13.232457 (+  3725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.232669 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.799361 (+566692us) raft_consensus.cc:1685] finished
0709 12:14:13.799392 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.812147 (+ 12755us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8430,"raft.queue_time_us":57901,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10567,"thread_start_us":101994,"threads_started":1,"wal-append.queue_time_us":292233}
I20260709 12:14:13.972038 11333 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.973264 11333 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:13.905339 11527 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:13.971175 11456 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.975378 11753 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.975911 11753 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:13.985337  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 108333us
I20260709 12:14:13.986162  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:13.987107  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:13.998772 11677 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:14.011792  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.009382  8995 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:14.014021  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.015321  8995 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:14.016266 11753 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.019941  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.025524  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.027417  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.028833  8995 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.031544  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.035105 11375 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:14.043045  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.023685 11730 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.038271 11375 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:14.045627 11650 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.050814 11677 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:14.051401 11677 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:14.052273 11677 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.052085 11375 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.053602 11375 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.055122 11782 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.055913 11782 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.010552 11485 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.061983  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:14.068802  9587 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.847s (SENT)
I20260709 12:14:14.069319  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.079211  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2436) took 2035 ms. Trace:
I20260709 12:14:14.081401  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.084609  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:14.077728 11670 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.002s
I20260709 12:14:14.088217  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:14.089773  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.076864 11650 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.077728 11492 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.096040  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.096308  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.096958  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:14.097775  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.079598 11800 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.109967  8920 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:14.118361  8920 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.099072  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.119491  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.121148  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.122715  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.116565  8919 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:14.094194 11670 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.124233  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.124663  8916 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:14.124845  8919 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:14.092923 11456 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:14:14.125705  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.126243  8919 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:14.092420 11527 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.127202 11670 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.088155 11805 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.133180 11725 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.133992 11725 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.108978 11485 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.110927  8925 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:14.082315 11775 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.119542  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.143129  8995 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:14.099409  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:14.144234  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.127027  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.144778  8995 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:14.137428  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.145188  8919 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:14.147221  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.147718  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.149001  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.119228  8920 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:14.154496  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.154274  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.156905  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.157641  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.158532  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.158658  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.159384  8995 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:14.098690 11738 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:14.160259  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.161613  8920 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.165529  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2433) took 2124 ms. Trace:
I20260709 12:14:14.165985  8994 rpcz_store.cc:276] 0709 12:14:12.041496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.022339 (+980843us) service_pool.cc:224] Handling call
0709 12:14:13.022671 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.022879 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:13.989229 (+966350us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.165205 (+175976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.165254 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:14.165297 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.165356 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.165473 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":878143,"prepare.queue_time_us":879397,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":263222,"threads_started":2}
I20260709 12:14:14.138497 11756 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.137374 11771 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.167832  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.138685 11650 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.177323  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 196590us
I20260709 12:14:14.145969 11789 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.143719 11800 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.161612 11263 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.162827 11527 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.183964  8994 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.150096 11689 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.146308 11753 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.135056 11333 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.156793 11670 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.157073 11805 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.168953 11775 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:14.207468  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53312.8us
I20260709 12:14:14.168622 11795 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:14.196625  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.209944  8920 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:14.210337  8994 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.191879 11263 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:14.213680  8993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 507) took 2008 ms (client timeout 1750 ms). Trace:
W20260709 12:14:14.213657 11813 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:14:14.196542 11756 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:14.216300  8993 rpcz_store.cc:269] 0709 12:14:12.204908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.278325 (+ 73417us) service_pool.cc:224] Handling call
0709 12:14:14.213450 (+1935125us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000f64d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:14.213549 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915976960}
I20260709 12:14:14.217378  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.229619  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.217386  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:14.220990  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.195905 11527 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.214973 11135 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:14.234982  8994 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.231702  8920 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:14.189075 11789 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.237942 11789 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.211695 11775 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.239552 11775 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.239722  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.241423  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.242699 11789 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.244035  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.211447 11795 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.244953 11782 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.245299 11795 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:14.245963  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.246955  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.248158  8994 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:14:14.249321  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.250068  8994 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:14.252064  8888 leader_election.cc:400] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:14.252388  8888 leader_election.cc:403] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:14.230578  8993 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:14.255812  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:14.192071 11650 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.257701  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.258646  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:14.259666  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:14.260143 11670 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.260600 11333 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.228035 11263 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.235332 11135 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:14.268759  9619 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:14.269829 11135 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.270085  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:14.271544 11670 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.272061 11670 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.274237 11591 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.274887 11591 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.265739  8993 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.292196  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.266889  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.256361 11756 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.267527  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.267684  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.271029 11135 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:14.277485  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.264086  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:14.234874 11527 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.302132  9074 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:14.298831  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.207039 11689 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.294515  8994 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.295629  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.218026 11805 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:14.297011  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45121.8us
I20260709 12:14:14.218940 11677 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:14:14.302814  8993 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.296094 11826 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
W20260709 12:14:14.269824 11817 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:14:14.306418  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2437) took 2262 ms. Trace:
W20260709 12:14:14.308326  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 303517us
I20260709 12:14:14.308254  8993 rpcz_store.cc:276] 0709 12:14:12.044297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.302223 (+2257926us) service_pool.cc:224] Handling call
0709 12:14:14.302591 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.306131 (+  3540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.306354 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.263723 11725 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.310623  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.306867  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.290690  9617 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.311256  9073 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:14.305101 11713 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.278875 11280 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.301961 11712 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:14.313834  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.312211  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.319841  9621 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:14.321203  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.309628  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:14.324342  8994 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:14.305241 11473 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.266248 11764 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.308049 11751 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.331082  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:14.322218 11679 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.176s	user 0.000s	sys 0.014s
W20260709 12:14:14.341763  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.322723  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:14.311551 11532 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:14.315544 11782 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.346091 11826 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:14.410856  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109934us
W20260709 12:14:14.412153  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81354.8us
I20260709 12:14:14.413000  9069 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:14.415835  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.319764 11713 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.357874 11825 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.423197  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:14.423426  8993 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:14.424538  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2446) took 2377 ms. Trace:
I20260709 12:14:14.425446  8993 rpcz_store.cc:276] 0709 12:14:12.046763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.381892 (+2335129us) service_pool.cc:224] Handling call
0709 12:14:14.423151 (+ 41259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.424223 (+  1072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.424485 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.426051  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:14.426829  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.427623  8993 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:14.428821  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.328966 11712 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.430765  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:14.424475  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.434060  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:14.409308 11800 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.434409 11333 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.439843  9624 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.440382 11511 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.436995  8920 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:14.436143  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.436431  9622 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:14.337512 11473 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.442422  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.412976 11682 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.420995 11447 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.002s
I20260709 12:14:14.441875  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:14.446221  9624 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:14.415019  9618 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.445392  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:14.445143 11771 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.448114  9622 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:14.420068 11681 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.415084 11782 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.440862 11511 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.449024  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.448297 11771 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.444206 11495 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.452596  8993 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:14.460448  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:14.460744  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 151200us
I20260709 12:14:14.462750  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:14.461328  8993 raft_consensus.cc:2376] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:14:14.468241  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:14.469930  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.448411 11492 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.469051  8993 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:14.475217  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.452092 11782 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.451779 11511 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.453173 11771 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.479800  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:14.490787  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.491556  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.393855 11756 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.493625  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.446089 11800 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.495326  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.496528  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.497704  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.498232  9068 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:14.498600  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.499894  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.503165  9074 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:14.448338 11682 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.449203 11447 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.508078  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:14.508618  9074 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 4. Ops: []
I20260709 12:14:14.508873  9067 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.507053  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.511715  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.450618 11825 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:14.514431  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.515369  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.515522  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:14.516230  8993 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.512563  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75204.7us
I20260709 12:14:14.512931  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.479545 11492 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:14.537968  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.528733  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:14.539093  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.518254  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.530367  9071 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:14.541363  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 97595.8us
I20260709 12:14:14.541597  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.460018 11495 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.502611 11333 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:14.518724 11827 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:14:14.545007  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.546885  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:14.548296  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.542236  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:14.543919  9068 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:14.587419  9073 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:14.517282 11650 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:14.589264  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47120.4us
I20260709 12:14:14.572429  8993 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:14.586228  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.586668  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.591424  9070 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:14.592432  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.596750  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:14.600303  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.523607 11800 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.531041 11805 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.635962  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.601686  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.541585 11492 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.525682 11712 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.603892  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:14.588029  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.541411 11404 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:14.543329 11280 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:14.633023  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46427.4us
I20260709 12:14:14.646212  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2615) took 3345 ms. Trace:
I20260709 12:14:14.646679  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.646628  9065 rpcz_store.cc:276] 0709 12:14:11.301293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.301882 (+   589us) service_pool.cc:224] Handling call
0709 12:14:11.315792 (+ 13910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.667342 (+1351550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.645982 (+1978640us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400368654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:14.646150 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228647808}
W20260709 12:14:14.637045  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.601228  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.584020 11825 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.551806 11333 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.603940 11681 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:14.644253  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.544972 11826 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.633121 11732 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.639155  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.585843 11836 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.666508  9066 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:14.552102 11689 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:14.649528  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50178us
I20260709 12:14:14.522244 11670 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.585470 11775 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.634210 11375 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.678977 11375 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.679441 11375 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.680167 11775 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.079811  8992 rpcz_store.cc:276] 0709 12:14:12.043963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.675854 (+1631891us) service_pool.cc:224] Handling call
0709 12:14:13.676143 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.676327 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:13.755206 (+ 78879us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.060189 (+304983us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.062404 (+  2215us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.078701 (+ 16297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.078759 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:14.078808 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.078893 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.079121 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44141,"prepare.queue_time_us":29698,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":18307,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":7237,"thread_start_us":252597,"threads_started":2,"wal-append.queue_time_us":137035}
I20260709 12:14:14.659621  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.684296  9072 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:14.685075 11771 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.685560 11762 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:14.686026 11762 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:14.686904 11762 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.687664 11771 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.688022 11762 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.688196 11495 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:14.689617 11799 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
W20260709 12:14:14.650234 11233 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:14:14.667675 11732 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.691601 11233 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:14.692041 11828 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:14:14.693042 11681 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.695439  9074 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:14.696417  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.697090  8992 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:14.667269  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:14.698678  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.698753  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:14.642978 11800 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:14.703516 11818 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.704s	user 0.005s	sys 0.000s
I20260709 12:14:14.703542 11800 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:14.704582 11800 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.707562  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.710217 11477 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.712868 11674 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.673087 11826 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.673795 11700 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:14.663111 11712 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.659301 11333 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.661103 11764 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.678166 11670 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.670590 11532 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.682257 11795 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.691672 11732 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.699569  8994 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 6. Ops: []
I20260709 12:14:14.668619  9065 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:14.700213  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:14.739863  9065 pending_rounds.cc:85] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:14.740259  9065 pending_rounds.cc:107] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:14:14.740592  9065 raft_consensus.cc:2889] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:14.668212  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.657950 11404 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.699441 11411 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.699461 11713 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.679454 11688 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:14.651113 11650 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.715509  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.669361  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.717571  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.722352  9067 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:14.652207 11805 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.653002 11825 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:14.676295  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:14.694628 11681 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.666205 11836 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.712893 11710 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.738515  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.740104  8992 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:14.641690  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.827772 11375 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.742801  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:14.700731  8995 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:14.471707  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:14.770376 11511 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.742194 11677 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.808164  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 161557us
I20260709 12:14:14.781810  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.768816  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:14.933298  9069 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:14.816601  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.764947 11829 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.793305 11795 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:14.733850 11712 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:14.726990 11700 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.833681  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:14.948771  9065 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:14:14.839558  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 122069us
I20260709 12:14:14.795615 11233 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:14:14.836377 11404 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:14.839074 11688 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:14.937711 11650 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:15.006227  8998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1207) took 2223 ms (client timeout 2086 ms). Trace:
W20260709 12:14:15.006865  8998 rpcz_store.cc:269] 0709 12:14:12.782512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.926427 (+143915us) service_pool.cc:224] Handling call
0709 12:14:15.005969 (+2079542us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b54003449d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:15.006121 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131733248}
W20260709 12:14:15.000305 11591 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 12:14:14.933279  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:14.934568  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:15.018594  8992 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.843351  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 167130us
I20260709 12:14:14.739895 11473 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:14.937731  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 169004us
I20260709 12:14:15.020259  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:14.838029 11263 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.005s
I20260709 12:14:14.943531 11801 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:15.015012 11846 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:14.932488 11824 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.940570 11280 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.945428 11843 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.940819 11713 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.836182 11447 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.945861 11836 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.941316 11677 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.958873 11375 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:14.843277 11825 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.843657 11805 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.839977 11411 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.900734 11707 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:14.959635 11511 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:14.941807 11527 consensus_meta.cc:287] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 12:14:14.845410 11492 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:14.961169 11700 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:14.962478  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.013382  8998 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:15.075354  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 503) took 2966 ms. Trace:
I20260709 12:14:15.075709  8998 rpcz_store.cc:276] 0709 12:14:12.108957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.012430 (+2903473us) service_pool.cc:224] Handling call
0709 12:14:15.012914 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.075056 (+ 62142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.075299 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.076848  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:15.077385  8998 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:15.079363  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:14.849367 11820 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.664s	user 0.007s	sys 0.000s
I20260709 12:14:15.035775 11263 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.046080 11674 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:15.055076  9000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2444) took 3008 ms (client timeout 2188 ms). Trace:
W20260709 12:14:15.073771  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123586us
W20260709 12:14:14.835721 11705 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.005s
W20260709 12:14:14.852916  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 183653us
W20260709 12:14:15.073938  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 140738us
W20260709 12:14:15.067026  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46898.5us
I20260709 12:14:15.035909 11801 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.094776  8919 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:15.082136  9000 rpcz_store.cc:269] 0709 12:14:12.046244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.722697 (+676453us) service_pool.cc:224] Handling call
0709 12:14:15.054765 (+2332068us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:15.054976 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382734592}
I20260709 12:14:15.055454  8997 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 7. Ops: []
I20260709 12:14:15.083390  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:15.084858  8992 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:15.087193  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:15.080042  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 158879us
I20260709 12:14:15.054041 11280 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.074337 11650 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.104241  9000 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:15.047025 11844 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.106494  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.107599 11705 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.074232 11805 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.107823 11704 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:15.108513 11805 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.105808 11233 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:15.109887 11233 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.110280 11233 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.110816 11805 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.072615 11688 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.111599 11677 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.112036 11688 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.112650 11280 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.113166 11492 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.089092 11263 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.089308 11473 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:15.082708 11769 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.058763 11411 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.093094  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.121639  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.086233  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:15.098191  8998 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:14:15.098521  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.098953  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:15.100103  8922 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:15.124850  8996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2447) took 3077 ms (client timeout 2093 ms). Trace:
W20260709 12:14:15.125295  8996 rpcz_store.cc:269] 0709 12:14:12.047023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.328829 (+1281806us) service_pool.cc:224] Handling call
0709 12:14:15.124670 (+1795841us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54001a22d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:15.124775 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119742720}
I20260709 12:14:15.056892 11713 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.101588  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.128201  8916 raft_consensus.cc:2376] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7. Re-sending same reply.
I20260709 12:14:15.102020  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.129453  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:15.102463  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.102944  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.104847  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 508) took 2899 ms. Trace:
I20260709 12:14:15.131270  9000 rpcz_store.cc:276] 0709 12:14:12.205211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.096582 (+2891371us) service_pool.cc:224] Handling call
0709 12:14:15.096861 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.104610 (+  7749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.104795 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.104938  8992 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:15.074414 11527 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.140588  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.114439  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:15.141301  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.141949  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1196) took 3465 ms. Trace:
I20260709 12:14:15.142290  8920 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:15.130769  8919 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:15.114964  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:15.115429  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.147550  9622 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:15.114190 11650 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.106317 11700 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.116989 11712 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:15.117007  9619 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:15.063385 11591 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.133180  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 512) took 2926 ms. Trace:
I20260709 12:14:15.180478  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:15.180757  8992 rpcz_store.cc:276] 0709 12:14:12.206373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.101212 (+2894839us) service_pool.cc:224] Handling call
0709 12:14:15.101485 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.132937 (+ 31452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.133129 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.160755  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:15.136158  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.181878  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:15.136727  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:15.139297  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.135473  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.139984  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:15.134389  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:15.106024 11837 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.172833  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:15.183329  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.174150  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77566.3us
I20260709 12:14:15.170354  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 384) took 3706 ms. Trace:
I20260709 12:14:15.214823  8992 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:15.175271  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.055675 11824 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.179898  9622 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:15.146473  9617 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.001s
I20260709 12:14:15.087157  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:15.212569  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:15.216712  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:15.216017  8918 rpcz_store.cc:276] 0709 12:14:11.464017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.469641 (+  5624us) service_pool.cc:224] Handling call
0709 12:14:11.469951 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.523472 (+ 53521us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:11.786733 (+263261us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.076378 (+289645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.076639 (+   261us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:12.076884 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.692270 (+1615386us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18003b28a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419
0709 12:14:15.169918 (+1477648us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5400311354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:15.170048 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.170238 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":349239,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":296,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":18840,"spinlock_wait_cycles":163631232,"thread_start_us":551539,"threads_started":2,"wal-append.queue_time_us":392668,"wal-append.run_cpu_time_us":999,"wal-append.run_wall_time_us":1001132}
I20260709 12:14:15.218940  8924 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:15.219558  8921 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.218214  9623 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.115895 11826 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
W20260709 12:14:15.104635 11843 consensus_queue.cc:1175] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "491a1127924f43d4a369f7d09c3a68db" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 12:14:15.142318  8999 rpcz_store.cc:276] 0709 12:14:11.676846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.676976 (+   130us) service_pool.cc:224] Handling call
0709 12:14:11.719853 (+ 42877us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:12.006788 (+286935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.006821 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:12.070657 (+ 63836us) log.cc:844] Serialized 52 byte log entry
0709 12:14:12.658090 (+587433us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:12.672119 (+ 14029us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.893254 (+1221135us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b1800343f00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf 00007f3985c55038
0709 12:14:13.893482 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.902459 (+  8977us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800343f00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:14.069226 (+166767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.141683 (+1072457us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b5400235ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:15.141725 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:15.141768 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:15.141778 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.141900 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1245464,"prepare.queue_time_us":1235427,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":88,"raft.queue_time_us":96208,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":17902,"spinlock_wait_cycles":232866304,"thread_start_us":538738,"threads_started":3,"wal-append.queue_time_us":902159,"wal-append.run_cpu_time_us":2712,"wal-append.run_wall_time_us":1050312}
I20260709 12:14:15.269223  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.269721  8917 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:15.284860  8920 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.284778  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 197686us
W20260709 12:14:15.285288  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 68668.4us
I20260709 12:14:15.288906  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:15.273232  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 112550us
I20260709 12:14:15.149464 11730 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:15.288700  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:15.290691  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:15.268181  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47262.4us
I20260709 12:14:15.131485 11844 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:15.296002  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.171821 11263 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:14:15.174492 11769 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:15.149148 11805 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:15.344121  8916 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.348163  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:15.349058  8999 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:15.230501 11404 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:15.296746 11730 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.359696  9623 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:15.150290 11679 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 12:14:15.320432  9615 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:15.293004  9617 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:15.327522 11843 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.286281 11511 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:14:15.386926  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96314.6us
I20260709 12:14:15.388762  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:15.389407  8921 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:15.461470  8920 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:15.466491  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77795.5us
I20260709 12:14:15.390887  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:15.365033 11844 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:15.365589 11730 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.480943  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.492542  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.296169 11705 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.497792  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:15.505391  8999 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:15.505482  8916 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:15.335659 11805 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.286463 11829 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:15.467505 11575 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.472234 11789 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.477671 11707 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:15.469664  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 706) took 1217 ms. Trace:
I20260709 12:14:15.477123 11795 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:15.528429 11795 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.478273 11280 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:15.533799  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.535015  9615 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:15.540747  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:15.542589  8925 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:15.222388 11837 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.504468 11819 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:15.527938 11853 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:14:15.516397  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.511224 11679 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:15.465946 11769 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:14:15.466542 11492 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:14:15.544378  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2435) took 3502 ms. Trace:
I20260709 12:14:15.557845  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:15.558841  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 270220us
I20260709 12:14:15.581238  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:15.582365  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:15.470965 11843 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.511723 11844 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:15.559744 11800 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.004s
I20260709 12:14:15.509423 11829 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:15.367942 11404 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.579442  8997 rpcz_store.cc:276] 0709 12:14:12.043576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.636065 (+1592489us) service_pool.cc:224] Handling call
0709 12:14:15.055169 (+1419104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.104087 (+ 48918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.544128 (+440041us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400325350. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:15.544308 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3262630144}
I20260709 12:14:15.524413 11707 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.515156 11575 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:15.589033  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1203) took 2841 ms. Trace:
W20260709 12:14:15.547281  9618 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.086s	user 0.008s	sys 0.000s
W20260709 12:14:15.524935 11732 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.005s
I20260709 12:14:15.526227 11263 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:15.620929  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2443) took 3575 ms. Trace:
I20260709 12:14:15.638136  8994 rpcz_store.cc:276] 0709 12:14:12.045948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.325240 (+2279292us) service_pool.cc:224] Handling call
0709 12:14:14.325536 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.739519 (+413983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.620479 (+880960us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54003db654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:15.620856 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859739008}
I20260709 12:14:15.621794  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 704) took 1369 ms. Trace:
I20260709 12:14:15.640084  9621 rpcz_store.cc:276] 0709 12:14:14.251974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.252106 (+   132us) service_pool.cc:224] Handling call
0709 12:14:14.252382 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.324132 (+ 71750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.621550 (+1297418us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b540069e954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:15.621734 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152115456}
I20260709 12:14:15.527159 11801 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.543179 11674 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.559641 11795 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.583916 11679 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:15.614553  9619 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:15.635959  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:15.525713  9617 rpcz_store.cc:276] 0709 12:14:14.252532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.254146 (+  1614us) service_pool.cc:224] Handling call
0709 12:14:15.466016 (+1211870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.614341 11789 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.617216 11650 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.678699  8924 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:15.651041 11729 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.651336 11849 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:14:15.626972 11829 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.639593  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:15.617410 11527 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.631259  8996 rpcz_store.cc:276] 0709 12:14:12.747417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.126058 (+2378641us) service_pool.cc:224] Handling call
0709 12:14:15.126341 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.126523 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:15.292655 (+166132us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.588706 (+296051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.588756 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:15.588798 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.588861 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.588975 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":344682,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"thread_start_us":461491,"threads_started":2}
I20260709 12:14:15.627767 11713 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.632961 11707 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:15.579398 11825 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.678112  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:15.692298  8997 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:15.635070 11575 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:15.678162  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.652060 11824 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.615571 11819 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.643363 11591 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.634285  9618 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:15.705964  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:15.685559  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1204) took 2918 ms. Trace:
I20260709 12:14:15.680708  8994 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:15.643092 11732 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.695323  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:15.709352  8996 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:15.654176 11263 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:15.679939 11674 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.619365 11800 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.710206  9000 rpcz_store.cc:276] 0709 12:14:12.775159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.132081 (+2356922us) service_pool.cc:224] Handling call
0709 12:14:15.132346 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.132519 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:15.368590 (+236071us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.684951 (+316361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.685266 (+   315us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:15.685314 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.685378 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.685502 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3630,"prepare.queue_time_us":388800,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":18960,"thread_start_us":506317,"threads_started":2}
I20260709 12:14:15.683326 11789 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.653306 11844 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.724939 11824 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:15.733940 11782 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.237s	user 0.007s	sys 0.006s
I20260709 12:14:15.722450 11674 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.743829 11782 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.745817 11843 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.746206 11730 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.747049 11825 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.747201 11872 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:15.757179 11710 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.818s	user 0.011s	sys 0.026s
I20260709 12:14:15.759786 11858 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.760473 11732 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.760339 11858 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.748250 11819 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:15.742339 11805 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.742048 11824 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:15.765184 11824 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.757036 11837 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.765954 11789 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:15.762341 11836 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.762109 11872 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:15.775439 11872 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:15.809123  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.012s
W20260709 12:14:15.810252  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.000s	sys 0.013s
W20260709 12:14:15.813380  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.007s
W20260709 12:14:15.814013  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.005s	sys 0.008s
W20260709 12:14:15.815706  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.816892  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.816071  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:15.819336  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 351156us
I20260709 12:14:15.820116  8925 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:15.828313  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:15.832518  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 250084us
W20260709 12:14:15.834901  8995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 524) took 1823 ms (client timeout 1822 ms). Trace:
I20260709 12:14:15.848424  8998 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:15.849619  8918 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:15.718861  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 708) took 1437 ms. Trace:
I20260709 12:14:15.878154  8920 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:15.878728  9618 rpcz_store.cc:276] 0709 12:14:14.281383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.298423 (+ 17040us) service_pool.cc:224] Handling call
0709 12:14:15.715853 (+1417430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.882066 11730 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:15.761642 11688 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
W20260709 12:14:15.884111  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56106.9us
W20260709 12:14:15.873767  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 587453us
I20260709 12:14:15.891371 11732 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.892096 11732 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:15.892694 11732 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:15.857450 11681 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:15.859838 11709 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:15.899963 11709 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.901167  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:15.864267  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.865903  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:15.904747 11751 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:14:15.719978 11679 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.909157  8921 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:15.903180 11709 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.909607 11650 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:15.910032 11681 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:15.910254 11650 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:15.869053 11233 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.004s
I20260709 12:14:15.911710 11233 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.912822 11782 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:15.913774  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.913944 11812 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.914551 11233 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.914952 11812 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.907800 11404 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.937345 11404 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.938081 11404 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.940517 11404 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:15.941792 11751 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.912176 11679 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:15.856099 11263 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.906234  9619 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:15.925290 11233 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:15.926661 11280 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:15.926527  8963 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:15.927510 11650 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.927615  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.929126 11447 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:15.930666 11411 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.010s
I20260709 12:14:15.931993 11707 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:15.932596  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.933514  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:15.927618 11681 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:15.875141  8995 rpcz_store.cc:269] 0709 12:14:14.011381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.159977 (+148596us) service_pool.cc:224] Handling call
0709 12:14:15.834293 (+1674316us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400324954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:15.834614 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238289152}
I20260709 12:14:15.942499 11751 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:15.977489  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.970497  8921 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:15.982272 11233 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.985809  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:15.986344 11511 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.964026 11732 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:15.987159 11511 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:15.987582 11700 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.792s	user 0.006s	sys 0.005s
I20260709 12:14:15.989132 11732 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:15.989364  8995 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:15.990028  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1214) took 2714 ms. Trace:
I20260709 12:14:15.990406  8995 rpcz_store.cc:276] 0709 12:14:13.275955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.975371 (+2699416us) service_pool.cc:224] Handling call
0709 12:14:15.988951 (+ 13580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.989746 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.989954 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.991811 11812 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:15.993693  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.995908 11841 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:15.996439 11871 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:15.996989 11871 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.986968  8920 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:15.989697 11280 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:15.997851  8923 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:16.011451  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.016700  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:15.997365 11871 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.022261 11681 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.022871  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:16.023654  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 97316.8us
I20260709 12:14:16.023828  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.024082  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.031888  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.033829  8991 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:16.033735  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.034634 11738 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.996817 11841 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.035159  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.031872  9065 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:15.974237 11411 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.039125  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.039465  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.035159 11738 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.047734  9072 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:16.048971  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.049767  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:16.062427 11333 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.240s	user 0.018s	sys 0.006s
I20260709 12:14:16.062994 11333 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.063717  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.064013 11411 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:16.065325 11333 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.066737 11682 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.067864  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.068693  9070 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:16.070482  9068 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:16.071683  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:16.072700  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.068569  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1216) took 2769 ms. Trace:
I20260709 12:14:16.061331  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.074579  8999 rpcz_store.cc:276] 0709 12:14:13.299462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.067180 (+2767718us) service_pool.cc:224] Handling call
0709 12:14:16.067696 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.068047 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.068077 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.068127 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:16.068159 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.068228 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.068351 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.011497 11447 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.020349 11812 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:14:16.085217  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79167.9us
W20260709 12:14:16.087812  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 79311us
I20260709 12:14:16.085477 11751 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.070410 11674 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.076577 11233 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.094942 11831 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.099982 11511 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.101135  9065 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:16.085325 11707 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.102252  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.111915  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1212) took 2770 ms. Trace:
I20260709 12:14:16.112438 11831 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:16.113739 11877 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:14:16.085256 11280 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.123123  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:16.124027  8991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 518) took 3895 ms (client timeout 1847 ms). Trace:
I20260709 12:14:16.124145  9066 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:16.124455  8991 rpcz_store.cc:269] 0709 12:14:12.228919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.666254 (+437335us) service_pool.cc:224] Handling call
0709 12:14:16.123746 (+3457492us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b5400196c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:16.123923 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7587280256}
I20260709 12:14:16.126220  8991 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.126813  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1218) took 2795 ms. Trace:
I20260709 12:14:16.128129 11738 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.128286 11447 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.131428 11841 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.128281  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.124898  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 517) took 3896 ms. Trace:
I20260709 12:14:16.127096  8991 rpcz_store.cc:276] 0709 12:14:13.331010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.125576 (+2794566us) service_pool.cc:224] Handling call
0709 12:14:16.125925 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.126579 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.126758 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.123441 11858 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:16.133819  8998 rpcz_store.cc:276] 0709 12:14:12.228645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.123669 (+2895024us) service_pool.cc:224] Handling call
0709 12:14:15.847901 (+724232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.877987 (+ 30086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.124691 (+246704us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400236ed0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:16.124824 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455911168}
I20260709 12:14:16.141803  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.142529  9069 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:16.142632  9070 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:16.141881  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.143868  9074 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:16.144908  8998 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:16.145735  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2457) took 2269 ms. Trace:
I20260709 12:14:16.146386  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:16.147179  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56301.7us
I20260709 12:14:16.148339  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.149426 11838 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.149868 11838 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.150556 11838 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.150864  8999 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:16.146086  8998 rpcz_store.cc:276] 0709 12:14:13.876933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.143914 (+2266981us) service_pool.cc:224] Handling call
0709 12:14:16.144456 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.145397 (+   941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.145676 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.149817  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.147220  9069 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:16.159861  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1217) took 2828 ms. Trace:
I20260709 12:14:16.162500  8999 rpcz_store.cc:276] 0709 12:14:13.323749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.116195 (+2792446us) service_pool.cc:224] Handling call
0709 12:14:16.150378 (+ 34183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.151346 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.151577 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.170625  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.009s	sys 0.014s
W20260709 12:14:16.171095  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.014s
I20260709 12:14:16.173723  9073 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.175700  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.176503  9069 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.114239  8992 rpcz_store.cc:276] 0709 12:14:13.251012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.845475 (+2594463us) service_pool.cc:224] Handling call
0709 12:14:15.846222 (+   747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.846913 (+   691us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:15.953369 (+106456us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.983225 (+ 29856us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.019207 (+ 35982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.019307 (+   100us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:16.021021 (+  1714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.021119 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.021281 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48842,"prepare.queue_time_us":189469,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1012,"raft.queue_time_us":74561,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":31877,"spinlock_wait_cycles":54124032,"thread_start_us":72833,"threads_started":2,"wal-append.queue_time_us":13076}
W20260709 12:14:16.171569  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 780730us
W20260709 12:14:16.187657  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53085.9us
I20260709 12:14:16.189056 11858 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:16.191362 11707 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:16.192322 11707 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.191380  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:16.195973 11511 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.196586 11511 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.198819 11511 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.196760 11492 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.187736  8998 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:16.205914  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.208248  9070 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:16.139957 11829 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.199191 11789 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:16.210409  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.210457  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2459) took 2333 ms. Trace:
I20260709 12:14:16.211735  8998 rpcz_store.cc:276] 0709 12:14:13.877475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.152537 (+2275062us) service_pool.cc:224] Handling call
0709 12:14:16.187339 (+ 34802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.210155 (+ 22816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.210388 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7040}
I20260709 12:14:16.213546  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.214344  9619 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.223017  8994 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:16.223991  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 531) took 1079 ms. Trace:
I20260709 12:14:16.224436  8994 rpcz_store.cc:276] 0709 12:14:15.144385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.639302 (+494917us) service_pool.cc:224] Handling call
0709 12:14:16.223891 (+584589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.225019  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.225775  9065 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:16.226756  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.226852  8996 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:14:16.229086  9065 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:16.231266  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.211148 11789 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.232625  9067 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.233084  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.223109 11831 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:16.236193 11707 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:16.237121  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.238303  9618 raft_consensus.cc:2410] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:16.239928  8994 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.248399  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1224) took 1570 ms. Trace:
I20260709 12:14:16.248876  8994 rpcz_store.cc:276] 0709 12:14:14.673836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.225499 (+1551663us) service_pool.cc:224] Handling call
0709 12:14:16.226032 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.240435 (+ 14403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.244416 (+  3981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.247665  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.211087 11492 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.252668  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:16.253798 11492 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:16.255000  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.255709  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.255856  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.256328  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1215) took 2961 ms. Trace:
I20260709 12:14:16.243757  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.257128  9615 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:16.256724  8995 rpcz_store.cc:276] 0709 12:14:13.294610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.991145 (+2696535us) service_pool.cc:224] Handling call
0709 12:14:16.018749 (+ 27604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.024438 (+  5689us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:16.024867 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.255810 (+230943us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.255997 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.256038 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:16.256075 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.256144 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.256254 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195640,"prepare.queue_time_us":661,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2075,"thread_start_us":34384,"threads_started":1}
I20260709 12:14:16.259112  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.259774 11829 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.260039  9621 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:16.263782  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.260448  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1208) took 3433 ms. Trace:
I20260709 12:14:16.268628  8992 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:16.239444 11789 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.259117  8995 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.280906  8998 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:16.282322  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 221389us
W20260709 12:14:16.277590  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49289.3us
I20260709 12:14:16.284379  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2461) took 2391 ms. Trace:
I20260709 12:14:16.284911  8992 rpcz_store.cc:276] 0709 12:14:13.878090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.182023 (+2303933us) service_pool.cc:224] Handling call
0709 12:14:16.244384 (+ 62361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.269346 (+ 24962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.269616 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.270061  8999 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:16.288493  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2460) took 2410 ms. Trace:
I20260709 12:14:16.289080  8999 rpcz_store.cc:276] 0709 12:14:13.877820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.179325 (+2301505us) service_pool.cc:224] Handling call
0709 12:14:16.222717 (+ 43392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.286229 (+ 63512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.288414 (+  2185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.291327  9066 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:16.292150  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1228) took 1617 ms. Trace:
I20260709 12:14:16.293073  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1220) took 1994 ms. Trace:
I20260709 12:14:16.293016  8995 rpcz_store.cc:276] 0709 12:14:14.674922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.258454 (+1583532us) service_pool.cc:224] Handling call
0709 12:14:16.258895 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.291844 (+ 32949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.292067 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.293471  8998 rpcz_store.cc:276] 0709 12:14:14.298974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.221058 (+1922084us) service_pool.cc:224] Handling call
0709 12:14:16.264374 (+ 43316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.292836 (+ 28462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.293023 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.295454  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:16.297506 11630 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.295503 11707 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.298172 11630 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.299875  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.294991 11738 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:16.301416 11738 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:16.301541 11575 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.596s	user 0.017s	sys 0.000s
I20260709 12:14:16.302277 11575 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.300025 11404 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.303392  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1205) took 3482 ms. Trace:
I20260709 12:14:16.302474 11738 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.316931  9070 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:14:16.314438  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.268784  9000 rpcz_store.cc:276] 0709 12:14:12.827014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.715713 (+2888699us) service_pool.cc:224] Handling call
0709 12:14:15.716149 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:15.830452 (+114303us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:15.830975 (+   523us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.972707 (+141732us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.056959 (+ 84252us) log.cc:844] Serialized 52 byte log entry
0709 12:14:16.058915 (+  1956us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:16.059843 (+   928us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.259716 (+199873us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.259894 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.260004 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.260039 (+    35us) raft_consensus.cc:1685] finished
0709 12:14:16.260049 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.260236 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242548,"prepare.queue_time_us":144125,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":16565,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":4883,"thread_start_us":133950,"threads_started":1,"wal-append.queue_time_us":177648}
I20260709 12:14:16.321669  9071 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.322115  8998 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:16.322829  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 532) took 1178 ms. Trace:
I20260709 12:14:16.325031  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.326136  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.326946 11674 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:16.328171 11280 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:16.328596 11280 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.328974 11280 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.331496 11233 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:16.323216  8998 rpcz_store.cc:276] 0709 12:14:15.144722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.314259 (+1169537us) service_pool.cc:224] Handling call
0709 12:14:16.321804 (+  7545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.322527 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.322756 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.291940 11492 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:16.332201  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1225) took 1658 ms. Trace:
I20260709 12:14:16.332753  8994 rpcz_store.cc:276] 0709 12:14:14.674160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.283518 (+1609358us) service_pool.cc:224] Handling call
0709 12:14:16.331597 (+ 48079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.331864 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.331890 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.331949 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:16.331977 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.332026 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.332142 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.340704  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85117.1us
I20260709 12:14:16.341214 11404 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.342552  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.344063  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.344702 11404 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.337411 11707 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:16.331975 11233 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.346163 11233 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:16.346550  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 496) took 1831 ms. Trace:
I20260709 12:14:16.347080  9068 rpcz_store.cc:276] 0709 12:14:14.515631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.587768 (+ 72137us) service_pool.cc:224] Handling call
0709 12:14:16.346208 (+1758440us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004204d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:16.346450 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3285384960}
I20260709 12:14:16.335763 11492 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.344916  9615 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:16.349197  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:16.311461  8997 rpcz_store.cc:276] 0709 12:14:12.779197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.715145 (+2935948us) service_pool.cc:224] Handling call
0709 12:14:15.828276 (+113131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.828835 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:15.829477 (+   642us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.005354 (+175877us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.250651 (+245297us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b18002c8180. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:16.250857 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.250924 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:16.250984 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.251086 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.261111 (+ 10025us) inbound_call.cc:177] Queueing success response
0709 12:14:16.304345 (+ 43234us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18002c8180. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
Metrics: {"mutex_wait_us":22827,"prepare.queue_time_us":137820,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":275957,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":46545408,"thread_start_us":146516,"threads_started":1,"wal-append.queue_time_us":260851}
I20260709 12:14:16.353904  8999 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:16.354460  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1231) took 1274 ms. Trace:
I20260709 12:14:16.354717  8999 rpcz_store.cc:276] 0709 12:14:15.080600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.314627 (+1234027us) service_pool.cc:224] Handling call
0709 12:14:16.351595 (+ 36968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.354255 (+  2660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.354416 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.356585  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 151586us
I20260709 12:14:16.357755 11670 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:16.359858 11756 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.360056 11670 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:16.360258 11769 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:16.356143 11707 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:16.360715 11769 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.361191 11769 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.361284 11670 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.361527 11707 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.362859 11670 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.303169 11800 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:16.365739  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 75522.2us
I20260709 12:14:16.366840  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.351102 11404 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.352135 11492 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:16.363368 11511 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:16.378085 11886 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:14:16.375828  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.360486 11756 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.381500  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.379989  8923 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:16.357298 11871 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:16.386651  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.388860  8992 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:16.389503  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1230) took 1315 ms. Trace:
I20260709 12:14:16.389748  8992 rpcz_store.cc:276] 0709 12:14:15.073987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.308156 (+1234169us) service_pool.cc:224] Handling call
0709 12:14:16.372168 (+ 64012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.389294 (+ 17126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.389459 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.378721 11511 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.392688  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:16.394918  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 52470.8us
I20260709 12:14:16.394392 11511 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.407791  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.416779  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1209) took 3587 ms. Trace:
I20260709 12:14:16.417405  8996 rpcz_store.cc:276] 0709 12:14:12.829621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.829717 (+3000096us) service_pool.cc:224] Handling call
0709 12:14:16.226360 (+396643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.231168 (+  4808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.416468 (+185300us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5400171e50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:16.416689 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910626176}
I20260709 12:14:16.413555 11838 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:16.424226  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.418027 11756 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:16.445096  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.438824  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 99452.9us
I20260709 12:14:16.376981 11404 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.461058 11738 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.461748 11738 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.464672 11738 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.466373  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.467046  8996 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.466917  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.467617 11738 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.468218  8992 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:16.468168 11738 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.470413 11738 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:16.475817 11888 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 12:14:16.475744 11891 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:14:16.486891  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52381.9us
I20260709 12:14:16.438832  9619 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:14:16.488046  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114634us
I20260709 12:14:16.498015  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.489023  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.496460  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:16.502593  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.506045  8997 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.508800  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.478677 11831 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.459662 11511 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.491816 11447 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.521821  8994 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.529728  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.493698 11712 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:14:16.539301  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.539625 11871 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.539953 11712 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:16.540462 11712 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:16.541136 11893 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:16.541450  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.542182  8922 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:16.542821 11844 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.543669  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.544343  8917 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:16.545037 11887 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:14:16.544884 11492 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.513068 11575 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.546629 11874 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:14:16.548702  9000 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:16.531075  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.543428 11844 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.533485 11864 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.551999  8996 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:16.562412  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.520623 11829 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:16.559621  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.536772  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.563673  9617 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:16.559360  8919 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:16.581427  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.566541 11895 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.567348  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.567444 11844 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.546880 11280 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.568986 11511 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.541486 11712 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.571579  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.572263 11404 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.572163 11864 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.609301  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:16.609795  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.610848 11801 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.610572 11895 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:16.611075 11864 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.547160 11447 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.611629 11895 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:16.612133 11895 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:16.613221 11447 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:16.573951 11492 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.575487  8994 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:16.613169 11895 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.614275 11769 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.576555  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.615566  8996 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:16.616402  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.616670  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.617030  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.617525  8996 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:16.617756  9000 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:16.617704  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.618300  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.618580  8921 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:16.618996  8996 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:16.579363  8998 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.618629  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.621447  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.621770  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.621419  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.622427  9068 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:16.622979  8921 raft_consensus.cc:2368] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9.
I20260709 12:14:16.589695  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.623576  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:16.624117  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.624219  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.624413  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.625260  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.625711  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.626035  8925 raft_consensus.cc:2393] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:16.626535 11751 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.589740 11630 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.600019  8918 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.626855  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.600587  8916 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.600680  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.601167  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.607362  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.607980  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.608520 11712 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.608726 11457 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.611416 11801 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:16.615496  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77282.1us
I20260709 12:14:16.527256 11838 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.625308 11263 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.626379  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.627036 11751 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.614974  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.627985  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.629172  9620 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.580914 11829 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:16.629863  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.630607  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.599886  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.610572  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.631210 11280 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.539041 11831 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.664773 11831 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.657886  8997 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:16.631799  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:16.618337  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.593331  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.669006  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.669653  8917 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 3.
I20260709 12:14:16.670466  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:16.597018  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 82955.7us
I20260709 12:14:16.640625  9619 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:16.624223  9067 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:16.645378 11404 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.614889 11895 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.626439  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.649046  8918 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:16.650328  8994 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:16.650069  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.683657  8996 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:16.655040  8998 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:16.656834  9616 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.641892 11457 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.661202  8921 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:16.661469 11871 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.662007 11263 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:16.662245 11864 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.662917  8992 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:16.673149  8917 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:16.695819  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:16.583388  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 98256.4us
I20260709 12:14:16.652410 11751 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.681420  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.690778  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:16.698096  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51079.9us
I20260709 12:14:16.691126  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.699494  8918 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.657877 11829 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.678838 11511 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.696482  8998 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:16.698868  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:16.695704  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 67791.6us
I20260709 12:14:16.697173  8996 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:14:16.698926  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 136829us
I20260709 12:14:16.670644 11233 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.705646  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.685113  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.701972  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.692142 11447 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.709931  8921 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:16.710446  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.711445  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.713738  9068 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:16.690888 11457 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:16.715812  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.717916  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.704828 11670 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.723626  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.725618  8925 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:16.725628  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.724143  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:16.711390 11280 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:16.712163 11630 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:16.730365  8917 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:16.732098  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.707854 11575 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:16.703552 11831 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:14:16.692724 11789 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.743052 11280 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.739915 11769 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:16.739853 11456 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:14:16.713033 11511 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.742496 11805 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:16.703866 11874 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:16.745990  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.746675 11819 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:16.748116  8922 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.707166 11707 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:16.739006  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.721514 11901 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.724638 11670 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.702324 11404 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.741976 11801 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.717053 11864 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.762706  9623 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:16.763814  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.762706  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.748847 11630 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.772130  9621 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:16.773233  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.769368 11575 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.780658 11456 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:16.782006  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 71642.9us
I20260709 12:14:16.756592 11280 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.790257  8921 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 3.
I20260709 12:14:16.770808 11492 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:16.762310 11805 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.800065  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:16.799412 11841 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:16.805079  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.805680  8998 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:16.807374  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.788769 11670 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.815310  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.792555  8918 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:16.735158 11263 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:16.855252  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.790932 11630 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.853875  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.805505 11805 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:16.855929  9069 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 12:14:16.856521  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:16.875715  8999 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:16.857887  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52921.6us
I20260709 12:14:16.876701  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.877570  8918 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 3.
I20260709 12:14:16.788115  9620 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:16.876775  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:16.802733 11841 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:16.790823 11456 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:16.804538 11732 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:16.822433 11492 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:16.791350 11901 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.822566 11707 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:14:16.882524  9069 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:16.952906  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:16.916231  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:16.955956  9622 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:16.949164  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.948860  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.950999  8916 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
W20260709 12:14:16.918087  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 192188us
W20260709 12:14:16.899945  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.912318  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.930100  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:16.958195  8921 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:16.970309  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.872632 11769 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:16.972348  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.975265  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:16.979224  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 178765us
I20260709 12:14:16.972247  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.981014  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:16.982782  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.983583  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.950373 11650 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.880703 11730 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:16.978231  8998 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:16.857661 11575 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:16.993877  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:16.883632 11233 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:16.884362 11844 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:16.987944  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:16.967036 11874 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:16.974676 11861 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.973242 11756 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.022280  9619 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:16.951982 11819 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:16.989718 11681 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:17.040771  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 164081us
I20260709 12:14:16.995849  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:16.994256  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:17.038156  8992 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:17.008587  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:16.906185 11841 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.020632 11800 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.045760  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:17.046387  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:17.052515  9619 raft_consensus.cc:2410] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:16.906016 11527 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.047696 11769 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.053922 11855 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.054252 11527 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.054601 11855 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.054986 11841 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.056871 11855 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.057025 11527 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.064837  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:17.067214 11492 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.074287  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.075418 11511 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.076042 11511 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.043846 11819 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.077423 11819 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.078871 11819 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.040941 11682 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.083827 11682 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.084803 11892 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.608s	user 0.003s	sys 0.000s
I20260709 12:14:17.045120 11704 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:17.087584  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2163) took 1063 ms. Trace:
I20260709 12:14:17.087816 11704 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.087997  9072 rpcz_store.cc:276] 0709 12:14:16.023911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.049949 (+ 26038us) service_pool.cc:224] Handling call
0709 12:14:16.050323 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.058116 (+  7793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.058198 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.082721 (+ 24523us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.234576 (+151855us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:16.234630 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.234713 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.084139 (+849426us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:17.087273 (+  3134us) raft_consensus.cc:1685] finished
0709 12:14:17.087294 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.087503 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2192,"raft.queue_time_us":5025,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":18711,"spinlock_wait_cycles":18723584,"thread_start_us":99548,"threads_started":1,"wal-append.queue_time_us":278233}
I20260709 12:14:17.089265 11704 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.092306  8921 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:14:17.093523 11829 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.094365  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1359) took 1798 ms. Trace:
I20260709 12:14:17.094810  9067 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:17.094735  8924 rpcz_store.cc:276] 0709 12:14:15.295617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.295750 (+   133us) service_pool.cc:224] Handling call
0709 12:14:17.094034 (+1798284us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540020e9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:17.094206 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806719232}
I20260709 12:14:17.096493  8924 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:17.097204  8916 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:17.098205  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1376) took 1102 ms. Trace:
I20260709 12:14:17.098569  8919 rpcz_store.cc:276] 0709 12:14:15.995723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.995924 (+   201us) service_pool.cc:224] Handling call
0709 12:14:15.996409 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.581540 (+585131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.097943 (+516403us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400244854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:17.098099 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166857984}
I20260709 12:14:17.047376  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.099614 11864 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:17.048789 11905 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 12:14:17.044915  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:17.101135  8919 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:17.101627  8998 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 3: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:17.047127  9620 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.107858 11575 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:17.108769  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 66911us
I20260709 12:14:17.110090  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.111729 11681 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.100935  9622 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:17.112462  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.112715 11681 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.113196 11800 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.106977  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 501) took 4998 ms. Trace:
I20260709 12:14:17.113979  8993 rpcz_store.cc:276] 0709 12:14:12.108398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.644656 (+2536258us) service_pool.cc:224] Handling call
0709 12:14:14.658779 (+ 14123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.832520 (+1173741us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:15.966126 (+133606us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.307475 (+341349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.307529 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:16.307592 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.106642 (+799050us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540039add4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:17.106686 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.106797 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299031,"prepare.queue_time_us":142994,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2992,"raft.queue_time_us":302893,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7938,"spinlock_wait_cycles":2697426176,"thread_start_us":173636,"threads_started":2,"wal-append.queue_time_us":194670}
W20260709 12:14:17.115818 11913 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:17.116024 11800 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.086943 11682 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.118297 11704 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:17.119860 11902 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.420s	user 0.002s	sys 0.001s
I20260709 12:14:17.024333 11874 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.121675  9616 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:17.077332  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.106932  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:17.047917  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52127.6us
I20260709 12:14:17.126274  9623 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:17.127596  9617 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:17.123050  9068 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:17.130859  8919 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:17.129622  9073 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:17.134689  9621 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:17.136612  8918 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:17.139096  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 113907us
I20260709 12:14:17.142433  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:17.147353  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 166398us
I20260709 12:14:17.101027 11901 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.148770  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:17.172940  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 243830us
W20260709 12:14:17.147620 11906 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
W20260709 12:14:17.173398  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 96203.4us
W20260709 12:14:17.175542  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.175297  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 154132us
I20260709 12:14:17.158885  9620 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:17.179811  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.051551 11844 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.179949  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:17.140827 11914 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:17.159809 11707 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.168113 11871 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.135987 11751 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.173223 11901 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:17.183939 11575 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:17.051745 11861 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.173398 11511 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:17.221248  9590 leader_election.cc:400] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9.
I20260709 12:14:17.221745  9590 leader_election.cc:403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:14:17.223183  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.223380  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.224686 11707 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9.
I20260709 12:14:17.225572 11707 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.225719 11911 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:17.227821  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 47996.9us
I20260709 12:14:17.208200 11919 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.213054 11829 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:17.221547  9618 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:17.220943 11650 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.219166 11901 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:17.207212 11630 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.269439  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:17.273356  8923 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.282042  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.259969 11831 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:17.276677 11447 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
W20260709 12:14:17.297814  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 74569.6us
I20260709 12:14:17.279855 11682 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.293277 11575 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:17.312927  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 88192.6us
I20260709 12:14:17.287746 11831 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.294373 11855 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:17.302611 11895 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.002s
W20260709 12:14:17.324290  8922 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.005s
I20260709 12:14:17.326256  8922 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:17.305837 11447 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:17.333046 11280 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 12:14:17.333520 11280 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.325871 11855 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:17.335660 11855 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.339346 11920 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:14:17.340270 11630 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.340374 11920 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.340845 11920 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.313678 11682 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.341030 11805 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.341643  9624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.012s
W20260709 12:14:17.341998  9624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.005s	sys 0.012s
W20260709 12:14:17.324321 11457 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.003s
I20260709 12:14:17.265846 11919 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.344818  8991 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:17.345168 11919 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.345471  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1219) took 4005 ms. Trace:
W20260709 12:14:17.345189 11915 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:14:17.345841  8991 rpcz_store.cc:276] 0709 12:14:13.340234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.152268 (+2812034us) service_pool.cc:224] Handling call
0709 12:14:17.344512 (+1192244us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16eee 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:17.344653 (+   141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.345235 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.345399 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11437312}
I20260709 12:14:17.348104 11831 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.349180 11831 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.349120 11670 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.350580  8917 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:17.351643  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53051.5us
I20260709 12:14:17.352569  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.354805 11511 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.343109 11457 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.358829 11457 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:17.361496 11575 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.332019  8922 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:17.373946  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45499.5us
I20260709 12:14:17.354995  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.374706  8918 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:17.384243  8923 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:17.312541 11864 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:14:17.364701 11805 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:17.387847 11909 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:14:17.383610 11919 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.315047 11912 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 12:14:17.385212 11895 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.389264 11457 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:17.415383 11514 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:14:17.415602 11844 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.419571 11919 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:17.420670 11919 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:17.403720 11712 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.001s
I20260709 12:14:17.421715 11829 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.422155 11712 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.422552 11712 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.423388 11712 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.424569 11712 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.425611  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70783.3us
I20260709 12:14:17.426391  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:17.428777  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 465) took 1189 ms. Trace:
I20260709 12:14:17.403934 11280 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:17.395589 11670 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:17.429785  9587 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.822s (SENT)
I20260709 12:14:17.429929 11895 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.431278  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.432148 11895 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.432785  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.433385 11861 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.432709 11895 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.434285 11895 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:17.434015 11929 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:17.434693  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:17.393424 11751 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.430267  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.436416 11492 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.436157 11855 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.438267 11855 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:17.438836 11855 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.439788  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.440732 11928 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.441169 11653 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:17.441416 11707 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.374506 11901 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.442232 11653 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.448622  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.439154 11855 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.448105 11457 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:17.446732 11670 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.453106 11457 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.458904 11457 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.460130 11457 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.463510 11707 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.464270 11707 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:17.465647 11707 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:17.429258  9618 rpcz_store.cc:276] 0709 12:14:16.239566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.244081 (+  4515us) service_pool.cc:224] Handling call
0709 12:14:17.104480 (+860399us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16eee 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:17.202414 (+ 97934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.271546 (+ 69132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.428250 (+156704us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b54006cc5d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:17.428473 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229171328}
I20260709 12:14:17.468808 11404 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.469571 11492 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:17.470022 11896 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.012s	user 0.005s	sys 0.000s
I20260709 12:14:17.455833  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.454645 11670 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.444609 11280 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:14:17.484182 11280 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:17.484702 11280 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.485569 11280 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.488508 11914 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.488989 11914 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.489483  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.491816  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.493076  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:17.493640  9073 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.448684 11844 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.495602  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:17.496177  9067 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.445252 11929 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:14:17.452945 11855 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.502487 11679 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.502926 11679 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:17.503966 11679 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.505822 11679 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.508309 11920 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.509676 11920 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.443691 11895 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.513454  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:17.490111  9072 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:14:17.515712  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69681.2us
W20260709 12:14:17.452477  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 62214.1us
I20260709 12:14:17.516889  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:14:17.519289  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.523598  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:17.523856  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.524385  9074 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:17.525277  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.526386  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:17.527025  9624 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:17.523633  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.528012 11670 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.529230 11670 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.532620  9618 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:17.454360 11456 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.543855  9065 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:17.535707 11653 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.538632  9073 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:17.542382  9067 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:17.546128  9617 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:17.547226 11789 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.547868  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.549294 11914 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.549986  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.550662  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.551738 11819 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:17.552434 11514 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.565421  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:17.576306  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.520185 11457 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 12:14:17.577934  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61156.2us
I20260709 12:14:17.584931  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:17.581853  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:17.585390  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.583289  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:17.587345  9617 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:17.588500  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:17.589291  8923 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.552882 11932 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:14:17.594168  8922 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:17.580768 11912 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:17.621037  8923 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:17.621507  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.569969 11653 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.643682  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.647696  9618 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:14:17.654246  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 685673us
I20260709 12:14:17.655320  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.659106 11730 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:17.659536 11730 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.659883 11730 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.662514 11704 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:17.665612 11527 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:17.665871  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 555809us
I20260709 12:14:17.666179 11527 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:17.666666  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.667153 11527 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.671633 11918 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:17.672286 11917 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.673522 11917 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.610303 11912 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:17.675834  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.677168  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 538) took 1105 ms. Trace:
I20260709 12:14:17.675102  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 536) took 1103 ms. Trace:
I20260709 12:14:17.677711  8994 rpcz_store.cc:276] 0709 12:14:16.571984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.695415 (+123431us) service_pool.cc:224] Handling call
0709 12:14:16.712394 (+ 16979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.743535 (+ 31141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.743564 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.744130 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.952761 (+208631us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:16.971891 (+ 19130us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.644116 (+672225us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18000bd640. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:17.653062 (+  8946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.653159 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.653214 (+    55us) raft_consensus.cc:1685] finished
0709 12:14:17.676954 (+ 23740us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.677108 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2640,"prepare.queue_time_us":20522,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2659,"raft.queue_time_us":687217,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":2747,"spinlock_wait_cycles":7676288,"thread_start_us":166288,"threads_started":1,"wal-append.queue_time_us":371832}
I20260709 12:14:17.701891  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.705714  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:17.706089  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.706453  8994 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:17.706837  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 531363us
I20260709 12:14:17.707774  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.708601  9073 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:17.711226  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:17.715538  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1232) took 2629 ms. Trace:
I20260709 12:14:17.717283  8922 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:17.721339  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54774us
I20260709 12:14:17.720777  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:17.722398  8997 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:17.705605 11932 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.715929  8995 rpcz_store.cc:276] 0709 12:14:15.085969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.315132 (+1229163us) service_pool.cc:224] Handling call
0709 12:14:16.356357 (+ 41225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.390490 (+ 34133us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:16.459707 (+ 69217us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.596218 (+1136511us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b18003c8b00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:14:17.715170 (+118952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.715257 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:17.715297 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.715364 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.715486 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68100,"prepare.queue_time_us":30528,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"spinlock_wait_cycles":20585344,"thread_start_us":50590,"threads_started":1,"wal-append.queue_time_us":1163804}
I20260709 12:14:17.707777  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.726053  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.726928  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.723515  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:17.728540  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.731300  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:17.731657 11732 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:17.732192 11732 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:17.731861 11932 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.732683 11732 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:17.733616  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:17.734606  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.734812 11932 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:17.722855 11831 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.735311 11805 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.735735 11630 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.736186 11630 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.736529 11630 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.717694 11949 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.739944 11753 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.740660 11682 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.740530 11753 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.740909 11732 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.742782 11753 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.729355  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:17.745416 11858 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.745855 11858 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.746793 11858 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.748064 11858 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.752405 11653 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.754091 11712 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.754597 11712 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.755492 11712 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.759984 11939 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:14:17.762791  8994 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:17.758852 11874 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:17.776691 11940 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:14:17.777839  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46267.2us
I20260709 12:14:17.720603 11738 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:17.789335  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60040.9us
I20260709 12:14:17.790702  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.793897 11575 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.794306 11575 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.794682 11575 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.794440  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.792441 11932 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:17.799089 11630 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:17.808247 11942 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:14:17.809170 11943 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:14:17.809731 11912 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.728134 11855 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.812384 11855 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.817664 11730 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.777911 11874 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.819777 11937 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:14:17.821789 11914 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:17.796253 11928 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.822724 11928 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.825964 11928 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.768478 11492 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.832118 11492 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.832513 11492 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.834636  8925 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:17.845476  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 117011us
I20260709 12:14:17.849472  9617 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:17.849730  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 55383.8us
I20260709 12:14:17.850638  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.855090 11447 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.857808 11951 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.858397 11951 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.860297  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:17.860805 11951 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.862422 11447 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.863559 11447 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.864126  9618 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:17.864566 11819 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.865109 11819 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.865320 11704 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.680537  9000 rpcz_store.cc:276] 0709 12:14:16.571415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.620248 (+ 48833us) service_pool.cc:224] Handling call
0709 12:14:16.620811 (+   563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.623640 (+  2829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.623665 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.080172 (+456507us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b2c00011ed8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:14:17.080588 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.212236 (+131648us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:17.233579 (+ 21343us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.457799 (+224220us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b1800469360. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:17.674715 (+216916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.674842 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.674884 (+    42us) raft_consensus.cc:1685] finished
0709 12:14:17.674900 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.675043 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440870,"prepare.queue_time_us":22351,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":445044,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":31319040,"thread_start_us":131266,"threads_started":1,"wal-append.queue_time_us":191788}
I20260709 12:14:17.865737 11704 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.866135 11704 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.865969 11819 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.867497 11914 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:17.788859 11949 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.869453 11949 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:17.870878 11914 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.871358 11914 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:17.872330 11914 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.873617 11914 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.852169 11650 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.875316 11650 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:17.876322 11650 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.878118  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:17.852083 11907 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:17.880311 11730 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:17.881867 11456 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.883734  9000 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:14:17.892887  8924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.016s
W20260709 12:14:17.893867  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.008s	sys 0.016s
W20260709 12:14:17.905761  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.790195 11895 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.910514  8999 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:17.892263 11871 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:17.919322 11789 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:17.921160  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:17.921825  9074 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.925952 11917 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.930979  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1382) took 1209 ms. Trace:
I20260709 12:14:17.933014  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1390) took 1188 ms. Trace:
W20260709 12:14:17.934656  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 386837us
I20260709 12:14:17.931589  8917 rpcz_store.cc:276] 0709 12:14:16.721525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.797467 (+ 75942us) service_pool.cc:224] Handling call
0709 12:14:17.930720 (+1133253us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001e55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:17.930901 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137460608}
I20260709 12:14:17.935631  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.936623  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.938457  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.933382  8916 rpcz_store.cc:276] 0709 12:14:16.744286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.098175 (+353889us) service_pool.cc:224] Handling call
0709 12:14:17.098546 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.098830 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:17.384211 (+285381us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.545767 (+161556us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.932566 (+386799us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b1800437f20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:17.932700 (+   134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.932744 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:17.932785 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.932857 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.932964 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17133,"prepare.queue_time_us":157782,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":4396,"raft.queue_time_us":2468,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":11220,"spinlock_wait_cycles":18998144,"thread_start_us":400436,"threads_started":2,"wal-append.queue_time_us":162465}
I20260709 12:14:17.940045  9071 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:17.896832 11730 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:17.915030 11858 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:17.944386  9065 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:14:17.945166  9065 pending_rounds.cc:85] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 7
I20260709 12:14:17.948230  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:17.935909 11756 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:17.951139  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.938030 11800 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.954360  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:17.955760  8916 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:17.945394  9065 pending_rounds.cc:107] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:17.957140  9065 raft_consensus.cc:2889] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:17.958174 11826 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:17.958601 11826 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.958946 11826 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:17.959599  9590 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 2.017s (SENT) [suppressed 20 similar messages]
I20260709 12:14:17.959978 11280 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.960409 11280 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:17.960764 11280 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.962124 11653 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.965487 11789 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.958787  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:17.944547 11844 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.973043  9074 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:14:17.973980  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.988989  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:17.981063 11917 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.962595 11653 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:17.950702 11858 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:18.031944  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 446605us
W20260709 12:14:18.031944  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 73172.3us
I20260709 12:14:18.069594  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:17.994139 11928 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:14:17.994333 11789 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:14:18.071902  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:18.000082 11800 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:18.068904  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:18.051973 11511 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.038754 11920 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.993417 11844 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.032580 11838 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.995608 11492 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:18.092710  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.099371  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 139791us
I20260709 12:14:18.102531  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.073586 11861 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.116809  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.078001 11681 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.122330 11934 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.106348 11670 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:18.070865 11864 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:14:18.141472  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 152556us
I20260709 12:14:18.149684  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.107494 11679 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:18.159814  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 106982us
W20260709 12:14:18.162704  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88170.8us
I20260709 12:14:18.164853  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:18.033322 11917 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.175004  9624 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:18.090348 11575 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.128298 11895 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:18.145341 11918 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:18.189837  8995 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.170758 11670 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:18.200943  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:18.181275 11916 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:18.160905 11934 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.184798 11679 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:18.209720  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.216512  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:18.217429  8920 raft_consensus.cc:2368] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:18.191263 11681 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.211918  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:18.212908  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:18.219827  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.221973  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.226251  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.229785 11844 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.192437 11918 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.232322 11492 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.232754 11918 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.189666 11800 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.233371  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1389) took 1489 ms. Trace:
W20260709 12:14:18.233671 11960 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:14:18.235504  9037 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.086s (SENT)
I20260709 12:14:18.236018  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:18.236231  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:18.237578  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.237717 11917 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:18.237856 11964 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:14:18.237979  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.238415  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.239404 11958 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:14:18.239912  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:18.240873 11934 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:18.241448 11961 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:14:18.235613 11575 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.206599 11968 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:18.242571 11954 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:18.242413 11968 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:18.235579 11957 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:14:18.246318  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:18.248052  8966 leader_election.cc:400] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:18.248395  8966 leader_election.cc:403] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:18.248804  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.206395 11916 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:18.255127  9073 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:18.256618  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:18.250780  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50075.7us
I20260709 12:14:18.253504  8916 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:18.273305  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.274139  8991 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.274782  8994 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.275965  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.277081  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.277908  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.278129  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.278739  8998 raft_consensus.cc:2376] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4. Re-sending same reply.
I20260709 12:14:18.279088  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.279837  8996 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.211215 11511 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:18.233753  8924 rpcz_store.cc:276] 0709 12:14:16.743994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.097175 (+353181us) service_pool.cc:224] Handling call
0709 12:14:17.097447 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.227685 (+130238us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:17.313829 (+ 86144us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.953644 (+639815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.953688 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:17.953731 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.233124 (+279393us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001dfe54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:18.233177 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.233311 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90276,"prepare.queue_time_us":100142,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2741,"raft.queue_time_us":59708,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":93,"spinlock_wait_cycles":292909696,"thread_start_us":595639,"threads_started":2,"wal-append.queue_time_us":660120}
I20260709 12:14:18.279631  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.281237  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.281574  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.223829 11682 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.294163  8994 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.302094 11826 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.302249 11864 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:18.302838  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.303934  8923 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:18.294461  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:18.244768 11968 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.279523 11263 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.295122  8998 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.299286  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.315594  8996 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:18.300570 11704 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.252668 11789 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:18.309247  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.295835  9071 raft_consensus.cc:2410] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:18.310865  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.312582  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:18.323284  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.327072  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:18.327756  9624 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.327944  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:18.330422  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.330729  9616 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:18.321739  8992 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:18.306610 11934 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:18.331831  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.332079  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:18.320780  8994 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.308256 11653 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.309373 11681 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.348302  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.351035  8992 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.352208  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:18.353188  8924 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:18.313262 11920 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:18.339592  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:18.362993  8998 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:18.364280  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.365543  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.366122  8998 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:18.363061  9621 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:18.343362  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.334452 11233 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:18.379065  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:18.368621  8996 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:18.380849  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.334710 11934 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.350790 11681 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.384953  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:18.337987 11858 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.394336  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.397199  8997 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:18.399211  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:18.400697  8994 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:18.403669  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.404095  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.410127  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.413883  9624 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:18.349217 11679 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.417198  8994 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.335904 11789 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.414173  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:18.384471 11982 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.425032  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.425763  8997 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 3.
I20260709 12:14:18.398113 11934 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.404551 11681 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.404790 11233 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:18.394088 11977 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:18.428061  8998 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.351851 11670 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.384313 11864 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:18.337548 11916 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.418696 11972 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:18.441813  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.442646  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:18.440017  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.445581  8998 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:18.446285  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.441236 11982 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.452782  8924 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:18.430130 11895 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:18.501672  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.502545  8994 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.490501  8991 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:18.504460  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.506058  8998 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.507565  8991 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:18.511188  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 98016.1us
I20260709 12:14:18.511137  8998 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:18.512184  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.512838  8996 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:18.516410  8991 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:18.517046  8921 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:18.445701 11826 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.404371 11511 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.520468  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.519373  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.426718 11280 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.521730  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.434966 11979 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:14:18.507805 11916 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.521646  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:18.537881  8991 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:18.538307  8998 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:18.538614  8994 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:18.539153  8996 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:18.540481  9624 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:18.546228  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:18.546411  8998 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:18.547700  8997 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:18.548555  8998 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.550431  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.550920  8996 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.440964 11920 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.559896  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.560484  8997 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:18.560626  8998 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 4: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:18.561854 11983 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:14:18.551400 11704 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.552608 11800 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.549561 11895 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:14:18.623301  8996 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:18.624022 11987 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:18.628801  8992 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:18.632067  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.615617 11800 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.550097 11233 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.619357 11988 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.638814 11988 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.645159 11988 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:18.646003  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.647456  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:18.647864 11732 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.648185  9620 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:18.649369  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.650218  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.651216  9072 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:14:18.641817 11789 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.652386  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.652979  9068 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:18.647940  9073 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:18.655576  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:18.635031 11800 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.657472  9620 raft_consensus.cc:2410] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:18.657732  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.662343  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:18.668058  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:18.668246 11976 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:18.670265 11966 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:18.670419 11929 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.670783 11966 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:18.671183 11966 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.670904 11929 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.673130 11929 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:18.679418 11514 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:18.679922 11514 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:18.656953 11977 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:18.698848 11977 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.702267 11977 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:18.702700 11956 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.637s	user 0.000s	sys 0.003s
I20260709 12:14:18.703418  9616 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:18.704692 11630 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:18.706847  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:18.712138  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.725582  9617 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.724509  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.729132  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.729748  9068 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:18.732100  9072 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:18.728207  9620 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:18.732600  9072 pending_rounds.cc:85] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 4
I20260709 12:14:18.738039  9072 pending_rounds.cc:107] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:18.738442  9072 raft_consensus.cc:2889] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:18.681079 11514 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.732898 11280 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.747786  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.667196 11901 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:14:18.753939  8992 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.727694 11858 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.774612  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:18.799065  9617 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:18.800496  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:18.800913  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50307.9us
I20260709 12:14:18.808812  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.727828 11929 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:14:18.730921 11966 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.831881 11630 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.774268 11954 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.092s
W20260709 12:14:18.841351 11914 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.967s	user 0.014s	sys 0.000s
I20260709 12:14:18.831620 11861 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.839213 11917 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.838794 11670 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:18.807930 11858 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:18.862310 11986 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:14:18.874508 11918 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:18.866961 11917 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.859175 11630 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.905258 11679 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.925905  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 98519.2us
I20260709 12:14:18.870811 11670 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:18.867201 11861 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:18.946848  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.948457  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.949242  9068 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:18.950302  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.951510  9074 raft_consensus.cc:2410] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:18.952144  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.953631  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.956990  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.957194  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.957930  9070 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:18.958616  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.960642  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.961485  9072 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:18.963780  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.965109 11670 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:18.966017  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.966825 11630 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:18.966631  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.939566 11907 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:18.969319  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.972234  9072 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:18.973313  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:18.974015  9068 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
W20260709 12:14:18.974537 11934 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.539s	user 0.000s	sys 0.010s
I20260709 12:14:18.976379  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:18.977138  8992 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:18.978143  9072 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.957942  9066 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:18.978852  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.979951  9065 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:18.980355  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:18.955018  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:19.020339  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.937281 11679 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.029754 11918 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:19.033082  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:18.942339 11949 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:14:18.975009 11934 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.036038 11511 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.042073 11511 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.044697 11511 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.047395 11929 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.047492 11918 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.048123 11929 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:19.049007 11994 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:14:19.050380 11929 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:19.051084 11917 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.051846  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:19.053368 12000 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:14:18.944137 11681 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.047147  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.059553  8991 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:19.069072  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.059582  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:19.076289  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 275888us
I20260709 12:14:19.076339  8921 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:19.077445  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:19.078675  9071 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:19.039872 11901 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.070096 11966 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.094029  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.095167 12008 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.073087 11789 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.098757  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:19.098973  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:19.083084 11263 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.007s
I20260709 12:14:19.100602  9622 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.101415  8991 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:19.102952  9066 raft_consensus.cc:2410] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:19.079886 11919 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.104525  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:19.105419  9065 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:19.095418 12004 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.102989  8991 pending_rounds.cc:85] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 6
I20260709 12:14:19.112547  8991 pending_rounds.cc:107] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:19.112872  8991 raft_consensus.cc:2889] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.116207  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:19.117362  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:19.118749 12004 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.120924 12004 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.121984  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:19.098627 11630 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.098048 11858 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:19.123821 11858 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.123575 11630 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.124289 11858 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.125651  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 729) took 1239 ms. Trace:
I20260709 12:14:19.125669 11630 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.126268 11858 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.107919 11789 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.128612  9624 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:19.128808 11861 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.095853 11901 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.129741 11789 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:19.130286 11934 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.105280 12008 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.111474 11263 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:19.132982 12008 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.133617  8993 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:19.134168 11681 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.134480  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:19.135589  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.123039  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.136929  9071 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:19.136782  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.137488  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:19.137986  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44109.1us
I20260709 12:14:19.138865  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:19.135044  8992 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.136195  9000 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:19.146155  8917 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:19.152034  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:19.152275  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:19.108352 11919 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:14:19.161343  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.142781 12002 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.141708 11918 raft_consensus.cc:2764] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:19.165902  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.162086  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.166890  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.163278  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:19.148005 11514 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.165000  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:19.165707  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:19.169404  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.150177 11901 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.166837  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.168965  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.171137  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.150651 11630 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:14:19.158284 11919 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.170024  8991 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:19.180004  9000 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:19.177613  8998 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:19.177551  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:19.177101  8992 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:19.181524  9620 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:19.184978  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.151490 12004 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:14:19.175954 11789 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.161048 11968 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:14:19.190310  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.176949 11949 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:19.164624 11929 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:19.187175 12002 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:19.180785 11630 consensus_queue.cc:1243] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:14:19.201424 11999 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:14:19.201526 12009 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.202086 12009 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.202468 12009 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.203217 11938 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.207700 12014 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.193404 11949 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.194109 11920 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:14:19.218169 11712 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.126113  9615 rpcz_store.cc:276] 0709 12:14:17.886747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.897136 (+ 10389us) service_pool.cc:224] Handling call
0709 12:14:17.938625 (+ 41489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.950246 (+ 11621us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:18.122231 (+171985us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.125130 (+1002899us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b180038bd80. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287
0709 12:14:19.125263 (+   133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:19.125325 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:19.125391 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.125472 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.125594 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252218,"prepare.run_wall_time_us":6056,"raft.queue_time_us":83832,"raft.run_wall_time_us":5071,"spinlock_wait_cycles":216233088,"thread_start_us":191822,"threads_started":2}
W20260709 12:14:19.219416  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.194511 11679 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.218291 11858 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.200574 12002 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:19.240218 11916 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.005s
I20260709 12:14:19.222568 11949 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.246508  8920 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:19.247454  9617 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:19.247998  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2108) took 1028 ms. Trace:
I20260709 12:14:19.248389  8920 rpcz_store.cc:276] 0709 12:14:18.223796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.225969 (+  2173us) service_pool.cc:224] Handling call
0709 12:14:19.247805 (+1021836us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000cb2d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:19.247937 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344063872}
I20260709 12:14:19.249570  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.250173  8920 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
W20260709 12:14:19.253103 12013 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:19.203959 11938 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.250974  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:19.265511  8995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 552) took 1140 ms (client timeout 1515 ms). Trace:
I20260709 12:14:19.265841 12009 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.194224 11789 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.268265  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.270038  8920 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:19.270835  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:19.272755  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.272627  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.273878  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:19.265995  8995 rpcz_store.cc:269] 0709 12:14:18.125552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.125751 (+   199us) service_pool.cc:224] Handling call
0709 12:14:19.265252 (+1139501us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54000f64d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:19.265437 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85150592}
I20260709 12:14:19.276321  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.271373  8920 raft_consensus.cc:2376] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6. Re-sending same reply.
I20260709 12:14:19.283630  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.295372  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.295449  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.296768  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.297531  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.205722 12015 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:14:19.296767  8920 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:19.303396  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.305948  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:19.304919  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.309023  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.292990 11682 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:19.324815  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 134560us
I20260709 12:14:19.281391 11979 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.254846 12002 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.338898  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 200079us
I20260709 12:14:19.298098 11679 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:19.308593 11934 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.350872  8920 raft_consensus.cc:2410] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:19.354250  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.283324 11233 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.365216 12009 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.366930 11789 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.308735 11976 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.292824 11928 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:19.312242 11670 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:19.362646  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.309020 11920 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.320884 11756 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.352065 11682 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.323778 11280 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 12:14:19.381829  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 84399.9us
I20260709 12:14:19.362722 11901 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.356904 11679 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.387578  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.384044  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:19.389021  9065 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
W20260709 12:14:19.390734  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77379.9us
I20260709 12:14:19.369045 11233 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.392167  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:19.393935  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:19.396294  9617 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.398633 11511 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:19.380790 11682 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.374739 11756 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.395011  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:19.409612  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.403844 11630 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.385947 11901 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.410698  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.377725 11934 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:14:19.412935 12016 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:14:19.383633 11928 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:19.390208 11679 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:19.415014 11800 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.004s
W20260709 12:14:19.413657 12017 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:14:19.408818 11979 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:19.390213 12021 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.417615  8995 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:19.379581 11858 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:14:19.402246 11233 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.392551 11976 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.416937 11630 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.466977  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:19.425927  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.389248 11929 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:19.379846 12023 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:14:19.409559 11756 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.430156  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:19.433048 12018 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:14:19.401625 11670 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:14:19.428540  9617 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:19.402534 11920 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:14:19.419158 11901 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.446106 12021 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:19.448770 11959 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.372s	user 0.004s	sys 0.000s
I20260709 12:14:19.449908  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:19.466225 11916 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:19.482053 11949 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.451996 12030 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.483563 11928 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.485850 11630 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.466580 11976 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.440461 11800 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.488646 11968 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.492472  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:19.520154 11838 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.008s	sys 0.012s
I20260709 12:14:19.497002  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2107) took 1277 ms. Trace:
W20260709 12:14:19.497588  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.498826  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.502312  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:19.506475 11855 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.528936  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:19.528075  8922 rpcz_store.cc:276] 0709 12:14:18.219706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.227698 (+  7992us) service_pool.cc:224] Handling call
0709 12:14:18.228064 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:18.241847 (+ 13783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.241890 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:18.249179 (+  7289us) log.cc:844] Serialized 52 byte log entry
0709 12:14:18.388821 (+139642us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:18.388862 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.496418 (+1107556us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000cb7d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:19.496488 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.496556 (+    68us) raft_consensus.cc:1685] finished
0709 12:14:19.496576 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.496915 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5376,"raft.queue_time_us":9775,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":20427,"spinlock_wait_cycles":30758272,"thread_start_us":80920,"threads_started":1,"wal-append.queue_time_us":277309}
I20260709 12:14:19.530761  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 433) took 1192 ms. Trace:
I20260709 12:14:19.531100  8922 rpcz_store.cc:276] 0709 12:14:18.345493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.529969 (+1184476us) service_pool.cc:224] Handling call
0709 12:14:19.530291 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.530458 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.530483 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:19.530523 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:19.530553 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.530604 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.530707 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.532415  8922 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.533490  8919 raft_consensus.cc:2410] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:19.507802  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81977.9us
I20260709 12:14:19.460623 12038 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.509475  8920 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:19.492504 11679 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:19.515641  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 161456us
I20260709 12:14:19.516968  8916 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:19.511547 12033 raft_consensus.cc:2764] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:19.526695  8917 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.492902  9071 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:19.534729  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:19.516505 11979 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:19.524665 12030 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.537626  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.622254  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 427) took 1288 ms. Trace:
I20260709 12:14:19.622707  8916 rpcz_store.cc:276] 0709 12:14:18.334068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.449557 (+1115489us) service_pool.cc:224] Handling call
0709 12:14:19.622194 (+172637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.556030  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 432) took 1218 ms. Trace:
I20260709 12:14:19.554214  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2110) took 1309 ms. Trace:
I20260709 12:14:19.619904  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:19.597426  8922 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:19.626178  8920 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:14:19.528004 11838 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.322s	user 0.009s	sys 0.012s
I20260709 12:14:19.624248  8923 rpcz_store.cc:276] 0709 12:14:18.244429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.248858 (+  4429us) service_pool.cc:224] Handling call
0709 12:14:19.554005 (+1305147us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b5400414bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:19.554150 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18381184}
I20260709 12:14:19.623713  8921 rpcz_store.cc:276] 0709 12:14:18.338507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.537649 (+199142us) service_pool.cc:224] Handling call
0709 12:14:18.543857 (+  6208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:19.077059 (+533202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.555716 (+478657us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540020f8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:19.555959 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223990016}
W20260709 12:14:19.630268  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 92733.5us
I20260709 12:14:19.526372 11968 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.631408  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.632050  8922 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:19.633575  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 98901.1us
I20260709 12:14:19.520517 11916 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.636840  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.544175 11630 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:19.638438  8917 raft_consensus.cc:2410] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:19.548076 11511 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.621884 11920 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.642997  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:19.629791 11732 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:19.633325 11997 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:14:19.626997 12029 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.656278  8923 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:19.649266  8921 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:19.652733  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:19.658324  9624 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:19.660185  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.661067  8923 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:19.635581 11730 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.662202  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.637255 12004 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.665767  9616 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.666154  8923 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:19.667374  8923 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:19.636859 11968 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.640105 11630 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.672621  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:19.673364  8921 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:19.550383 11919 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.672645 11732 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:19.675319 11732 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.675836 12004 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.676573 12004 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.681988  8921 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:19.665462 12029 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.686151 12029 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.647665 12010 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:19.688859  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49128.7us
I20260709 12:14:19.547540 12038 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:19.695986  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53052.8us
I20260709 12:14:19.702996  9618 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:19.694147 11630 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.666685 12039 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.670735 11681 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.703909 11934 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.656630 11920 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.631778  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:14:19.732474  8916 raft_consensus.cc:606] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:19.732942  8916 raft_consensus.cc:614] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:19.725948  8998 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:19.661453 11511 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.731491  8992 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:19.739219  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:19.740187  8996 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:19.719774 12028 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.743816  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:19.729455 12042 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:14:19.712277 11730 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:14:19.713543 11682 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.745543  8998 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:19.726744 12039 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:19.752789  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:19.759191  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:19.768268  9616 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 4.
I20260709 12:14:19.731840 11681 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.750620 11800 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.687316 11979 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:19.767886 12036 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:14:19.754164 12004 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.742231 11934 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.759660 11949 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:19.768636 12021 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.881963  9624 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:19.780449 11730 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.953050 11730 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.957031 11730 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.970860  8917 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:14:19.862896 12037 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:14:19.775151 12028 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.881218 12043 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:14:19.881570 12046 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.941643 11920 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.937538 11800 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.981554 12046 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.982288 11800 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.879776 12045 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.852662 11916 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:19.774765 12047 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:19.976974 11976 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.991866 12047 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:19.992532 12047 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.979807 12051 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:14:19.941351 11968 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:19.995146  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 431) took 1658 ms (client timeout 1526 ms). Trace:
I20260709 12:14:19.960649 12030 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:19.989934  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 207463us
I20260709 12:14:19.784523 11679 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.940853 12049 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.862314  9616 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:19.913378 12039 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:19.995304  8916 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:20.387097  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1400) took 2808 ms. Trace:
W20260709 12:14:20.208508  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.452879  8924 rpcz_store.cc:269] 0709 12:14:18.336961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.356585 (+ 19624us) service_pool.cc:224] Handling call
0709 12:14:19.994934 (+1638349us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540020e9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:19.995065 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163352448}
I20260709 12:14:20.455354  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:20.462085  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:20.450141 11800 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.211347  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:20.464864  9068 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.467540  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:20.467756  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:20.468304  8919 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:20.470357  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:20.136511  8993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1240) took 1860 ms (client timeout 2224 ms). Trace:
I20260709 12:14:20.470993  8995 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:14:20.471071  8993 rpcz_store.cc:269] 0709 12:14:18.276375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.276850 (+   475us) service_pool.cc:224] Handling call
0709 12:14:20.136264 (+1859414us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400235ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:20.136433 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968455424}
I20260709 12:14:20.108429  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:20.474867  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.476454  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.477213  8999 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:20.478557  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:20.108037  9066 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:14:20.456961  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 837057us
I20260709 12:14:20.104489  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:20.106739  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:20.455314  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:20.463557  8924 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:20.462296  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:20.480114  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:20.480445  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:20.068749  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 365085us
I20260709 12:14:20.456096  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 442) took 1718 ms. Trace:
I20260709 12:14:19.936919 11233 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:20.530552  9074 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:20.570936 11949 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.542857  9040 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:20.708077 11949 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.708654 12023 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:20.080768 11982 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:20.710016  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 167246us
I20260709 12:14:20.710351 11949 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:20.483840 12007 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.711465 12007 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:19.985255 12028 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.715296  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:20.715461  9072 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:20.135556 11914 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:20.560009  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 78806.6us
I20260709 12:14:20.077894 11918 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.201872 12047 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.389473 12019 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.483901 11682 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:19.987538 12045 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:20.571589  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:20.729351  9066 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:20.044159 12001 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.082s	user 0.002s	sys 0.000s
I20260709 12:14:20.102270 11858 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.730301 11858 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:20.730363  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:20.480841  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:20.732491  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:20.735129 11907 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:20.737267 11233 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.608147  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.717402  9616 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.738131 11233 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:20.455128 12002 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.086s	user 0.011s	sys 0.002s
I20260709 12:14:20.709120 12023 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.743459 12023 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.107730 11919 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.744750  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:19.990857 12038 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:20.418792 12004 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:20.627672 11901 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.093s	user 0.010s	sys 0.001s
W20260709 12:14:20.697395 11979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.018s	sys 0.023s
I20260709 12:14:20.340490 11789 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:20.722491  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:20.706830  8923 raft_consensus.cc:2410] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:20.700121  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:20.860049  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 389249us
I20260709 12:14:20.731354 11858 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.737386  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 441) took 1999 ms. Trace:
W20260709 12:14:20.860941  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.013s	sys 0.045s
W20260709 12:14:20.861279  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.045s
I20260709 12:14:20.452239  8918 rpcz_store.cc:276] 0709 12:14:17.578834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.579418 (+   584us) service_pool.cc:224] Handling call
0709 12:14:17.591646 (+ 12228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.942681 (+351035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:17.942709 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.958184 (+ 15475us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.747511 (+789327us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b1800437e00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:18.848934 (+101423us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:18.848977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.052577 (+203600us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:20.386623 (+1334046us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b5400245254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:20.386699 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:20.386769 (+    70us) raft_consensus.cc:1685] finished
0709 12:14:20.386788 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.387007 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258716,"raft.queue_time_us":259703,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9287,"spinlock_wait_cycles":368437120,"thread_start_us":101226,"threads_started":1,"wal-append.queue_time_us":986957,"wal-append.run_cpu_time_us":3781,"wal-append.run_wall_time_us":1104748}
I20260709 12:14:20.751452 12004 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.863916 12004 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:20.079501 11630 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:20.754271  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.754458  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 548) took 1601 ms. Trace:
I20260709 12:14:20.755146  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:20.755947  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.864792  9071 rpcz_store.cc:276] 0709 12:14:19.153493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.153634 (+   141us) service_pool.cc:224] Handling call
0709 12:14:20.754216 (+1600582us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54003b83d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:20.754391 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742073088}
I20260709 12:14:20.865511  8996 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:20.759976  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:20.866062 11630 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.866369  8992 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.755563  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:20.869681  8998 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:20.812903 11916 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.716318  9069 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:20.454241 11976 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.714226 12007 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:20.762204 12062 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:20.859046 11979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.020s	sys 0.025s
I20260709 12:14:20.764757  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:20.763516 12045 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.027256 11511 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.716540  8925 rpcz_store.cc:276] 0709 12:14:18.737984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.551870 (+813886us) service_pool.cc:224] Handling call
0709 12:14:19.552276 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:19.552722 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.552755 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:19.553355 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:14:19.632682 (+ 79327us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:19.632722 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.632788 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:20.455885 (+823097us) raft_consensus.cc:1685] finished
0709 12:14:20.455904 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.456038 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4854,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"thread_start_us":78859,"threads_started":1,"wal-append.queue_time_us":115111}
I20260709 12:14:20.782828  9616 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:20.812965  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46639.1us
I20260709 12:14:20.907847  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:20.837080 11934 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:19.996922 11968 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.719286 11681 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:20.820731  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 90425.7us
I20260709 12:14:20.891041 12046 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.937923  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:20.723554 11918 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:20.939457 11918 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.940873 11918 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.726473 12019 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:20.825579  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.763464 12077 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:20.543141  8994 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:20.624776 12024 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.598326  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:20.135362 11730 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:20.946744 12064 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:20.950758 12064 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.951099 12064 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:20.951618 11756 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.436s	user 0.008s	sys 0.005s
I20260709 12:14:20.952015 11756 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:20.953794 11968 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.879648 11901 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.954310 11968 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:20.901676 11916 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.955318 11968 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.818552 11704 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:20.812683 12047 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:20.857666  9068 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:20.861114  8920 rpcz_store.cc:276] 0709 12:14:18.737610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.543723 (+806113us) service_pool.cc:224] Handling call
0709 12:14:19.622193 (+ 78470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.626707 (+  4514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.737204 (+1110497us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b540015a250. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:20.737331 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179699584}
W20260709 12:14:20.101807 11974 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.786s	user 0.003s	sys 0.006s
I20260709 12:14:20.609483 12021 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:20.632822 11679 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:20.884100  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:20.879124  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:20.743417 12002 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:20.826881 11919 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.945721 12074 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:20.897404  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 738) took 1762 ms. Trace:
I20260709 12:14:20.981834  9618 rpcz_store.cc:276] 0709 12:14:19.134629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.139549 (+  4920us) service_pool.cc:224] Handling call
0709 12:14:19.149512 (+  9963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.703646 (+554134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.897067 (+1193421us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400771854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:20.897316 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272278784}
I20260709 12:14:20.820775 12008 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:14:20.816828  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 293854us
I20260709 12:14:20.553735 12049 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.828819 12073 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:14:20.957523  8921 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:20.887831 11976 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.878161 11789 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.949959  8997 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.961928  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:20.963562  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:21.012440  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:20.973078  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:20.886425 12062 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:20.976188  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:20.980422  9624 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:20.972429 11679 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:20.986701  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:21.022585  8994 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.960603 11704 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:20.973030 11966 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.005s
I20260709 12:14:21.007568  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:21.007730  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 288566us
I20260709 12:14:20.949555 11456 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:21.028640  9621 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:21.013103  9066 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.990510 12071 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.015508  9065 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.012766  8998 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:14:20.984232  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.029911  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:21.040355  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:21.035945  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 156929us
I20260709 12:14:21.042212  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:20.966713 12007 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:20.975621 12009 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:14:20.949656 12024 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.005963 11907 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.974349 11917 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:14:21.001334 11919 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:20.950214 11730 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.010288 12074 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.975580 12004 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:14:20.975768 11630 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:14:21.029105 11966 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.010s	sys 0.005s
I20260709 12:14:20.949020 12058 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:14:21.026923 11704 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.020713 12062 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:20.979357 12021 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:20.959985 12077 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.034698 11456 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.078799  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 730) took 3154 ms. Trace:
I20260709 12:14:21.075172 12074 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.080758 12045 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.081174 11920 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.081589 12068 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:21.081661 11855 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.118747 12068 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.118888 11855 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.082041 11934 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.082465 12046 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.083562  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.085269 12075 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:21.086171  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.055721 11928 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:21.092507  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 327786us
I20260709 12:14:21.088249  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:21.144846  8917 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.046005 12079 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.099287  8995 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.105057  8994 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:21.105907  8924 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:21.071607 11954 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.109246  9066 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:21.079438 11681 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.110314  9623 rpcz_store.cc:276] 0709 12:14:17.920033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.930331 (+ 10298us) service_pool.cc:224] Handling call
0709 12:14:17.930634 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.930961 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:17.930986 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.946906 (+ 15920us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.174961 (+228055us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:18.175000 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.175065 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:20.063327 (+1888262us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:21.060310 (+996983us) raft_consensus.cc:1685] finished
0709 12:14:21.060341 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.074527 (+ 14186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3893,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2917,"spinlock_wait_cycles":27557120,"thread_start_us":182416,"threads_started":1,"wal-append.queue_time_us":245526}
I20260709 12:14:21.114372 12045 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.114593 11919 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.117892 11920 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.061427 11907 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.120573  8923 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:21.084311  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.058560 12007 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:21.109799 12056 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.114s	user 0.002s	sys 0.002s
I20260709 12:14:21.134387 12089 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.135052  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 542) took 2465 ms. Trace:
W20260709 12:14:21.141196  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 188268us
I20260709 12:14:21.112882 11456 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.053982 12071 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:21.153889  8964 leader_election.cc:336] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.671s (SENT)
I20260709 12:14:21.157913  9073 rpcz_store.cc:276] 0709 12:14:18.670077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.683586 (+ 13509us) service_pool.cc:224] Handling call
0709 12:14:18.684023 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.684478 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:18.803427 (+118949us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.893151 (+2089724us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800396fa0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a
0709 12:14:20.893367 (+   216us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.893965 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.067415 (+173450us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:21.067457 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.067527 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.134775 (+ 67248us) raft_consensus.cc:1685] finished
0709 12:14:21.134873 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.134997 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244026,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":56091,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":195,"spinlock_wait_cycles":3920768,"thread_start_us":352479,"threads_started":3,"wal-append.queue_time_us":372333,"wal-append.run_cpu_time_us":1163,"wal-append.run_wall_time_us":1002226}
I20260709 12:14:21.124094 11934 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.144112 11928 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.165107  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:21.179734  8917 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:21.179874  8918 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:21.180783  8918 pending_rounds.cc:85] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 6
I20260709 12:14:21.181056  8918 pending_rounds.cc:107] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:21.181277  8918 raft_consensus.cc:2889] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:21.180816  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 151009us
I20260709 12:14:21.149550 12079 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:21.025853 12019 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.157266 11917 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:21.188805  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:21.172389 11934 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.172377 12058 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.175622 11928 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.156687 11681 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:21.247052  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58281.4us
I20260709 12:14:21.250905  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:21.156348 11954 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.200610 12091 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:21.188591 12065 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:14:21.205001 11917 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.240526 11653 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:21.185068 12024 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:21.296886  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 149279us
I20260709 12:14:21.299099 12067 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.188910 12079 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.195871 12093 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.247367 11630 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:21.446938 11630 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.254885 12019 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:21.302098 12090 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:14:21.256587 11789 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.298659 12002 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:21.410642  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 159806us
I20260709 12:14:21.337817 12049 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.417861 11730 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.306181 11949 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.185518 12033 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:14:21.305234 11653 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:21.443591  9590 leader_election.cc:336] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.526s (SENT)
I20260709 12:14:21.245070 12058 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.336907 11938 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:21.443056  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 155836us
I20260709 12:14:21.453905  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:21.453403  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 747) took 1104 ms. Trace:
I20260709 12:14:21.455955  9622 rpcz_store.cc:276] 0709 12:14:20.349102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.350137 (+  1035us) service_pool.cc:224] Handling call
0709 12:14:20.455776 (+105639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.038027 (+582251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.038057 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.038103 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:21.038131 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.453040 (+414909us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001301d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:21.453122 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.453322 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338541440}
I20260709 12:14:21.448843  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2686) took 1344 ms. Trace:
I20260709 12:14:21.464382 12080 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.463696 11653 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.465840 12080 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.471958 11682 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.471295 12075 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.472551 11682 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.472690 12075 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.470944 11826 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.471385 12038 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:21.475107 12038 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.474212 11653 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.474615 11826 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.485872 11679 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:21.486694 12087 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:14:21.303386 12091 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.529726 11907 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.487202 12024 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:21.569156 12084 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:14:21.569397 12095 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:14:21.570729 12021 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.571419 12077 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.572144 12038 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.574631 12045 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:21.575433 12092 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:14:21.531813 11679 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.576171  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2525) took 1850 ms. Trace:
I20260709 12:14:21.487948 12067 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:21.578420  8997 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.012s
I20260709 12:14:21.584092  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:21.584668  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2528) took 1116 ms. Trace:
I20260709 12:14:21.585153 11826 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.586177 11917 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.457720  9065 rpcz_store.cc:276] 0709 12:14:20.104648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.106903 (+  2255us) service_pool.cc:224] Handling call
0709 12:14:20.107220 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.038488 (+931268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.448580 (+410092us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54002d4bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:21.448776 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082371328}
I20260709 12:14:21.586781 11682 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:21.579197  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 249279us
I20260709 12:14:21.523746 12029 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:21.576536  8991 rpcz_store.cc:276] 0709 12:14:19.725600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.725715 (+   115us) service_pool.cc:224] Handling call
0709 12:14:19.726049 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:19.728513 (+  2464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.728550 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.729110 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.738741 (+1009631us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18001fe820. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:21.035577 (+296836us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:21.149234 (+113657us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.153810 (+  4576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.153881 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.575842 (+421961us) raft_consensus.cc:1685] finished
0709 12:14:21.575936 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.576105 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24064,"prepare.queue_time_us":165312,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2655,"raft.queue_time_us":42661,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":12347,"spinlock_wait_cycles":6069632,"thread_start_us":389930,"threads_started":2,"wal-append.queue_time_us":1413986}
I20260709 12:14:21.585038  8997 rpcz_store.cc:276] 0709 12:14:20.468586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.543033 (+ 74447us) service_pool.cc:224] Handling call
0709 12:14:21.584611 (+1041578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.531523 12101 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.604036 11907 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.604575 11907 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:21.606369 12023 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.002s
I20260709 12:14:21.606663 11907 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.607936 11907 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.608515 11907 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.609186 11934 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:21.611662  9037 connection.cc:256] RPC call timeout handler was delayed by -1.1414355919998798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:14:21.614138  9037 connection.cc:256] RPC call timeout handler was delayed by -1.0685355919999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:14:21.614396 12071 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.601251 12101 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.616176 12101 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.615067  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:21.617106  9065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:21.617805  9065 raft_consensus.cc:606] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:21.618225  9065 raft_consensus.cc:614] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.452723 11949 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.624065  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:21.593472 12024 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.628930  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.611346 11907 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:21.634672  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.637321  8995 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:14:21.637682  8925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.010s
I20260709 12:14:21.639058  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:21.641490  8925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.010s	sys 0.011s
I20260709 12:14:21.587168 11704 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.606833 12023 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.646880  9074 pending_rounds.cc:85] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 3
W20260709 12:14:21.646675  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 331509us
I20260709 12:14:21.655289  9074 pending_rounds.cc:107] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:21.655738  9074 raft_consensus.cc:2889] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:21.648342  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.653154  9070 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:21.656859  9066 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:21.618997 11920 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.619133 12096 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 12:14:21.647524  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.637054 11712 raft_consensus.cc:2764] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:14:21.664640 12062 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.555s	user 0.019s	sys 0.001s
W20260709 12:14:21.665402 11456 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.010s
I20260709 12:14:21.667704  9068 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:21.639225 12019 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.668774  9073 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:21.627640 12068 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.681550  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.654422 11934 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.655941 11681 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.685653 11949 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.691161  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.692368  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:21.694914  8920 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:21.679201 12058 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.700030  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:21.701524  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.643656 12024 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.673389 12007 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:21.706156  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 117054us
I20260709 12:14:21.706296  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.700810  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:21.708636  9622 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:21.710129  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.711094  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.711870  9622 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:21.715749  8925 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.668916 12089 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:14:21.669212 11907 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:14:21.718924  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.704744 11630 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.739450  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.733873  9066 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:21.735440  9067 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:14:21.740928  9067 pending_rounds.cc:85] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 3
I20260709 12:14:21.741173  9067 pending_rounds.cc:107] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:21.741393  9067 raft_consensus.cc:2889] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:21.741392  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.677073 11456 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.752907  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.677549 12062 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:21.718012 11918 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.021s
W20260709 12:14:21.736720 12074 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:14:21.721905 12019 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.724109 12067 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.762537  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:21.757889 12064 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.806s	user 0.005s	sys 0.006s
I20260709 12:14:21.772002 12064 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.774286  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 782) took 1294 ms. Trace:
I20260709 12:14:21.774688 12064 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.763157  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.730571 11976 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.776075  9624 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.777962  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.778776  9065 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:21.775106  9616 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.779861  9065 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:21.782366 11704 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.774755  9621 rpcz_store.cc:276] 0709 12:14:20.480080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.480209 (+   129us) service_pool.cc:224] Handling call
0709 12:14:21.774081 (+1293872us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540046ee54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:21.774196 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741608192}
I20260709 12:14:21.785904  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.787022 12044 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.787449 12044 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:21.791883  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.792675  8918 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:21.788311 12044 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.795717  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.796591  9616 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:21.796442 12044 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.799844  9621 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:21.800647  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.801383  9619 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:21.802392  9619 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.805613  8918 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.807314  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.809635  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:21.811658  8918 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:21.719488 12080 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.769691 12019 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.731777 11928 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.813230  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.769886 12024 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.818351  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:21.818883  8918 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.819000  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.819727  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:21.820263  8925 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.818985  9624 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:21.825320 12055 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.829s	user 0.004s	sys 0.000s
I20260709 12:14:21.825783  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:21.826505  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 780) took 2179 ms. Trace:
I20260709 12:14:21.822839  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.829033  8917 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:21.826901  9617 rpcz_store.cc:276] 0709 12:14:19.646680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.646778 (+    98us) service_pool.cc:224] Handling call
0709 12:14:19.647126 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:19.721226 (+ 74100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:19.721258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.727045 (+  5787us) log.cc:844] Serialized 26 byte log entry
0709 12:14:19.868342 (+141297us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:19.868403 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.868496 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.824326 (+1955830us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:21.826203 (+  1877us) raft_consensus.cc:1685] finished
0709 12:14:21.826231 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.826438 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89117,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":6867,"spinlock_wait_cycles":2786048,"thread_start_us":177359,"threads_started":2,"wal-append.queue_time_us":254611}
I20260709 12:14:21.770300 12074 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:21.833642  9616 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:21.814685 12019 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.836941 12089 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:21.837863 12089 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.838204 12089 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:21.840785 12074 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.730358 12079 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.852995 11456 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:21.853489 12028 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.826911 12105 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:21.872756 12105 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:21.873204 12105 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:21.873339  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 432245us
I20260709 12:14:21.877692 11954 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:21.858999  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:21.878737  8922 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:21.880537 11928 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.886409 11916 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.826530 11704 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:14:21.891146  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:21.891573 11704 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:21.891992 11704 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:21.892102  8918 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:21.892793 11704 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.893961 11704 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.827046 12024 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:14:21.896075 12024 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:21.896509 12024 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:21.897274 12024 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:21.898466 12024 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.899931 11901 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:21.903152  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:21.903779  8997 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.904917  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:21.905874  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:21.906464  8992 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:21.908084  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.909126  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:21.909183  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:21.912207  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.914008  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:21.914317  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:21.914633  8998 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:21.919278  8997 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:21.921757  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:21.922822  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:21.923491  8993 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.924137  8925 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:21.925472  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:21.920732  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:21.926013  8999 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:21.839084 12089 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:22.056453  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.059187  8923 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.064112  8922 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
W20260709 12:14:21.939738  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.978929  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58250.7us
I20260709 12:14:21.911427 11838 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.949101  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:22.080683  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.915827 12028 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:22.089169  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:22.090962  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:21.866779 12101 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.093097  8999 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:22.094985  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.097030  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.098291  9623 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:22.112768  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.100971 12023 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.101473 12064 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.101655 12008 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:22.104214  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.105465  9071 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:22.108142  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2531) took 1626 ms. Trace:
I20260709 12:14:21.919644 12002 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:22.113523  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:21.916899 11653 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.193s
I20260709 12:14:22.124536  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.085865 12067 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:21.923844 11975 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:22.145797  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:22.146901  8995 rpcz_store.cc:276] 0709 12:14:20.473210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.478278 (+  5068us) service_pool.cc:224] Handling call
0709 12:14:22.099082 (+1620804us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003dcf54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:22.099175 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425999616}
I20260709 12:14:21.925565 12007 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 12:14:22.159150  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.050568 11630 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.203s
I20260709 12:14:22.125705 12029 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.115803 12075 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.126194 12089 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.124742 11704 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:22.148389 11918 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.148193 12002 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.179286  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.144979 12008 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:22.185055 12113 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.362s	user 0.002s	sys 0.001s
I20260709 12:14:22.185367  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.233394  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.234520  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.195463  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.234689 12096 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.235513 12096 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.236271  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.237346  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.237982  9074 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:22.238057 12096 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.238689  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.201050 11630 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.145037 12064 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.211153 12079 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:22.214080  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.154184 11838 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:22.242827  9074 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:22.115896 12019 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.116878 12028 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.241685  9073 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:22.177687 12062 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:22.217720 11916 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:22.229314 12002 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:22.164641 11975 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.262234  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.266439  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.267006  8923 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:22.268512  9617 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:22.242100 11838 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:22.178716 12029 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.270109  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:22.246116 11704 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:22.279199 11704 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.275362 12064 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:22.278141 12101 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.293243  9618 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:22.283253  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.286516  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.295553  8917 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.290149 11907 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:22.305274 11907 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.306552 11907 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.313179  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.317200  8993 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:22.269495 12023 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:14:22.337000 11975 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.262595 11916 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.345788  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:22.287539 12008 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.348901 12093 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 12:14:22.354411 12044 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 12:14:22.357127 12029 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.359189  8819 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 3 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.360258 11732 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:22.361459  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.388193  8917 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:22.393004  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:22.399272  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.350756 11630 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.400761  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.402894  8924 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.409339  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 263613us
I20260709 12:14:22.390292 11681 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.397665 12008 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.366379 11907 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.425242  9074 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:22.444756  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:22.408650 12067 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:22.450147 12067 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.410058 12101 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.451908 12101 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.454862  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.455657 12093 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.456157  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.456480 12093 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.457401  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.458566  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.410127 12096 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:22.459808 12096 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:22.461112 12096 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.441524 12079 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.465890 12079 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.468663 12079 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:22.470969 11918 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.471607 11918 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:22.442502 11681 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.473313 12028 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.442054 12019 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.459142  9074 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:22.479315  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.489126  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 556) took 1527 ms. Trace:
I20260709 12:14:22.489562  9074 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:22.489506  9068 rpcz_store.cc:276] 0709 12:14:20.961485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.961676 (+   191us) service_pool.cc:224] Handling call
0709 12:14:22.488926 (+1527250us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000ab754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:22.489070 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506346240}
I20260709 12:14:22.479712 11681 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:22.465241 11907 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.492036  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.492179  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.492470 12093 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.493060  9621 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:22.494019  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:22.497035  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.487529  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:22.499704  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:22.487535  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.502033  8920 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:22.502315  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.503139  9068 raft_consensus.cc:2376] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5. Re-sending same reply.
I20260709 12:14:22.487923  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:22.488653 12075 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:22.455044 12101 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.487147  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.510046  8922 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:22.350302 12105 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.515004  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.505396  8924 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:22.506942  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:22.521420  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.524535  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:22.485594  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.527288  9072 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.532610  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.533758  8925 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:22.534905  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.535945  8918 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:22.509168 11670 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:22.504941 11653 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.537554  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.540629  9065 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:22.537616  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.504628 12075 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:22.512933 12053 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.494105 12093 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:22.538856  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.549605  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.550659  8925 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:22.531906 12054 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:22.534081 11233 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.521163 12101 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.553457 12002 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.560420  8918 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.540922 11653 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.562652  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.563045 11653 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.563445  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:14:22.566335  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.567348 11756 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:22.559190 11233 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.556692 12102 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.561738  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.546206 12075 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.562969  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.570881  9070 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
W20260709 12:14:22.575053  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.580544  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:22.582909  8918 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.540263 11918 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.588476  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.576803 11233 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.627161  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.578015 12102 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:22.641937  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.648926  9073 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:22.573365 12101 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.645793  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:22.663406 11756 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:22.665325 12102 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.666747 12102 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.672942 12101 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.674099 12105 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:22.676783  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.677423  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:22.672829  9072 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:22.681945  8920 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:22.682909  8922 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:22.683816  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.684546  9073 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:22.686576  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.687448  9072 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.693847  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 345456us
I20260709 12:14:22.695511  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.695914  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:22.696230  8993 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:22.696521  8999 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.698138  8995 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:22.685086 11949 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:22.710765  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:22.710944  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 298300us
I20260709 12:14:22.678189 11653 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.778208  8924 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:22.806748  8994 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:22.810062 11670 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:22.805456  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.811203 12096 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.710462 11630 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:22.781441  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.693534 11918 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.815847  8991 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:22.761484  8999 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:22.816829 11670 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.817965  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:22.775287  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:22.818542  8992 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.813408  8998 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:22.815956 12096 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.749716  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:22.823278  8995 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.828313  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.829883  8991 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:22.720329 11949 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:22.831653  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.718164  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.832917  8993 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:22.835496  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60405.1us
I20260709 12:14:22.835659  8992 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:22.754861  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.836505  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:22.826284 11630 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.790637  9072 raft_consensus.cc:2410] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:22.841563  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.842191  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:22.842396  9072 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:22.843621  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.858103  9072 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:22.861433  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:22.857020  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.866180  8992 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:14:22.845155 11949 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:22.920614  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56005.7us
I20260709 12:14:22.867669  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.922056  9072 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:22.877321  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.910248  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1422) took 3254 ms. Trace:
I20260709 12:14:22.923472  8916 rpcz_store.cc:276] 0709 12:14:19.656144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.751095 (+ 94951us) service_pool.cc:224] Handling call
0709 12:14:19.995085 (+243990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.451900 (+456815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.909997 (+2458097us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540020e9d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:22.910172 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560323456}
I20260709 12:14:22.910985  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:22.925307  8999 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.925544  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.926337  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:22.913599  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:22.927471  9072 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:22.840655 12122 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.929486  9073 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:22.930339  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 565) took 1026 ms. Trace:
I20260709 12:14:22.931658  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:22.934183  8994 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.935999  9072 rpcz_store.cc:276] 0709 12:14:21.904053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.926937 (+1022884us) service_pool.cc:224] Handling call
0709 12:14:22.927286 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.929921 (+  2635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.930165 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:22.938004  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.938660  8997 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:22.938369  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2692) took 1031 ms. Trace:
I20260709 12:14:22.947402  9072 rpcz_store.cc:276] 0709 12:14:21.907106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.937633 (+1030527us) service_pool.cc:224] Handling call
0709 12:14:22.937904 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.938080 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.938105 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:22.938147 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:22.938176 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.938226 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:22.938323 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:22.957657  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:22.958374  8992 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:22.930258 12054 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:22.914191 12053 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:22.961139 12054 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:22.965348 12134 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:22.966763 12130 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:14:22.928529 12096 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:22.937152 12135 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:22.968672 12125 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:14:22.968701  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:22.969892  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.970247  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:22.930922 12124 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:14:22.971078  9073 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:22.986728  8888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.903s (SENT) [suppressed 39 similar messages]
I20260709 12:14:22.986886  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2694) took 1079 ms. Trace:
I20260709 12:14:22.987586  9073 rpcz_store.cc:276] 0709 12:14:21.907665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.937743 (+1030078us) service_pool.cc:224] Handling call
0709 12:14:22.970835 (+ 33092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.986578 (+ 15743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.986818 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:22.976744  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:22.978199  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 409609us
W20260709 12:14:22.975374  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.991716  8995 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:22.985427  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:22.983815  8999 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
W20260709 12:14:22.993187  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.961341 12053 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.002874  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.005460  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.996500  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.007741  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.008250  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:23.009678  8999 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:23.009908  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:22.994187  8994 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:23.011968  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.012805  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.013247  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.014348  8999 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.015081  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.017159  8920 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.015878  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.015846  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.017122  9073 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:23.018857  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.019340  9073 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.019946  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.020750  9073 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:23.020946  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.021924  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.022899  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.023945  9623 raft_consensus.cc:2410] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:14:23.024041  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.027279  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.028012  8920 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:23.028570  8925 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:22.977952  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.029064  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.039819  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.011634 12067 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:23.065173  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.069242  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56386.8us
I20260709 12:14:23.024814 12123 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.023787 11976 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.074167  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:23.030344 12008 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 12:14:23.023542 12039 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.031409 12046 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:23.015889 11756 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:14:23.092962  8993 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:23.092104  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 249971us
I20260709 12:14:23.113260  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.113888  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.114171  8917 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:23.115921  8995 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:14:23.108249  9615 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:23.084513 11976 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.077987 12123 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.106582 12046 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:23.150327  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 76634.2us
I20260709 12:14:23.140220  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.141309  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.124073 12160 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:23.164742  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 53603.2us
I20260709 12:14:23.092461 12039 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:23.171211  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.188633  8997 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:23.138881  8995 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:23.110168 12143 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.152563 11976 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.198659  8995 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.202854  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.163959 12123 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.140832 12067 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:23.190310  8994 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:23.165782 12046 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:23.121560 12140 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:14:23.211495 11681 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.190241 12039 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.222755  8997 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:23.220034  8992 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:23.220934  8994 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:23.227049 12137 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:14:23.227190 12129 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:14:23.230604  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 752) took 1131 ms. Trace:
I20260709 12:14:23.231006  9619 rpcz_store.cc:276] 0709 12:14:22.098834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.098959 (+   125us) service_pool.cc:224] Handling call
0709 12:14:22.099308 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.099656 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.099686 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:22.339073 (+239387us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2c000125b8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:14:22.339489 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:14:22.577957 (+238468us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:22.578570 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.578661 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.230295 (+651634us) raft_consensus.cc:1685] finished
0709 12:14:23.230319 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.230539 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":26543488,"thread_start_us":238099,"threads_started":1,"wal-append.queue_time_us":735740}
W20260709 12:14:23.232203 12141 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:14:23.233585 12146 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:14:23.234136 12164 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:23.234696 12164 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:23.235952  9619 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:23.207652 12143 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.216694 12008 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:23.209021 12145 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.243738  8997 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.238377  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.219164 11653 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.262894  9073 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:23.256294  8995 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:23.249536  8994 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:14:23.244403 12143 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.235587 12164 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:23.262702 12102 consensus_meta.cc:287] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.006s
W20260709 12:14:23.265859 11233 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.003s
W20260709 12:14:23.278051 12159 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:23.246171 12008 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.302848  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:23.304831 12008 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.305125  8995 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:23.306017  9073 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:14:23.314289  9073 pending_rounds.cc:85] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:23.314668  9073 pending_rounds.cc:107] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:23.315011  9073 raft_consensus.cc:2889] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:23.324007  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 284289us
I20260709 12:14:23.326385  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1421) took 3674 ms. Trace:
I20260709 12:14:23.328629  8995 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:23.329049  8921 rpcz_store.cc:276] 0709 12:14:19.651762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.683190 (+ 31428us) service_pool.cc:224] Handling call
0709 12:14:19.683497 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.001658 (+1318161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.326130 (+2324472us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400018454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.326320 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929435008}
I20260709 12:14:23.332293  9073 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:23.333266  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:23.337150  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 149247us
I20260709 12:14:23.304222 11233 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.338958  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.340327  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.340844  8991 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:23.342649  9073 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:23.282933 12067 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:23.351019 12152 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:14:23.352394 12151 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:14:23.352672 12139 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:23.357566  8923 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:23.359045 11233 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.336316 11838 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.360944 11838 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.363559  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.365379 12039 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.368091  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:23.369071  9070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2702) took 1311 ms (client timeout 1675 ms). Trace:
W20260709 12:14:23.360383 12155 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:23.372114  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:23.380173  9070 rpcz_store.cc:269] 0709 12:14:22.057732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.158803 (+101071us) service_pool.cc:224] Handling call
0709 12:14:23.368895 (+1210092us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540026cad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.369015 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906425728}
I20260709 12:14:23.383404  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:23.383980  9070 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:23.372996  8964 connection.cc:256] RPC call timeout handler was delayed by -1.4041027780001514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3138s for a response
I20260709 12:14:23.334771 12160 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:23.374110  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.379757  8996 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:23.378296 12172 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:23.385643  8964 connection.cc:256] RPC call timeout handler was delayed by -1.3632894780002971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
I20260709 12:14:23.389674  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.397611  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 562) took 1539 ms. Trace:
I20260709 12:14:23.397959  9065 rpcz_store.cc:276] 0709 12:14:21.857899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.858021 (+   122us) service_pool.cc:224] Handling call
0709 12:14:21.858321 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.541100 (+682779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.397395 (+856295us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54003f02d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.397559 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568628608}
I20260709 12:14:23.391968 12166 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:23.396759 12172 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:23.400651 12166 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:23.401199 12166 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.401583 12172 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.396950 11233 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.379020 12170 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.408569 12166 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.410609 12166 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.414047 12039 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.415066 12039 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:23.387336 12075 consensus_meta.cc:287] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.777s	user 0.013s	sys 0.000s
I20260709 12:14:23.416343  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.423662 12075 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.425294  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 758) took 1296 ms. Trace:
I20260709 12:14:23.426378 12075 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.425724  9620 rpcz_store.cc:276] 0709 12:14:22.138319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.323968 (+185649us) service_pool.cc:224] Handling call
0709 12:14:22.337151 (+ 13183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:22.387352 (+ 50201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:22.693475 (+306123us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.067429 (+373954us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.110620 (+ 43191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.110695 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:23.110746 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.425084 (+314338us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54005ae954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.425126 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.425239 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4219,"prepare.queue_time_us":417869,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":298299,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":28136,"spinlock_wait_cycles":116906624,"thread_start_us":715415,"threads_started":4,"wal-append.queue_time_us":526819}
I20260709 12:14:23.429586  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:23.416427  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.435278  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:23.446224  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.452728  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.454006  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:23.462064  9070 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:23.470031  9069 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:23.470491  9069 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:23.478222  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.479434  9620 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:23.471450  9069 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.480547  9069 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:23.486816  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:23.487906  9070 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:23.490669  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2200) took 1861 ms. Trace:
I20260709 12:14:23.494139  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.494839  9624 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.491200  9067 rpcz_store.cc:276] 0709 12:14:21.629255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.629372 (+   117us) service_pool.cc:224] Handling call
0709 12:14:21.629762 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.741950 (+112188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.490437 (+1748487us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540026dc54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.490608 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233913088}
W20260709 12:14:23.498694  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.499511  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.449441 11976 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.500620  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.502420  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:23.504273  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.506319  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:23.495889 12164 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.510569  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64324fda988042f2a6200271577d02a9"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:23.519129  9067 raft_consensus.cc:606] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:23.519538  9067 raft_consensus.cc:614] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:23.511801  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:23.513827  9069 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:23.516239  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.520334  9069 pending_rounds.cc:85] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 5
I20260709 12:14:23.517343  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:23.520736  9069 pending_rounds.cc:107] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:23.521193  9069 raft_consensus.cc:2889] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:23.532557 11704 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:23.532773  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:23.533792  9067 raft_consensus.cc:2376] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
I20260709 12:14:23.523955  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.539783 12089 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:23.540241 12089 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:23.541023 12089 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.542130  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 576) took 2533 ms. Trace:
I20260709 12:14:23.542829  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.545095 12091 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:23.551119  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.506157 12102 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.508025 12181 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.576061  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 52180.9us
W20260709 12:14:23.553797  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.542510  9000 rpcz_store.cc:276] 0709 12:14:21.008358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.008624 (+   266us) service_pool.cc:224] Handling call
0709 12:14:21.008961 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.188615 (+179654us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:22.580189 (+1391574us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b180023fe60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf
0709 12:14:22.580387 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 12:14:22.837097 (+256710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:22.837159 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:22.837219 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.541913 (+704694us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400196c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.541967 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.542077 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50421,"prepare.queue_time_us":110193,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":88465,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":34108,"spinlock_wait_cycles":415603712,"thread_start_us":353434,"threads_started":2,"wal-append.queue_time_us":462624}
I20260709 12:14:23.518221 11954 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.581921  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.518234 12171 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.604667  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:23.604916 11233 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:23.557894  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.524931 12162 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.607909  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:23.593609  9615 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:23.612598  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.579835 12070 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:23.593207 12058 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:23.615537  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.600921 12170 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:23.618942  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.619891  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:23.616014 11982 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.523609 12164 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.633839 11858 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.640118 11976 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.640985  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.642305  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.611933 12123 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.645684 12123 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.646495  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.646713  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.647091  8993 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.647879  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.648442  8994 raft_consensus.cc:2376] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8. Re-sending same reply.
I20260709 12:14:23.648810  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.649452  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.606747 12030 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.614080 12162 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.510315 12160 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.618420 12145 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:23.664309  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.698510  8998 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:23.699373  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.611927 11855 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.651207  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:23.653002  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.701660  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:23.672122  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52307.5us
I20260709 12:14:23.673216  8993 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:23.703876  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.704504  8993 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:23.635069 12164 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.620980 12075 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.684998  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.595763 12102 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.602901 12181 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.620276 11914 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.737250  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2727) took 1173 ms. Trace:
I20260709 12:14:23.705389  8998 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:23.699534  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:23.678040  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54434.6us
I20260709 12:14:23.684340 11976 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:23.711529  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.715842  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.716732  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:23.876463  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.876967  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.876734  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 161015us
I20260709 12:14:23.720013  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:23.879719  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 159774us
I20260709 12:14:23.880872  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:23.721011  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.881565  8993 raft_consensus.cc:2376] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
I20260709 12:14:23.882443  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.883200  8993 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:23.884162  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.702015  9000 raft_consensus.cc:2376] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4. Re-sending same reply.
I20260709 12:14:23.885493  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.886019  9000 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.728032  8995 raft_consensus.cc:2376] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
I20260709 12:14:23.651338 11982 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:23.651420 11916 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.728767  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.737078  8916 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:23.607544 11954 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.651890 12170 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:23.738391  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.710325  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:23.738888  9073 rpcz_store.cc:276] 0709 12:14:22.564317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.343303 (+778986us) service_pool.cc:224] Handling call
0709 12:14:23.343909 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.344359 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:23.605817 (+261458us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.735956 (+130139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.736019 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:23.736998 (+   979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.737066 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.737192 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":277060,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":93,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":19080,"thread_start_us":318660,"threads_started":2}
I20260709 12:14:23.894415  8921 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.894482  8995 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:23.740406  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.741398  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:23.895576  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 155235us
I20260709 12:14:23.896307  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:23.743887  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44428.3us
I20260709 12:14:23.898115  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:23.778981  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.630832 11681 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:14:23.650660 11653 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:14:23.721030 12030 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.778492 12046 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260709 12:14:23.741158 11918 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.697206 11670 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:14:23.796650 11855 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:23.805047 12178 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:14:23.800894 12096 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.812634 12181 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.940739 11918 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.947225 12121 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:23.947440 11918 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.813251  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:23.947765 12121 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:23.948246  8997 raft_consensus.cc:2376] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
I20260709 12:14:23.948767 12121 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.949577  8997 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:23.949894 12121 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.890384 11928 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:14:23.815603 12143 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.004s
I20260709 12:14:23.939328 12093 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:14:23.939460 12046 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.952467 12143 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.953037 12089 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.815487  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:23.954335 12046 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.818724 12102 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.777631 12183 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:14:23.795365 12147 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:14:23.826236 12162 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.958413 12096 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.827373 12053 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:23.741093  8918 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:23.935899 12030 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.969623 12096 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.970017  8918 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:23.970829 12030 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.829468  9066 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:23.973259  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2207) took 2340 ms. Trace:
I20260709 12:14:23.973599 11954 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:23.974030  8917 raft_consensus.cc:2410] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:23.830250  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:23.975803  9071 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:23.976631 11456 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.931068 12079 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:23.954350 12143 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:23.978847  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 788) took 1565 ms. Trace:
I20260709 12:14:23.838645 11233 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:23.839293 11914 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:23.847594  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 453) took 1329 ms. Trace:
W20260709 12:14:23.849901  8964 leader_election.cc:336] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.575s (SENT)
W20260709 12:14:23.997553  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 147681us
I20260709 12:14:23.997186  8922 rpcz_store.cc:276] 0709 12:14:22.518052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.541334 (+ 23282us) service_pool.cc:224] Handling call
0709 12:14:22.682586 (+141252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.683326 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.847362 (+1164036us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400018e50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.847514 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298773248}
I20260709 12:14:23.850683 12007 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.857214 12002 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:23.857366 12171 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.861123 12145 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:23.864387 12117 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 2.041s	user 0.007s	sys 0.000s
I20260709 12:14:23.865515  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 497) took 2068 ms. Trace:
I20260709 12:14:23.866214  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:24.016340  8999 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:24.018074  8999 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:23.867981  9617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 750) took 1771 ms (client timeout 1992 ms). Trace:
I20260709 12:14:23.863152  8819 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 2 to 6, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 6 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.872187  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:24.019086  9617 rpcz_store.cc:269] 0709 12:14:22.096659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.096778 (+   119us) service_pool.cc:224] Handling call
0709 12:14:23.867812 (+1771034us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54006bdfd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.867921 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358414592}
I20260709 12:14:24.019934  8991 raft_consensus.cc:2376] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
W20260709 12:14:23.872558  8823 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 318) took 27870 ms (client timeout 15000 ms). Trace:
W20260709 12:14:23.873764  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 419863us
I20260709 12:14:23.716845  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:23.884349  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:23.887653  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:23.889317  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:24.022421  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 133198us
I20260709 12:14:24.022560  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:24.024713  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 140474us
I20260709 12:14:23.892505  8993 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:23.900130  9620 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:23.894379  8998 raft_consensus.cc:2376] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
I20260709 12:14:24.015913  9616 rpcz_store.cc:276] 0709 12:14:21.797467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.804622 (+  7155us) service_pool.cc:224] Handling call
0709 12:14:21.814185 (+  9563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.835140 (+ 20955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.865276 (+2030136us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54004ced54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.865456 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44286208}
I20260709 12:14:23.931650  9073 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:24.027889  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:24.028309  9073 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
W20260709 12:14:23.925625  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.890484 12166 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:23.890570 11982 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.985673 11928 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:23.938830  8996 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:23.907964 12070 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:23.890666 11968 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.893671 12067 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.940387 11838 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:23.945003 12189 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:23.814493 12008 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.956521 12170 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:23.908370 12140 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:23.835986  9074 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:23.982758  9618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 756) took 1882 ms (client timeout 1872 ms). Trace:
I20260709 12:14:23.983498  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 456) took 1439 ms. Trace:
I20260709 12:14:23.984090  8920 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:24.054613  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:24.055354  8995 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:14:24.054433  9618 rpcz_store.cc:269] 0709 12:14:22.100310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.103954 (+  3644us) service_pool.cc:224] Handling call
0709 12:14:23.982562 (+1878608us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400479854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.982689 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336639232}
I20260709 12:14:24.057230  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:24.056988  8924 rpcz_store.cc:276] 0709 12:14:22.544441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.549101 (+  4660us) service_pool.cc:224] Handling call
0709 12:14:23.983308 (+1434207us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400313154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.983442 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463360384}
W20260709 12:14:23.944325  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 425178us
I20260709 12:14:23.992177  8921 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:23.973610  9066 rpcz_store.cc:276] 0709 12:14:21.632488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.741160 (+108672us) service_pool.cc:224] Handling call
0709 12:14:23.973074 (+2231914us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400369554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:23.973201 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4795294592}
I20260709 12:14:24.006978  8925 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:23.941004 12058 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:24.014847  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:24.063525  9068 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.063830  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:24.029745  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.025004  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:24.031064  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:24.025389  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 147868us
I20260709 12:14:24.068338  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:24.025945  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 786) took 1617 ms. Trace:
I20260709 12:14:23.937664  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:24.037079  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:24.069329  9623 rpcz_store.cc:276] 0709 12:14:22.408131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.153543 (+745412us) service_pool.cc:224] Handling call
0709 12:14:23.869972 (+716429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.870203 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.870236 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.870283 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:23.870318 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.870394 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.025791 (+155397us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54006bdfd0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:24.025891 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547145600}
I20260709 12:14:24.038811  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:24.033978 11855 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:14:24.040195  8997 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:24.043018  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:23.995618 12192 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.987937  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:24.177049  9069 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:24.031143 12102 raft_consensus.cc:2764] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:23.977175 11456 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.071450  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:24.167009 11858 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:14:24.030679 12183 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:24.039741  8993 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:24.180748  9072 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:24.072868  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 135286us
I20260709 12:14:24.180888 11858 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:24.073798  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:24.132412  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61735.9us
I20260709 12:14:24.181491 11858 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:24.181914  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 108189us
I20260709 12:14:24.182145  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:24.181638  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:24.183005  8993 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.182425 11858 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.047838 11838 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.184470 11858 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.184682 11838 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.042482 11928 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:24.182385  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:24.187845  8996 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:24.187549 11928 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.188807  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:24.132517  8819 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 3 to 4, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 4 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:24.046765 11732 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.047374 12166 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:24.147586  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:24.133561  8991 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:24.041366 12160 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.034636 12181 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.034425 12172 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
W20260709 12:14:24.132683 12157 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:24.284694 11928 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.025905 12007 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.167436  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:24.289824 12096 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.154170  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:24.193005  9068 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:24.145467 12195 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.254s
I20260709 12:14:24.195714  9069 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:24.136307 12145 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:24.229197  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:24.020732  8823 rpcz_store.cc:269] 0709 12:13:56.015527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.042995 (+ 27468us) service_pool.cc:224] Handling call
0709 12:14:23.872172 (+27829177us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:12.709070 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:12.815733 (+106663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:12.815780 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:14:12.815798 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:12.817049 (+  1251us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:12.817146 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:12.817173 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:14:12.818449 (+  1276us) tablet.cc:701] Row locks acquired
0709 12:14:12.818494 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:14:12.818672 (+   178us) write_op.cc:270] Start()
0709 12:14:12.818815 (+   143us) write_op.cc:276] Timestamp: P: 1783599252818599 usec, L: 0
0709 12:14:12.818837 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:12.929595 (+110758us) log.cc:844] Serialized 5467 byte log entry
0709 12:14:13.599099 (+669504us) op_driver.cc:464] REPLICATION: finished
0709 12:14:13.887517 (+288418us) write_op.cc:301] APPLY: starting
0709 12:14:13.892511 (+  4994us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:13.892824 (+   313us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:13.892953 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:13.914877 (+ 21924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:13.915369 (+   492us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:14:13.915448 (+    79us) write_op.cc:312] APPLY: finished
0709 12:14:13.916044 (+   596us) log.cc:844] Serialized 101 byte log entry
0709 12:14:13.916307 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.916537 (+   230us) write_op.cc:454] Released schema lock
0709 12:14:13.916632 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:13.917228 (+   596us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.917271 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9339,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":248267,"apply.run_cpu_time_us":5551,"apply.run_wall_time_us":35051,"num_ops":14,"prepare.queue_time_us":616881,"prepare.run_cpu_time_us":18974,"prepare.run_wall_time_us":369603,"raft.queue_time_us":338831,"raft.run_cpu_time_us":69907,"raft.run_wall_time_us":287822,"replication_time_us":739686,"thread_start_us":534437,"threads_started":4,"wal-append.queue_time_us":216416,"wal-append.run_cpu_time_us":35558,"wal-append.run_wall_time_us":1817384}]]}
I20260709 12:14:24.228560  8819 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 3 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:24.230804  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49259.2us
I20260709 12:14:23.996711  9615 rpcz_store.cc:276] 0709 12:14:22.413372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.214691 (+801319us) service_pool.cc:224] Handling call
0709 12:14:23.215064 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.618258 (+403194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.978596 (+360338us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400770e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:23.978782 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711362816}
I20260709 12:14:24.145145 12202 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.285777  8993 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:24.044759 12167 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:14:24.287952  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:24.053390 11919 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 12:14:24.075824 12093 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:14:24.132437 11653 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.134274 12073 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 12:14:24.196372 12182 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.132409 11954 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 12:14:24.302287  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 490) took 2566 ms. Trace:
I20260709 12:14:24.155891 12198 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:24.220155 12140 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:24.331388  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:24.183444 12102 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:24.343750  8997 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:24.165238  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:24.344226  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 161116us
I20260709 12:14:24.292339 12030 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.350835  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:24.402372  9068 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:14:24.135623  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 110672us
I20260709 12:14:24.350901  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:24.351332  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:24.351485  8996 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:24.405640  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54819.3us
I20260709 12:14:24.197288 11976 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 12:14:24.356791  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:24.407828  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:24.358825  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 369418us
I20260709 12:14:24.361833  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:24.335109 12181 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.411926 12181 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.366109  8999 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:24.282853 11732 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.221225 12192 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:24.362908 12145 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.417073 12145 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.389820 12172 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:24.390749 12008 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:24.382560  9622 rpcz_store.cc:276] 0709 12:14:21.735770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.758973 (+ 23203us) service_pool.cc:224] Handling call
0709 12:14:21.759333 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.759837 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.759879 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.760449 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.815607 (+ 55158us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:21.815635 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.815680 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.863788 (+2048108us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:24.231548 (+367760us) raft_consensus.cc:1685] finished
0709 12:14:24.231567 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.302179 (+ 70612us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2551,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2721,"spinlock_wait_cycles":14102272,"thread_start_us":16345,"threads_started":1,"wal-append.queue_time_us":56078}
W20260709 12:14:24.426337  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64580.2us
I20260709 12:14:24.367581 12171 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:24.377496 12202 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:24.428185 12046 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:24.382843 12182 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:24.350705 12058 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.423693 12096 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:24.447700 12199 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:14:24.509768  9068 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:24.427053 12172 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:24.428457 11233 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:24.448244 12070 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.399688 11914 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:24.447153 12008 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.815001  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.521293 12204 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:14:24.489472 12039 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.489283 12208 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.768095 12193 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.311s	user 0.000s	sys 0.000s
I20260709 12:14:24.503621 12182 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.448671 12030 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:24.383984 12166 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:24.522863 12096 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:24.984179  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2142) took 1898 ms. Trace:
I20260709 12:14:24.511053 12046 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:24.772297 11630 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.973946  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 563929us
I20260709 12:14:24.973404  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:24.974099  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 568519us
I20260709 12:14:25.017406  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:14:24.967713 12205 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.593s	user 0.000s	sys 0.001s
W20260709 12:14:24.988058  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.896220 11233 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:24.974345  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 792215us
I20260709 12:14:25.026623  8998 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:25.028214  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.029076  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:24.952646  8919 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.000s
W20260709 12:14:25.000790  9074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.021s	sys 0.021s
W20260709 12:14:25.030884  9074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.022s	sys 0.021s
I20260709 12:14:25.031566  8919 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
W20260709 12:14:25.000998  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 669638us
I20260709 12:14:25.032436  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:25.005649  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.003s	sys 0.002s
I20260709 12:14:25.007786  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:24.966534 12210 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:14:25.033202  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.004s	sys 0.002s
W20260709 12:14:25.033529  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 994951us
I20260709 12:14:24.985116  8920 rpcz_store.cc:276] 0709 12:14:23.086918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.087136 (+   218us) service_pool.cc:224] Handling call
0709 12:14:23.983872 (+896736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.054918 (+ 71046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.983876 (+928958us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400313150. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:24.984099 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061193472}
I20260709 12:14:25.030306  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:25.083118  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 50772.2us
I20260709 12:14:25.086608  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.044804  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2736) took 1078 ms. Trace:
I20260709 12:14:25.042068 12183 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.088692 12192 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.089362 11976 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.090090  8996 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:25.089948 11976 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.091768 12212 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:25.092176 11838 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.907s	user 0.008s	sys 0.000s
I20260709 12:14:25.092294 11976 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.092633 11838 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.087713  9067 rpcz_store.cc:276] 0709 12:14:23.966216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.966371 (+   155us) service_pool.cc:224] Handling call
0709 12:14:23.968703 (+  2332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.974307 (+  5604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.974336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.974817 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.073728 (+ 98911us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:24.073788 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.073896 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.044608 (+970712us) raft_consensus.cc:1685] finished
0709 12:14:25.044628 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.044746 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5234,"raft.queue_time_us":6424,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":98510,"threads_started":1,"wal-append.queue_time_us":375432}
I20260709 12:14:25.094717 11838 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.095431  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.095567 11914 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:25.096067  9067 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:25.096454 11914 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:25.082818 11919 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.097361 11919 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:25.097756 11919 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.029534 12188 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.098834 12046 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.099335 12188 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.100625 12214 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:25.101148 12214 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:25.101385 12188 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:25.101987 12188 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:25.102435 12188 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:25.102036 12214 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:25.104054  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 72819.3us
I20260709 12:14:25.124457 12227 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.122727 12225 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:25.123507 11838 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:14:25.042407 12191 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.742s	user 0.000s	sys 0.001s
I20260709 12:14:24.947886 12039 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:25.122153 12121 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.172s	user 0.010s	sys 0.000s
I20260709 12:14:25.117002  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2742) took 1111 ms. Trace:
W20260709 12:14:25.017904 12203 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.730s	user 0.001s	sys 0.001s
I20260709 12:14:25.137934  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2737) took 1161 ms. Trace:
I20260709 12:14:25.164651  9071 rpcz_store.cc:276] 0709 12:14:23.976676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.986534 (+  9858us) service_pool.cc:224] Handling call
0709 12:14:24.024923 (+ 38389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.026455 (+  1532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.026487 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.040740 (+ 14253us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.230617 (+189877us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:24.340938 (+110321us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.341169 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.341258 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.137721 (+796463us) raft_consensus.cc:1685] finished
0709 12:14:25.137742 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.137878 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15212,"prepare.queue_time_us":106157,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":37180,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":19581,"thread_start_us":94991,"threads_started":1,"wal-append.queue_time_us":378206}
I20260709 12:14:25.136713  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2744) took 1131 ms. Trace:
I20260709 12:14:25.036285 12202 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.108502 12096 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.126699 12213 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:25.092360 12212 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.118536 12030 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.143079  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.178268  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.139820  8889 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:25.179109  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:24.901520 12008 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.147091  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 577) took 1087 ms. Trace:
I20260709 12:14:25.021520 11732 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.098043 11914 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:14:25.138170 11928 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.001s
W20260709 12:14:25.131160 12089 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.178s	user 0.008s	sys 0.000s
W20260709 12:14:25.137601 11858 consensus_meta.cc:287] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.952s	user 0.005s	sys 0.004s
W20260709 12:14:25.134619 12145 consensus_meta.cc:287] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.717s	user 0.002s	sys 0.005s
I20260709 12:14:25.166558  9074 rpcz_store.cc:276] 0709 12:14:24.005609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.360181 (+354572us) service_pool.cc:224] Handling call
0709 12:14:24.376026 (+ 15845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.378044 (+  2018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.378073 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.378505 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.031251 (+652746us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:25.031289 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.031356 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.136491 (+105135us) raft_consensus.cc:1685] finished
0709 12:14:25.136518 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.136655 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1660,"raft.queue_time_us":72202,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":36351,"thread_start_us":652437,"threads_started":1,"wal-append.queue_time_us":756326}
I20260709 12:14:25.193078  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.193877  9074 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:25.084167 12091 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.164466  9073 rpcz_store.cc:276] 0709 12:14:24.005135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.028843 (+ 23708us) service_pool.cc:224] Handling call
0709 12:14:24.029113 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.029431 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.029457 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.041036 (+ 11579us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.385145 (+344109us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:24.392866 (+  7721us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.426373 (+ 33507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.426469 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.116791 (+690322us) raft_consensus.cc:1685] finished
0709 12:14:25.116811 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.116944 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33090,"prepare.queue_time_us":7321,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":465210,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":44153,"spinlock_wait_cycles":16130432,"thread_start_us":251894,"threads_started":1,"wal-append.queue_time_us":1033872}
I20260709 12:14:25.089412 12192 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.172640  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2745) took 1159 ms. Trace:
I20260709 12:14:25.212862  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.116317 12007 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:25.179610  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 74338.3us
I20260709 12:14:25.214232  9067 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:14:25.160740 12225 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:25.172133 12199 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:25.183737  9068 rpcz_store.cc:276] 0709 12:14:24.059592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.542007 (+482415us) service_pool.cc:224] Handling call
0709 12:14:24.767499 (+225492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.768003 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:24.984253 (+216250us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.146760 (+162507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.146813 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:25.146854 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.146917 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.147035 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2384,"prepare.queue_time_us":216043,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4622,"raft.queue_time_us":104,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":15643,"thread_start_us":157051,"threads_started":1}
I20260709 12:14:25.131628 11919 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.223676  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:25.174935 12121 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.187348 11704 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.966600 12172 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.021404 11630 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.237821  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.242343 11630 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.242686 11456 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.243202  9000 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:25.195087  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.211151  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.171504 12154 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:14:25.162139 11838 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.018224 12140 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.214697  9067 pending_rounds.cc:85] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 8
I20260709 12:14:25.180419 12211 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.143404 12188 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.258174 12188 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.260735 12182 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.262230  9616 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:25.222198 12225 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.188283 12227 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:25.213125  9069 rpcz_store.cc:276] 0709 12:14:24.012993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.407358 (+394365us) service_pool.cc:224] Handling call
0709 12:14:24.407805 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.408090 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.408127 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.408656 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.408879 (+   223us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:24.408927 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.409152 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.172378 (+763226us) raft_consensus.cc:1685] finished
0709 12:14:25.172394 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.172565 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.189548 12219 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:25.191064 11233 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.237592 11858 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.222435  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:25.185482 11982 consensus_meta.cc:287] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.151s	user 0.007s	sys 0.002s
I20260709 12:14:25.191054 11732 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.210410 12145 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.185561  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1278) took 1973 ms. Trace:
I20260709 12:14:25.247314  9074 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:25.253239  9067 pending_rounds.cc:107] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:14:25.257009  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.270354  9068 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:25.264210 12219 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.271211 11732 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.288539 12219 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.289165 12008 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.290316 11732 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.290710 11919 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:25.269059 12172 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.263487 12224 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:14:25.273820  8992 rpcz_store.cc:276] 0709 12:14:23.212526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.238083 (+ 25557us) service_pool.cc:224] Handling call
0709 12:14:23.254374 (+ 16291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.721407 (+467033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.721436 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.743177 (+ 21741us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.936174 (+192997us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:23.936212 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.025029 (+ 88817us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400290254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:24.025081 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.185226 (+1160145us) raft_consensus.cc:1685] finished
0709 12:14:25.185252 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.185495 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576,"raft.queue_time_us":30294,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7723,"spinlock_wait_cycles":1016799488,"thread_start_us":74393,"threads_started":1,"wal-append.queue_time_us":187958}
I20260709 12:14:25.263661 12227 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.296790 12227 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:25.265625 12181 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.003s
I20260709 12:14:25.297207 12219 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.297552 12181 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:25.299616  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 265157us
I20260709 12:14:25.300472  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.301365  9068 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:25.302228  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.270887 11838 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.222009 12192 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.275326  9067 raft_consensus.cc:2889] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:25.274878  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2560) took 1627 ms. Trace:
I20260709 12:14:25.266686  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2740) took 1270 ms. Trace:
I20260709 12:14:25.274974  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.310989  9074 raft_consensus.cc:2368] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:25.312211  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.313195  9074 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:25.314755  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.315865  9068 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:25.321018  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.322862  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.306732  8994 rpcz_store.cc:276] 0709 12:14:23.646940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.649016 (+  2076us) service_pool.cc:224] Handling call
0709 12:14:23.649313 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:23.649683 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.649735 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:23.674870 (+ 25135us) log.cc:844] Serialized 52 byte log entry
0709 12:14:23.890110 (+215240us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:23.932617 (+ 42507us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.009468 (+ 76851us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b180031b040. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:24.009767 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.009876 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.147536 (+1137660us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:25.274597 (+127061us) raft_consensus.cc:1685] finished
0709 12:14:25.274630 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.274801 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25383,"prepare.queue_time_us":45577,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1555,"raft.queue_time_us":102296,"raft.run_cpu_time_us":15376,"raft.run_wall_time_us":1490409,"spinlock_wait_cycles":39206400,"thread_start_us":193977,"threads_started":1,"wal-append.queue_time_us":331573}
I20260709 12:14:25.308172  9070 rpcz_store.cc:276] 0709 12:14:23.996067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.996210 (+   143us) service_pool.cc:224] Handling call
0709 12:14:23.996511 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.012131 (+ 15620us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:24.049369 (+ 37238us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.768505 (+719136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.815722 (+ 47217us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.815876 (+   154us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:24.815908 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.815972 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.266455 (+450483us) raft_consensus.cc:1685] finished
0709 12:14:25.266476 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.266628 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61548,"prepare.queue_time_us":38484,"prepare.run_cpu_time_us":8641,"prepare.run_wall_time_us":121418,"raft.queue_time_us":492642,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":33076,"thread_start_us":340962,"threads_started":1,"wal-append.queue_time_us":1023194}
I20260709 12:14:25.333626  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.334604  9070 raft_consensus.cc:2368] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:25.340770  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.342471  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.345970  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.347466  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.348397  9070 raft_consensus.cc:2368] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9.
I20260709 12:14:25.349366  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.350221  9070 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:25.343307  9074 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:25.264546 12067 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.215s	user 0.008s	sys 0.001s
W20260709 12:14:25.351940  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 266364us
I20260709 12:14:25.351295  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.357923  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.328756  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:25.358376  8964 connection.cc:256] RPC call timeout handler was delayed by -1.2909292730000743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3189s for a response
I20260709 12:14:25.360426  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.267441 12212 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:25.263191 12182 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.364389  9070 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:25.270617 11982 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.414084  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.414435  9074 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:25.345456 12089 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:25.465454  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 492098us
I20260709 12:14:25.496100  9068 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:25.345239 11914 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:25.422021  8923 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:25.415140  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.499955  8924 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:25.424810  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 394541us
W20260709 12:14:25.492558  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 405982us
I20260709 12:14:25.505010  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.493736  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2747) took 1066 ms. Trace:
I20260709 12:14:25.506301  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:25.497078  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 83107.8us
I20260709 12:14:25.508630  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:25.424304 12102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.000s	sys 0.043s
I20260709 12:14:25.506618  9070 rpcz_store.cc:276] 0709 12:14:24.427265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.363582 (+936317us) service_pool.cc:224] Handling call
0709 12:14:25.363949 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.493296 (+129347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.493666 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.498275  9074 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:25.422199  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.493677 12089 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.516808  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:25.517030  8921 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:25.460573 11653 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.076s	user 0.008s	sys 0.002s
I20260709 12:14:25.348276 11838 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.355468 12008 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.541337 12008 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.365221 12067 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.504709 12214 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:25.347669 12224 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 12:14:25.356470 12219 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:25.490494 12070 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:25.476378 12170 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:25.539855  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.549381  9070 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:25.517414 12102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.001s	sys 0.053s
I20260709 12:14:25.542917  9074 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:25.428929 12145 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:25.514966  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 157242us
I20260709 12:14:25.498672 12228 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:25.541330  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.422590 12181 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:25.552211  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.585568  8916 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:25.586243  8924 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:25.551211  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.554684  8921 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:25.558934  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 62823.9us
I20260709 12:14:25.522219 12231 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.584610  9621 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:25.590401  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.557752 12070 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.587675  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:25.587291  9070 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.525801 12192 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.555742 12170 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.545974 12089 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.594463 12214 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:25.589767 12228 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.532539 12225 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:25.630617  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.517277 11233 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:14:25.530934 12227 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.634347  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:25.636009  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:25.600178 12096 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.601774 12008 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.603688 11982 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.603688 12039 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.605438  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:25.606417  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.586601 11456 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.608722  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 567) took 3536 ms. Trace:
I20260709 12:14:25.609737 12251 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.623731 12102 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:25.612557  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:25.616591  9037 connection.cc:256] RPC call timeout handler was delayed by -2.0899263650001103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 12:14:25.617657  9617 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:25.544631 11653 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.547403 11838 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.646814  9622 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:25.589003  9074 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.552904 12131 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.611543 12231 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.640022 12240 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.640517  9072 rpcz_store.cc:276] 0709 12:14:22.072055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.948765 (+876710us) service_pool.cc:224] Handling call
0709 12:14:23.979329 (+1030564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.181088 (+201759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.122371 (+941283us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400369554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:25.608538 (+486167us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400369550. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:25.608665 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2831466752}
I20260709 12:14:25.655310  9072 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:25.610291  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1465) took 1892 ms. Trace:
W20260709 12:14:25.644784  9037 connection.cc:256] RPC call timeout handler was delayed by -2.035926365000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 12:14:25.653152  8918 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:25.632874  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.655997  8923 rpcz_store.cc:276] 0709 12:14:23.718289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.874259 (+155970us) service_pool.cc:224] Handling call
0709 12:14:23.874535 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.499532 (+1624997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.610057 (+110525us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400245c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:25.610226 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558434176}
I20260709 12:14:25.656172  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:25.656096  9037 connection.cc:256] RPC call timeout handler was delayed by -2.0179263650002213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 12:14:25.647783 12192 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.686585 12192 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:25.688657  8999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1291) took 1651 ms (client timeout 2098 ms). Trace:
W20260709 12:14:25.689244  8999 rpcz_store.cc:269] 0709 12:14:24.036724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.036847 (+   123us) service_pool.cc:224] Handling call
0709 12:14:25.688371 (+1651524us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400196754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:25.688586 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680958720}
I20260709 12:14:25.690538  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1459) took 1987 ms. Trace:
I20260709 12:14:25.691111  8925 rpcz_store.cc:276] 0709 12:14:23.703209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.709904 (+  6695us) service_pool.cc:224] Handling call
0709 12:14:23.737938 (+ 28034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.075782 (+337844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.690225 (+1614443us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:25.690458 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618140416}
I20260709 12:14:25.695988 12134 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.696570 12134 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:25.696727 12225 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.697669 12134 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.647605 12145 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:25.664363  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 171379us
I20260709 12:14:25.648528 11982 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.711339 11982 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:25.711638 12089 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.712311 11982 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.713614 11982 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.665282  8917 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:25.667595 12102 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.646864 12058 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:14:25.644028 12251 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.652626 12202 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:25.640235 11456 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:25.675897  9072 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:25.665350 12240 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:25.734388  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48799.4us
W20260709 12:14:25.702150  8964 leader_election.cc:336] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.679s (SENT)
I20260709 12:14:25.704082 12160 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:25.652853 12131 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.704593 12227 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.708194 12228 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:25.716355 12145 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:25.710207 12231 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:25.716920  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.716832  8999 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:25.718807  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 62713.4us
I20260709 12:14:25.744673  8996 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:25.699039 12134 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.727159  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.729103  9070 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:25.730594  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.732822  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.663950 11233 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:25.753690  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2748) took 1326 ms. Trace:
I20260709 12:14:25.754180  9068 rpcz_store.cc:276] 0709 12:14:24.427563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.496745 (+1069182us) service_pool.cc:224] Handling call
0709 12:14:25.497161 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.520454 (+ 23293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.520570 (+   116us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.543728 (+ 23158us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.648881 (+105153us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:25.648922 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.649028 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.753459 (+104431us) raft_consensus.cc:1685] finished
0709 12:14:25.753480 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.753629 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22586,"raft.queue_time_us":24512,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":104560,"threads_started":1,"wal-append.queue_time_us":196086}
I20260709 12:14:25.735306  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:25.755507 12192 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:25.757799 12089 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:25.736936  9037 connection.cc:256] RPC call timeout handler was delayed by -1.3447263650000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2866s for a response
I20260709 12:14:25.709141 12170 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:25.716203 11653 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.727751 12039 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.746287  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:25.750569  8992 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.751564 12166 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:25.736650 12160 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:25.759205  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:25.765267  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63177.3us
W20260709 12:14:25.784109  8964 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.696s (SENT)
I20260709 12:14:25.774669  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.782128  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:25.775535  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.742486 12145 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.782042  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.834743  9618 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:25.830112  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:25.797006  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:25.841745  9072 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.841789  8993 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:25.843472  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.848081  9620 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:25.784570  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.847031  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:25.851183  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67099us
I20260709 12:14:25.851593  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:25.852275  8964 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.800s (SENT)
I20260709 12:14:25.853139  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.853812  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.856473  8993 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.840790  8991 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:25.799090  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.885525  9623 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:25.786561  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.789209  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.888198  8998 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:25.914141  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.738384 12202 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:25.747864 11968 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.925024  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:25.931349  8996 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:25.932693  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:25.939657  9623 raft_consensus.cc:2368] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:25.791711  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.940640  8997 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.932986  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:25.829625 12143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.031s	sys 0.020s
W20260709 12:14:25.935588  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 83360.4us
I20260709 12:14:25.957989  8993 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
W20260709 12:14:25.937908  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1462) took 2226 ms (client timeout 2053 ms). Trace:
W20260709 12:14:25.970033  8964 leader_election.cc:336] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.826s (SENT)
I20260709 12:14:25.933961  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:25.778071 12153 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.782863 12172 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:25.942427  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 155956us
I20260709 12:14:25.936643  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 582) took 1874 ms. Trace:
I20260709 12:14:25.980481  9067 rpcz_store.cc:276] 0709 12:14:24.062458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.097108 (+1034650us) service_pool.cc:224] Handling call
0709 12:14:25.097373 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.310298 (+212925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.936381 (+626083us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400420ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:25.936580 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233658112}
I20260709 12:14:25.970557  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.983484  8993 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.946166  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:25.941941  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:25.976392  9617 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.942943  9624 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:25.970477  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:25.970112  8919 rpcz_store.cc:269] 0709 12:14:23.711227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.716494 (+  5267us) service_pool.cc:224] Handling call
0709 12:14:25.937725 (+2221231us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b540015a254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:25.937838 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22809600}
I20260709 12:14:25.784044 12182 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:25.989796  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:25.991890  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.992915  8964 leader_election.cc:336] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.853s (SENT)
I20260709 12:14:25.993521  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.829314 12214 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.095902  8998 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:25.829083 12039 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:25.770912 11916 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 12:14:26.016289  8991 raft_consensus.cc:2368] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
W20260709 12:14:26.112744  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 119852us
W20260709 12:14:26.113636  8964 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.877s (SENT)
I20260709 12:14:26.114136  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:26.016816  8992 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:26.116266  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:26.117108  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:26.044485  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:26.065346  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.924355 12211 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:25.923857 11838 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:26.096769  9618 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:26.096987  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:26.128705  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:25.971196 12002 raft_consensus.cc:2764] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:26.018639  8997 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:26.104523  9072 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:25.779901 12054 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.208s
W20260709 12:14:26.120705  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 336925us
I20260709 12:14:26.121271  8993 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:26.126881  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:26.158267  8991 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:25.970276 12121 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.127704  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:25.969627 12143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.607s	user 0.032s	sys 0.021s
I20260709 12:14:26.130438  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:26.182206  8996 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:26.186940  8921 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:26.131135  8920 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:26.130863  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:26.131723  9066 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:26.132669  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:26.134280  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:26.190412  8923 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.143927  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:26.145079  9623 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:25.929384 12234 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:26.149166  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:26.191851  9072 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:26.191939  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 258992us
I20260709 12:14:26.151381  8998 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:26.002765 11918 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:25.929162 11919 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.184s
I20260709 12:14:26.155771  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:26.146530 12156 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:26.156718  8964 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.961s (SENT)
W20260709 12:14:26.215014  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58448.1us
W20260709 12:14:26.216033  8964 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.982s (SENT)
W20260709 12:14:26.217072  8964 leader_election.cc:336] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.002s (SENT)
I20260709 12:14:26.217540  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:25.782641 11653 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:26.178066  8916 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:14:26.106419 11895 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.928004 12232 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.317s
I20260709 12:14:26.175004  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:26.182948  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:26.185601  9617 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:26.191365  9067 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:26.190893  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:26.145996 12073 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:26.223188  8964 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.624s (SENT)
I20260709 12:14:26.256244  8964 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:26.176597 11838 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:26.230551  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:25.945338 11456 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:26.238373  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 47557.5us
I20260709 12:14:26.107838 12182 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:26.268750  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:26.182233 12166 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:25.972460 11968 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:26.295341  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:26.261240  8992 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:26.290190  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:26.293324  8993 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:26.296258  9072 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:26.145805 12181 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:14:26.230014 11895 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:26.312438 11895 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:26.297278  9067 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:26.314464  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:26.314774  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:26.315627  8996 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:25.988471 12240 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:26.225221 12228 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
W20260709 12:14:26.709955  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.012s
W20260709 12:14:26.759562  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.014s	sys 0.012s
W20260709 12:14:27.129231  8995 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.007s	sys 0.003s
W20260709 12:14:27.124210  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.002s	sys 0.000s
W20260709 12:14:27.147698  8995 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.008s	sys 0.003s
I20260709 12:14:26.316049  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.098604  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:27.071538  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.002s
I20260709 12:14:27.102043  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:27.122459  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:27.147564  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.018s	sys 0.013s
W20260709 12:14:27.148301  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.006s	sys 0.000s
W20260709 12:14:27.189620  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.002s	sys 0.010s
W20260709 12:14:27.147619  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.015s	sys 0.018s
W20260709 12:14:26.760273  9619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.007s	sys 0.003s
W20260709 12:14:26.843716  9588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.009s
I20260709 12:14:27.123204  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:26.508036 11982 consensus_meta.cc:287] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.001s
I20260709 12:14:26.300846 11838 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:26.460073 11653 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:26.464792 11968 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:26.289817 11918 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:26.319186 12039 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.208595 11918 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.209545 11918 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:26.760218  9590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.006s
W20260709 12:14:26.547928 12096 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.001s
I20260709 12:14:26.409639  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:27.214624  9619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.492s	user 0.008s	sys 0.005s
I20260709 12:14:26.294425 11914 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.917s
I20260709 12:14:26.301401 12140 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:26.650892 12134 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.001s
I20260709 12:14:27.156401  9067 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:26.317785 12154 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:27.211577 11895 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.402781 12070 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:26.558387 12145 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.000s
I20260709 12:14:26.373648  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:26.759037  8997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.012s
I20260709 12:14:27.193742  8992 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:27.209560  8923 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.019s	user 0.014s	sys 0.000s
W20260709 12:14:26.750065  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.317094 12258 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:14:27.348631 12131 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:27.349637  8997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.011s	sys 0.016s
I20260709 12:14:27.349902 12131 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:27.350409  8993 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:27.351469  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1307) took 1057 ms. Trace:
I20260709 12:14:27.352560  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1306) took 1082 ms. Trace:
I20260709 12:14:27.354300  8992 rpcz_store.cc:276] 0709 12:14:26.270237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.361031 (+ 90794us) service_pool.cc:224] Handling call
0709 12:14:27.352455 (+991424us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:26.407461 12259 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:14:27.355948 12182 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.357494  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:26.231498 12153 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:27.360039 12198 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:26.406646 12256 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:14:27.352311  8993 rpcz_store.cc:276] 0709 12:14:26.294357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.320375 (+ 26018us) service_pool.cc:224] Handling call
0709 12:14:27.351287 (+1030912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.355391  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2234) took 1310 ms. Trace:
W20260709 12:14:27.360831  9588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.002s	sys 0.012s
I20260709 12:14:26.433560 12251 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.360808  8998 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:14:27.364158  9590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.006s	sys 0.013s
I20260709 12:14:27.207151 11838 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.364869  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1304) took 1095 ms. Trace:
I20260709 12:14:27.364988  9067 rpcz_store.cc:276] 0709 12:14:26.044915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.315796 (+270881us) service_pool.cc:224] Handling call
0709 12:14:27.355250 (+1039454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.365590  8991 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:27.365477  8998 rpcz_store.cc:276] 0709 12:14:26.269640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.409316 (+139676us) service_pool.cc:224] Handling call
0709 12:14:27.364760 (+955444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.366297  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1303) took 1098 ms. Trace:
W20260709 12:14:27.366339  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 1.15469e+06us
I20260709 12:14:27.351527  8923 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:26.760900 12223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.007s	sys 0.003s
W20260709 12:14:26.709661 12192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.011s
I20260709 12:14:27.366894  8991 rpcz_store.cc:276] 0709 12:14:26.267522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.269261 (+  1739us) service_pool.cc:224] Handling call
0709 12:14:27.366207 (+1096946us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:27.368613 12192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.011s	sys 0.021s
W20260709 12:14:26.379439 12249 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.638s	user 0.000s	sys 0.001s
I20260709 12:14:27.367851  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 473) took 1233 ms. Trace:
W20260709 12:14:27.360155  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 224783us
I20260709 12:14:27.367223  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.371694 12145 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.372246  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2235) took 1327 ms. Trace:
I20260709 12:14:27.373163  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:27.367983 12223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.007s	sys 0.009s
I20260709 12:14:26.308135 12172 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:27.373881  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2741) took 3369 ms. Trace:
I20260709 12:14:27.374454 12145 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.375700  9072 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.375445 12172 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.374300  9065 rpcz_store.cc:276] 0709 12:14:24.004830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.005000 (+   170us) service_pool.cc:224] Handling call
0709 12:14:24.005434 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.005953 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:24.033026 (+ 27073us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.534099 (+1501073us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b1800404380. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:14:25.803126 (+269027us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.807423 (+  4297us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.808068 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.808251 (+   183us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.808303 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.808404 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.373355 (+1564951us) raft_consensus.cc:1685] finished
0709 12:14:27.373395 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.373655 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2083,"prepare.queue_time_us":516449,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":8124,"raft.queue_time_us":26833,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":126723,"spinlock_wait_cycles":3444992,"thread_start_us":268567,"threads_started":2,"wal-append.queue_time_us":1640779}
I20260709 12:14:27.369525  8991 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:27.370477  8923 rpcz_store.cc:276] 0709 12:14:26.133950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.134061 (+   111us) service_pool.cc:224] Handling call
0709 12:14:27.367590 (+1233529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.372663  9067 rpcz_store.cc:276] 0709 12:14:26.045207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.366650 (+1321443us) service_pool.cc:224] Handling call
0709 12:14:27.372159 (+  5509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.362844 12140 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:26.402426 12261 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.989s
I20260709 12:14:27.384838  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.360661 12198 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:27.384625 12154 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.385916  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2236) took 1340 ms. Trace:
I20260709 12:14:27.384573 12140 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.387391  8998 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:27.362001 11918 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:27.379938  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 1.15779e+06us
I20260709 12:14:27.386350  9067 rpcz_store.cc:276] 0709 12:14:26.045530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.384395 (+1338865us) service_pool.cc:224] Handling call
0709 12:14:27.385830 (+  1435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.393512 12228 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:27.393942 12228 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:27.393833  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1305) took 1123 ms. Trace:
I20260709 12:14:27.400318  8992 rpcz_store.cc:276] 0709 12:14:26.269940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.359031 (+1089091us) service_pool.cc:224] Handling call
0709 12:14:27.393156 (+ 34125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.393497 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.393523 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.393563 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.393597 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.393651 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.393752 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.386585 12198 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.405197 12198 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:27.408068 12154 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.408674  8998 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:27.399061  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 1.10372e+06us
I20260709 12:14:27.424113  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1470) took 1918 ms. Trace:
I20260709 12:14:27.430714  9072 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:27.428813 11919 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.439563 12265 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:27.440230 11919 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.441267 12143 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.441432 12211 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.419709  8996 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:27.433318 12070 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:27.434832 12096 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.435564 12166 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:27.431736 12131 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:27.441453 12265 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:27.433435  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:27.434883  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 764) took 3300 ms. Trace:
I20260709 12:14:27.442145 12211 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.438438 12160 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.427582  8917 rpcz_store.cc:276] 0709 12:14:25.505331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.545277 (+ 39946us) service_pool.cc:224] Handling call
0709 12:14:25.545520 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.715804 (+170284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.423318 (+1707514us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000da554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:27.423801 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272860928}
I20260709 12:14:27.447858 12145 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.450214  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1308) took 1142 ms. Trace:
I20260709 12:14:27.456100  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2238) took 1405 ms. Trace:
I20260709 12:14:27.454970  8996 rpcz_store.cc:276] 0709 12:14:26.307845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.316306 (+  8461us) service_pool.cc:224] Handling call
0709 12:14:27.448156 (+1131850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.442173 12143 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.459373  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 517) took 1842 ms. Trace:
I20260709 12:14:27.449895  9616 rpcz_store.cc:276] 0709 12:14:24.134483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.136291 (+  1808us) service_pool.cc:224] Handling call
0709 12:14:24.168720 (+ 32429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.262570 (+1093850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.434189 (+2171619us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540061e4d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:27.434596 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490200960}
I20260709 12:14:27.457438  9072 rpcz_store.cc:276] 0709 12:14:26.046126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.298102 (+251976us) service_pool.cc:224] Handling call
0709 12:14:27.449101 (+1150999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.460399  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.449667 12265 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:27.464876  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96577.8us
I20260709 12:14:27.465193 12276 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:27.466370 11916 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:14:27.469288  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.456261 12145 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.467918  9590 connection.cc:256] RPC call timeout handler was delayed by -1.0416598750000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:14:27.446260 12070 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.475679  9067 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:27.474385 12264 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.469000 12276 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.459933  9619 rpcz_store.cc:276] 0709 12:14:25.616899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.618122 (+  1223us) service_pool.cc:224] Handling call
0709 12:14:25.618481 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.618716 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:25.722231 (+103515us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.458683 (+1736452us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.458795 (+   112us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.458934 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.459039 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.459268 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97579,"prepare.queue_time_us":317176,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":9181,"spinlock_wait_cycles":107804928,"thread_start_us":1614451,"threads_started":2,"wal-append.queue_time_us":1641194}
I20260709 12:14:27.456342 12096 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.471510 11968 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.484376 12228 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.483361  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2243) took 1387 ms. Trace:
I20260709 12:14:27.486478  9067 rpcz_store.cc:276] 0709 12:14:26.092936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.400083 (+1307147us) service_pool.cc:224] Handling call
0709 12:14:27.480579 (+ 80496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.473018  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:27.480839 12264 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.480333 12143 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.487730 11919 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.488286 12145 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.488505 12265 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.492830 12265 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:27.495589  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 122647us
I20260709 12:14:27.500941  9065 raft_consensus.cc:2410] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:27.506107 11968 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.507087 12096 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.507725 12096 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.508333 12096 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.509315 11968 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:27.513144  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.514791  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:27.515316  8923 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:27.516683  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:27.520355  8964 leader_election.cc:400] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9.
I20260709 12:14:27.520797  8964 leader_election.cc:403] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:27.521720 12207 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9.
I20260709 12:14:27.522467  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:27.524477 11630 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:27.524917 11630 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:27.525290 12264 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.526018 12264 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:27.526933  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:27.566004  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 132958us
I20260709 12:14:27.582175  9616 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:27.582701  9616 pending_rounds.cc:85] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 7
I20260709 12:14:27.583002  9616 pending_rounds.cc:107] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:27.583310  9616 raft_consensus.cc:2889] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.583431 11895 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:27.584321  9071 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:27.587816 11895 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.588567 11895 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.528796 12096 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.526435 11630 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.590919  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64211.8us
I20260709 12:14:27.591360 11895 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.591852  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:27.592075 11895 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.602835  9072 raft_consensus.cc:606] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:27.614828 12262 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.614704 11954 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:27.637709 11954 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:27.620802  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53609.9us
I20260709 12:14:27.623035 12290 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.628311 12202 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.629752  9073 raft_consensus.cc:2368] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
W20260709 12:14:27.631160 12291 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:14:27.619091 12140 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.632025 12160 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.641158 11954 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.642699 11954 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:27.643378 12262 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.644120 12262 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.646708 12262 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.643162 12140 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.647969 12290 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:27.650383  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.636852  9072 raft_consensus.cc:614] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:27.653509 12228 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.654482 12222 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.632876  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 110575us
I20260709 12:14:27.655218 12222 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.656107  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:27.657101 12231 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:27.657896 12222 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:27.659422  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.662361  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:27.665980  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.670632  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:27.674391 12270 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 12:14:27.676340 12275 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 12:14:27.735984  9066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2231) took 1691 ms (client timeout 1557 ms). Trace:
I20260709 12:14:27.678700  9074 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:27.686568  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2242) took 1639 ms. Trace:
I20260709 12:14:27.694109 11630 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.705700 12276 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.726581  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 784) took 5334 ms. Trace:
W20260709 12:14:27.731695  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.650671 12290 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.732380 12286 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:27.734455  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 89356.2us
I20260709 12:14:27.734254  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.735010 12096 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.736091  9067 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:27.737898  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.738224 12007 raft_consensus.cc:2764] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:27.738351  9624 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:27.738802 12289 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.742336  9621 rpcz_store.cc:276] 0709 12:14:22.392459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.495451 (+102992us) service_pool.cc:224] Handling call
0709 12:14:23.982686 (+1487235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.590616 (+1607930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.776253 (+185637us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400479854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:27.726093 (+1949840us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400479850. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.726347 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7103123072}
W20260709 12:14:27.739082  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76846.9us
I20260709 12:14:27.655145 12211 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.740744  9065 rpcz_store.cc:276] 0709 12:14:26.092496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.442744 (+1350248us) service_pool.cc:224] Handling call
0709 12:14:27.686284 (+243540us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400368654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.686467 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70156032}
W20260709 12:14:27.739732  9066 rpcz_store.cc:269] 0709 12:14:26.044045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.044195 (+   150us) service_pool.cc:224] Handling call
0709 12:14:27.735460 (+1691265us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b54000ac654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.735740 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12258560}
I20260709 12:14:27.773121  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1309) took 1439 ms. Trace:
I20260709 12:14:27.747344 12147 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.747524 11704 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.759267 12202 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:27.772259  8995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.039s
I20260709 12:14:27.776714  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:27.777163  8995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.039s
I20260709 12:14:27.782972  9620 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:27.781900  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.766660 12286 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.773553  8993 rpcz_store.cc:276] 0709 12:14:26.330190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.361778 (+1031588us) service_pool.cc:224] Handling call
0709 12:14:27.362464 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.363808 (+  1344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.363841 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.364484 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.447533 (+ 83049us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:27.461296 (+ 13763us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.461506 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.461570 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.749201 (+287631us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800002440. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:27.763584 (+ 14383us) raft_consensus.cc:1685] finished
0709 12:14:27.769314 (+  5730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.769458 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16936,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3115,"raft.queue_time_us":334,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":349,"spinlock_wait_cycles":8835328,"thread_start_us":82499,"threads_started":1,"wal-append.queue_time_us":120895}
I20260709 12:14:27.788350  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.788875 12239 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.788494 12289 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.789695 12131 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.789919 12089 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:27.812482  8917 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:27.812573 12089 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.813921  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.790413  9065 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.815188 12211 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.790781 12212 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.816475 12239 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.817444 12212 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.819921  9070 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:27.819603 12219 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:14:27.820254 12212 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.820917 12212 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:27.821257 12212 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:27.821732 12239 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.822263 12212 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.824008  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.824982 12290 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.825723 12290 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.827445  9073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2215) took 2644 ms (client timeout 1826 ms). Trace:
I20260709 12:14:27.828043  8920 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:27.800472 12202 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.828787 12207 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.795637 12214 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.812592  8925 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:27.830142 12202 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.829741 12214 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.830750 12131 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.831110  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.832582 12214 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.796365 12096 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.833099 12131 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.794236  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:27.789330 12147 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:27.830554  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.835165 12096 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.799278  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 771) took 1962 ms. Trace:
I20260709 12:14:27.835649 12147 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:27.835943  9620 rpcz_store.cc:276] 0709 12:14:25.836636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.928278 (+ 91642us) service_pool.cc:224] Handling call
0709 12:14:27.733828 (+1805550us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:27.799173 (+ 65345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3001216}
I20260709 12:14:27.786056  9616 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
W20260709 12:14:27.799955 12273 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.436s	user 0.007s	sys 0.004s
W20260709 12:14:27.801512  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 166153us
I20260709 12:14:27.795691 12093 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.838771 12093 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.803764  9074 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:27.841696 12195 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:14:27.842140  9071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2213) took 2659 ms (client timeout 1696 ms). Trace:
W20260709 12:14:27.842607  9071 rpcz_store.cc:269] 0709 12:14:25.182896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.214188 (+ 31292us) service_pool.cc:224] Handling call
0709 12:14:27.841905 (+2627717us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54001b6a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.842059 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5051990272}
I20260709 12:14:27.844017 12093 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.844062  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:27.841697  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 583) took 2671 ms. Trace:
I20260709 12:14:27.845340  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2237) took 1799 ms. Trace:
I20260709 12:14:27.845641  9074 rpcz_store.cc:276] 0709 12:14:25.169975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.497841 (+327866us) service_pool.cc:224] Handling call
0709 12:14:25.498140 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.677772 (+2179632us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5800679dd0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985b970aa 00007f3985c19447 00007f3985c31fe7 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4
0709 12:14:27.841311 (+163539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.841632 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4312982272}
I20260709 12:14:27.847076  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.848584  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.849887  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.850419  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.791344  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.854048  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:27.854667  9066 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:27.855536  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.855822  9066 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:27.856894  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.857331  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:27.850569  9074 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:27.858101  9066 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:27.858215  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.858906  8918 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:27.860049  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.861536  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:27.811913  9069 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:27.809793  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:27.828127  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2585) took 2026 ms. Trace:
I20260709 12:14:27.820295  9070 pending_rounds.cc:85] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:27.863306  9070 pending_rounds.cc:107] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:27.863602  9070 raft_consensus.cc:2889] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.794872 11704 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:27.799590 11858 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:27.813052  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:27.827930  9073 rpcz_store.cc:269] 0709 12:14:25.183215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.247591 (+ 64376us) service_pool.cc:224] Handling call
0709 12:14:27.804887 (+2557296us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b54000e79d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.827346 (+ 22459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5412786944}
I20260709 12:14:27.791288  8963 leader_election.cc:400] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:27.870050  8963 leader_election.cc:403] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:27.845358  9071 raft_consensus.cc:2368] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:27.872011  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 587) took 2094 ms. Trace:
I20260709 12:14:27.872594  9070 rpcz_store.cc:276] 0709 12:14:25.773962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.843933 (+ 69971us) service_pool.cc:224] Handling call
0709 12:14:27.819391 (+1975458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.867507 (+ 48116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.868385 (+   878us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000e79d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.868575 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4521586432}
I20260709 12:14:27.786935 12276 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:14:27.874033 11704 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.864432  8995 rpcz_store.cc:276] 0709 12:14:25.802106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.803446 (+  1340us) service_pool.cc:224] Handling call
0709 12:14:25.803880 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.804142 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:27.149183 (+1345041us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.801306 (+652123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.811405 (+ 10099us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.827684 (+ 16279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.827829 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.828038 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24417,"prepare.queue_time_us":1560137,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":93,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9436,"thread_start_us":1832840,"threads_started":2}
I20260709 12:14:27.866546  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:27.867799  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.877528  9622 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:27.875219  8923 raft_consensus.cc:2376] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11. Re-sending same reply.
I20260709 12:14:27.845857  9067 rpcz_store.cc:276] 0709 12:14:26.045829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.487437 (+1441608us) service_pool.cc:224] Handling call
0709 12:14:27.735627 (+248190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.767867 (+ 32240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.845126 (+ 77259us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54000ac650. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:27.845255 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569735424}
I20260709 12:14:27.807961 12286 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.880506  9074 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:27.795090 11456 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:27.892678 12289 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:27.893774  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.895190 12195 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:27.903889 12290 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:27.905056  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114035us
I20260709 12:14:27.905244 12093 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:27.907891  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2600) took 1924 ms. Trace:
I20260709 12:14:27.908667  8997 rpcz_store.cc:276] 0709 12:14:25.983613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.150092 (+166479us) service_pool.cc:224] Handling call
0709 12:14:26.150543 (+   451us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:26.176505 (+ 25962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.176538 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:26.177236 (+   698us) log.cc:844] Serialized 78 byte log entry
0709 12:14:27.350467 (+1173231us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.394474 (+ 44007us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.410807 (+ 16333us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.432274 (+ 21467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.450056 (+ 17782us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.673484 (+223428us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:27.907586 (+234102us) raft_consensus.cc:1685] finished
0709 12:14:27.907619 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.907813 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56872,"prepare.queue_time_us":14327,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":88,"raft.queue_time_us":64485,"raft.run_cpu_time_us":554,"raft.run_wall_time_us":17800,"spinlock_wait_cycles":80876928,"thread_start_us":1137063,"threads_started":2,"wal-append.queue_time_us":1143783}
W20260709 12:14:27.911950  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45566.5us
I20260709 12:14:27.915886  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:27.918228 12214 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:27.815122 12089 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:27.919811 12089 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:27.920483 12214 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.921496 12214 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.883993  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:27.921986 12214 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:27.922505  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51426.9us
I20260709 12:14:27.922721 12093 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:27.923298 12093 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.923728 12093 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.923585  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:27.925208 12131 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:27.925747 12131 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.926188 12131 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:27.927678 12219 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:27.928583 12219 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:27.929759  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.934978  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.939905 12172 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:27.940659 12172 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:27.941919 12172 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.949851  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65662.5us
I20260709 12:14:27.946439 12198 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.957758 12231 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:27.961141 11968 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.961891 11968 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.963445  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 181738us
I20260709 12:14:27.957490 12198 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:27.971498  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.983382  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.984064  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:27.973915  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.003088  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:28.007440  9065 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:28.007961  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.014232  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.006239 12270 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:14:28.021804  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 98355.4us
I20260709 12:14:28.023598  9071 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:28.019996  9624 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:28.014290  8889 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:28.014496 12212 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.037158  9065 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:27.973083 12093 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.035980  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 80550.9us
I20260709 12:14:28.040175 12166 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:28.048868  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.049149 12222 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.049530 12222 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.049876 12222 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.040999 12228 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.056951  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 54002.6us
I20260709 12:14:28.045028 12166 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.063799  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.064627  8918 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:28.066036 12166 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.058316 12140 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.058519 12240 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:28.059257  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.060230  9071 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:28.069175  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:28.069584  9065 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:28.072094 12219 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.068372  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:28.074167  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.082587  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:28.067891 12290 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:14:28.086915  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44332.1us
W20260709 12:14:28.088266  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 182141us
I20260709 12:14:28.089088  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.091776  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.090575  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:28.103055 11630 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.083876 12140 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.103621 11630 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.104048 11630 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.105217 12140 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:28.109310  8966 connection.cc:256] RPC call timeout handler was delayed by -1.5129054159999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 12:14:28.134267  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:28.111413 12290 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:28.140588  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.145222  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53795.2us
I20260709 12:14:28.084189 12228 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.142086  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.145058  9073 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:28.147871  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.125550 12231 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:28.133015 11968 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.152244  9066 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.134344 12140 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.135640 12007 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:28.156570  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.172912  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.173928  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.175454  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 94321.5us
I20260709 12:14:28.178893  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.150619 12093 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.174753  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.192909  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.162024 12140 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:28.196282  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:28.150998 12207 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:14:28.204778 12140 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:28.232957  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71065.4us
I20260709 12:14:28.209137 12160 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:14:28.200771 12276 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:14:28.251082  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:28.198283 11968 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:14:28.258450  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:28.282721  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64224.9us
I20260709 12:14:28.253202  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:28.284482  9624 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.253268  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.254578  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.255744  8888 leader_election.cc:400] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:28.285681  8888 leader_election.cc:403] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:28.256170  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.258424 12171 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:28.263374  9000 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:28.218238 12251 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 12:14:28.268707  8991 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:28.270450  9068 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 12:14:28.271293 12299 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.319s	user 0.000s	sys 0.006s
I20260709 12:14:28.206697 12290 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.192287 12007 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.244879 12093 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:28.242544 12286 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.273054  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.276196  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.279383 12298 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.291476 12227 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:28.296494  9068 pending_rounds.cc:85] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 7
I20260709 12:14:28.348591  9068 pending_rounds.cc:107] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:28.348976  9068 raft_consensus.cc:2889] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:28.334141  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.326228  8994 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:14:28.332719  9037 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.591s (SENT) [suppressed 29 similar messages]
I20260709 12:14:28.279662  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.258888 11855 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:14:28.294868 12171 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.355777  9066 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:28.356804  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.357582  9000 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:28.358268 12007 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.338049 12093 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:28.364063  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.364612 12096 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.365300 12096 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.366864  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 111373us
I20260709 12:14:28.367993  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:28.368510  9073 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:28.369748 12229 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
I20260709 12:14:28.371482 12227 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:28.366998 12286 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.369859 11982 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.370918  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:28.350414 12298 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.372648  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:28.387444  8964 connection.cc:256] RPC call timeout handler was delayed by -1.4076979249998658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 12:14:28.385789  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.389497  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:28.384188  9619 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:28.373394 12171 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.399847  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:28.383803 11982 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.402976 12172 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.399030 12228 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.362906 12093 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.449009  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.449868 12131 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.010s
I20260709 12:14:28.405917 12007 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.452813  8996 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:28.416673 11982 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.401680 12160 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:14:28.459520 12058 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.433835 12172 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.462565  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.411016 12214 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.473297  9624 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:28.434777 12207 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:28.453644 12219 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.475939  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:28.480083  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.480397  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85202.7us
I20260709 12:14:28.484422  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:28.485057  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.485518  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.491786  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.492175 12298 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.492761  8991 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:28.493561  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.494594  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.494825  9074 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:28.495419  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.496519  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.497145 11630 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.500434 12222 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.476541 12172 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.502815 12227 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:28.526176  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.468518 12058 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:28.519486 12207 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.520143  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:28.529027  8991 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:28.535674 12156 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.536653 12156 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.476317 12007 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.540071 12303 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:14:28.541213 12007 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:28.544143 12304 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:14:28.545315  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.546044  8993 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:28.546980  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.547756  8993 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
I20260709 12:14:28.548575  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.549214  8993 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:28.528448 12160 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:14:28.528517 12228 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:28.551913 12214 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.552117 12228 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:28.552609 12228 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:28.553145 12147 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.553555 12147 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:28.554819  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:28.559341  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.560901 12198 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.562937  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 584) took 2790 ms. Trace:
I20260709 12:14:28.529016  8996 raft_consensus.cc:2376] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8. Re-sending same reply.
I20260709 12:14:28.563321  9068 rpcz_store.cc:276] 0709 12:14:25.772988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.775281 (+  2293us) service_pool.cc:224] Handling call
0709 12:14:25.775590 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.352398 (+2576808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.562638 (+210240us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b54004227d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:28.562877 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5735989632}
I20260709 12:14:28.564185  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:28.565196 12305 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.204s	user 0.000s	sys 0.002s
I20260709 12:14:28.565567  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:28.566102 12219 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:28.566617 12219 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.530403 12058 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.531845 12093 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.554539 12147 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.457913 12131 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.573156 12131 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.575366  8992 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:28.566700  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:28.582754  8996 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.549988  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:28.585722  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.574107  8994 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:28.589653  8993 raft_consensus.cc:2368] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8.
I20260709 12:14:28.590488  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.592890  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.593689  8991 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:28.590523  9000 raft_consensus.cc:2376] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7. Re-sending same reply.
I20260709 12:14:28.595961 12222 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.596362  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.597565  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.598280  9000 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:28.598453 12096 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.598696 12171 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.599638 12156 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.600996 12171 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:28.603641 12212 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.562s	user 0.002s	sys 0.009s
I20260709 12:14:28.605417 12198 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.606163 12198 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.607875 12147 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.609061 12198 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.610450  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:28.610992  9069 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.611878 11630 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.612600  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.613265  8995 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:28.599058  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.616400  9000 raft_consensus.cc:2410] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:14:28.619616  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 239157us
I20260709 12:14:28.631551  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:28.636786  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.638836  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.640256  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.641091  8993 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
W20260709 12:14:28.642041  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.643092  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:28.645402  8964 leader_election.cc:336] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.557s (SENT)
I20260709 12:14:28.634084  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:28.652952  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.653779  8999 raft_consensus.cc:2410] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:28.654891  8999 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:14:28.655179  8999 pending_rounds.cc:85] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 3
I20260709 12:14:28.655441  8999 pending_rounds.cc:107] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:28.655671  8999 raft_consensus.cc:2889] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:28.648831  9621 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:28.660718  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.661744  9000 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:28.664172  9622 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.663875  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:28.663834  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:28.669143  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:28.634447 12309 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:28.672309  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:28.672289  9067 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:28.677646  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.681890  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:28.682225  8995 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:28.682552  9617 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.687619 12228 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:28.690047  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55882us
I20260709 12:14:28.691545  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.692629  9622 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:28.694406  9617 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
W20260709 12:14:28.697665  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 371481us
I20260709 12:14:28.698791 12147 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.699684 12147 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.672959 11968 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:28.639597 12171 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:14:28.680078 12166 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:28.715843  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:28.719252  8964 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.665s (SENT)
I20260709 12:14:28.720588  9622 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:28.720724  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.689167 12093 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:28.718647  8991 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:28.644943 11982 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.731886  9072 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:28.703219 12309 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:28.757755 11982 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.758006 12309 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.751784  9620 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:28.753425  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:28.762346  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.723628 12093 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.763569 12093 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:28.762398  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.767338 12160 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.767798  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.720410 12140 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.768720 12212 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:28.770004  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.770257 12140 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.770073 12212 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:28.771624  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52451.1us
W20260709 12:14:28.773296  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.773187 12212 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:28.774133  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.722541 12166 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:28.775578 12166 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.777482 12147 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.709009 12320 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:14:28.782217  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:28.754137 12318 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:28.724390 12290 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:14:28.750017 11630 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:28.775005 12131 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.754045 12207 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:28.786661  9069 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:28.803984  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:28.809784  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.815024  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.817673  9619 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:28.790670 12096 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:28.828279  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.828337  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.829471  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2765) took 1071 ms. Trace:
I20260709 12:14:28.829942  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:28.833346 12212 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.834055 12212 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.836833 12212 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.839967 12007 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.841714 12166 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.843822  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.853765 11968 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:28.860215 12214 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.813695 12207 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.861598  8922 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:28.829999  9072 rpcz_store.cc:276] 0709 12:14:27.758273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.793954 (+ 35681us) service_pool.cc:224] Handling call
0709 12:14:28.829247 (+1035293us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400368b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:28.829394 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799071488}
I20260709 12:14:28.816601 12140 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:28.872308  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:28.861366 12096 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:28.890462  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.897850  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.826645 12228 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:28.899168  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.907953  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.921340  8925 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:28.903110 12276 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:28.903184 12096 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:28.941799  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:28.942052  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.950109  8918 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:28.955471  8922 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
W20260709 12:14:28.956671  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.957782 12198 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:28.958199 12198 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:28.959375 12276 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:28.960145 12172 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.960398 12276 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.963343  8819 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 207) took 31187 ms (client timeout 15000 ms). Trace:
I20260709 12:14:28.965711  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.966558  9067 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 4: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:28.967382  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.967648  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.967826  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.968076  9074 raft_consensus.cc:2368] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:28.968950  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.969429  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:28.969547  9067 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:28.969635 12166 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:28.971025  9624 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:28.925753 12156 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:28.931416 12131 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:14:28.902922 12214 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.975271 12156 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:28.976876  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.982056  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:28.925215 12207 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:28.977412  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:28.977871  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.993592  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.971772 12140 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:28.993789  9074 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:28.995149  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.996076  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.992905  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:28.999433  9066 raft_consensus.cc:606] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
W20260709 12:14:28.999604  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 372057us
I20260709 12:14:28.999790  9066 raft_consensus.cc:614] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:28.997349  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:28.998618  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 333557us
I20260709 12:14:29.000090  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:28.996898  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.004383  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:29.007766  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.010787  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 206883us
I20260709 12:14:29.021602  9070 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:29.023869  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.025260  8916 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:14:29.021020  8922 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.996562 12265 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.994444 12007 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:29.060820  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:28.959133 12198 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.067695  8924 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:29.068472 12214 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:29.068585 12172 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:29.069147 12214 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:29.069762 12329 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:29.073470  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.074141  8925 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.074447  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.075860  8916 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:29.059216  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 93442.6us
W20260709 12:14:29.077759  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.088449  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.095860  8924 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:28.963817  8819 rpcz_store.cc:269] 0709 12:13:57.775577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.776285 (+   708us) service_pool.cc:224] Handling call
0709 12:14:28.963077 (+31186792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:25.138164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:25.138858 (+   694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:25.138905 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:14:25.138924 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:25.186636 (+ 47712us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:25.186717 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:25.186747 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:14:25.187351 (+   604us) tablet.cc:701] Row locks acquired
0709 12:14:25.187399 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:14:25.187618 (+   219us) write_op.cc:270] Start()
0709 12:14:25.187792 (+   174us) write_op.cc:276] Timestamp: P: 1783599265187533 usec, L: 0
0709 12:14:25.187822 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:14:25.258294 (+ 70472us) log.cc:844] Serialized 1662 byte log entry
0709 12:14:27.629752 (+2371458us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18002f0320. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:27.875682 (+245930us) op_driver.cc:464] REPLICATION: finished
0709 12:14:27.967797 (+ 92115us) write_op.cc:301] APPLY: starting
0709 12:14:27.967943 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:27.968202 (+   259us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:27.968251 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:28.032878 (+ 64627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:28.088764 (+ 55886us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:14:28.095535 (+  6771us) write_op.cc:312] APPLY: finished
0709 12:14:28.158856 (+ 63321us) log.cc:844] Serialized 41 byte log entry
0709 12:14:28.161458 (+  2602us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:28.187022 (+ 25564us) write_op.cc:454] Released schema lock
0709 12:14:28.202935 (+ 15913us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:28.265536 (+ 62601us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:28.265579 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5543293,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":91686,"apply.run_cpu_time_us":8495,"apply.run_wall_time_us":267160,"num_ops":4,"prepare.queue_time_us":690767,"prepare.run_cpu_time_us":15644,"prepare.run_wall_time_us":374153,"raft.queue_time_us":175720,"raft.run_cpu_time_us":19565,"raft.run_wall_time_us":124892,"replication_time_us":2687597,"spinlock_wait_cycles":44272384,"thread_start_us":516810,"threads_started":4,"wal-append.queue_time_us":263804}]]}
I20260709 12:14:29.020982 12298 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:14:29.098522  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:29.099702  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.099022  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.103724  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:29.104287  8996 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:29.102641  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 425492us
I20260709 12:14:29.100960  8918 raft_consensus.cc:2376] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8. Re-sending same reply.
I20260709 12:14:29.113876  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.114108  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:29.108845  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:29.074726 11630 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.119325  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:29.119915  8997 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.120924  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:29.128399  8917 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:29.052232 12058 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.056324 12093 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.154642  8995 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:29.153225  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44912.4us
I20260709 12:14:29.147205  8996 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:29.155843  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 55447.8us
W20260709 12:14:29.161564  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 101590us
I20260709 12:14:29.066430 12265 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.162770  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:29.115998 12198 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:29.166371  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57601.7us
I20260709 12:14:29.178166  8923 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.103278 12286 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:14:29.189800  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.190595  8916 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:29.196101  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.189219 12219 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
W20260709 12:14:29.205634 12319 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:29.178193 12276 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.244561  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:29.221987  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60001.2us
W20260709 12:14:29.122393 11968 consensus_queue.cc:1175] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "491a1127924f43d4a369f7d09c3a68db" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 9 } }
I20260709 12:14:29.251083 12332 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:29.272418  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 219437us
W20260709 12:14:29.287267  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 120949us
W20260709 12:14:29.291302  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 56889.6us
I20260709 12:14:29.300058  8997 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:29.248546 12276 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:29.308813  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.231537 12219 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.227326 12339 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:14:29.343928  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:29.344655  9069 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.313009 12276 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:29.366392  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123769us
I20260709 12:14:29.409920  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:29.334213 12140 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:29.406107 12156 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:29.415639  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 73168.5us
I20260709 12:14:29.416144  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:29.328022 12212 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:14:29.452554  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.453146  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.472754  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 52898.6us
W20260709 12:14:29.474475  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64683.5us
I20260709 12:14:29.475636  8889 leader_election.cc:400] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7.
W20260709 12:14:29.480258  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.480398  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.410642  8820 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 2 to 3, term changed from 1 to 6, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to <none>, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:29.420205 12344 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.467058 12346 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:14:29.524761  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118419us
I20260709 12:14:29.473539  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:29.509909 12350 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.484829 12172 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.510933 12058 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:29.511078 12335 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:14:29.511796  8889 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:29.512502 11855 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:29.510012 12365 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.544442  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:29.545300  8922 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:29.549721  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.525588  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:29.415768 12229 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:14:29.590649  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 611) took 1038 ms. Trace:
I20260709 12:14:29.591261 12290 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.591562  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2601) took 1035 ms. Trace:
I20260709 12:14:29.591076  9071 rpcz_store.cc:276] 0709 12:14:28.552582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.590281 (+ 37699us) service_pool.cc:224] Handling call
0709 12:14:28.628568 (+ 38287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:28.635868 (+  7300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.635912 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:28.645497 (+  9585us) log.cc:844] Serialized 52 byte log entry
0709 12:14:29.055077 (+409580us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:29.055144 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.055264 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.590422 (+535158us) raft_consensus.cc:1685] finished
0709 12:14:29.590443 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.590592 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10255,"thread_start_us":361450,"threads_started":1,"wal-append.queue_time_us":458332}
W20260709 12:14:29.556648  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 280257us
W20260709 12:14:29.559191  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 85730.5us
I20260709 12:14:29.494041 12332 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:29.577838 12370 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.578089 12364 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:14:29.578397 12357 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.584098 12219 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:29.586280 12359 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:29.589176  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63664.3us
I20260709 12:14:29.605134  9069 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:29.591969  8992 rpcz_store.cc:276] 0709 12:14:28.555954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.602058 (+ 46104us) service_pool.cc:224] Handling call
0709 12:14:28.602436 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.612363 (+  9927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.612394 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.612892 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.052801 (+439909us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:29.052856 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.052949 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.591355 (+538406us) raft_consensus.cc:1685] finished
0709 12:14:29.591374 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.591502 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9320,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":439479,"threads_started":1,"wal-append.queue_time_us":973921}
I20260709 12:14:29.551126 12093 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:29.572855 12140 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:29.618547  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 106875us
I20260709 12:14:29.618954  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:29.619771  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:29.626678  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:29.632516  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.609061 12227 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:29.606630 12332 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:29.541612 12344 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.562490 12172 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.648941  9073 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:14:29.627110 12096 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.002s
I20260709 12:14:29.649402  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:29.634509  8820 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:29.622529 12140 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:29.622289 12354 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:29.649983  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:29.603003 12365 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.627715 12240 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.681507  8820 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 7, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:29.682969  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70291us
I20260709 12:14:29.683195 12171 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.681540 11630 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.644277 12332 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.687071 12354 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.644773 12219 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:29.687589 12371 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.687968 12376 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:29.680614 12140 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.684223  8992 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:29.682984  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53469.3us
I20260709 12:14:29.690104  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:29.690726  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.695890  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:29.700522 12338 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.395s	user 0.005s	sys 0.000s
W20260709 12:14:29.702438 12347 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:14:29.708956 12344 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:29.709417 12207 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:29.710064  8999 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:29.710882 11954 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:29.713721 12341 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:14:29.715127 11855 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.742184  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:29.616477 12370 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.718375  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:29.802094  8996 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.640012 12227 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:29.686522 12172 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:29.732779  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:29.657064 12096 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.618630 12359 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.618295 12357 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.734112 12093 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:29.787899 12007 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.762354  8997 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.735224  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.756856  8820 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 4, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:29.761201  9070 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:29.733820  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:29.848256  8923 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:29.644079 12265 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:29.806490  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 211105us
I20260709 12:14:29.809171  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:29.849604  8992 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:29.736649  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:29.836846  8999 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:29.853062  8994 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.765623 12371 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:29.839183  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 219483us
W20260709 12:14:29.733436  8995 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 12:14:29.861621  8995 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:29.788844 12290 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:29.741951 12171 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:29.862650  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126109us
I20260709 12:14:29.798226 11954 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:29.862738 12290 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:29.863749  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 234381us
I20260709 12:14:29.863816 12171 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.865083 12290 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:29.845561  8996 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:29.866513  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:29.862242 12265 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:29.873255  8916 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.005s
I20260709 12:14:29.874351  8916 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:29.867129  8993 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:29.879513 12265 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:29.880818 12265 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.883951 11982 raft_consensus.cc:2764] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:29.763382 11630 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.750208 12350 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 12:14:29.735306 12229 consensus_queue.cc:1059] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:14:29.896435  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:29.884445 12341 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:14:29.916914  8997 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:29.860970 12219 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:29.935261  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 202556us
I20260709 12:14:29.887874  8820 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 6, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 6 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:29.936255  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:29.928045  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 126683us
I20260709 12:14:29.806903 12374 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 12:14:29.938453  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:29.947618  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:29.787952 12376 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.861119 12007 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:29.960712  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:29.962353  9037 leader_election.cc:400] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8.
I20260709 12:14:29.962738  9037 leader_election.cc:403] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:29.963590 12290 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:29.964144 12290 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.964507 12290 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:29.967485 12286 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:29.968039 12286 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.968433 12286 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.973053 12381 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:29.867265 12093 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.931790 12219 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:29.929899 11968 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:29.997249  9590 leader_election.cc:336] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.640s (SENT)
I20260709 12:14:29.949177 12240 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:30.010052  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:29.999683  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 135217us
I20260709 12:14:30.010931  9622 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:29.978533 12276 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.003s
I20260709 12:14:30.000413  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.003170  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:30.007268  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 172315us
I20260709 12:14:29.993131 12219 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.999677  8820 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 6, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 6 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:30.017839  8964 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.907s (SENT)
I20260709 12:14:30.016333  8924 raft_consensus.cc:2368] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:29.993444 12350 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:30.034256  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:29.996447 11855 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:30.039431  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:29.924935 12227 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:29.999493 12362 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.046418  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.050904  8917 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:30.042641  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 619) took 1750 ms. Trace:
I20260709 12:14:30.047794  9624 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:30.048228  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.051187  8820 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 7, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.015013 12370 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.047185 12371 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.056582 12096 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.058831 12007 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:30.062670  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.063794 12156 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.072832 12333 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:30.073179  8917 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:30.073325  8820 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.023624 12350 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.001385 11968 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.042484 12365 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:30.077129  8964 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.918s (SENT)
I20260709 12:14:30.085180  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:30.077553  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 80331.9us
W20260709 12:14:30.088461  9590 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.749s (SENT)
I20260709 12:14:30.088984  9590 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.096781  8921 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:30.097770 12369 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.098328 12369 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.099740  8820 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 5, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:30.101100 12369 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.101486  8820 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 5, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:30.102840 12373 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.103355 12373 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:30.103730  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.104514  8917 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:30.104319 12373 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.105409  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.105687 12373 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.107570 12240 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.111881 11855 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:30.114382  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.080892 12171 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.120496 12093 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.122097 12359 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:30.127449 12338 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 12:14:30.025303 12276 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.066916  8998 rpcz_store.cc:276] 0709 12:14:28.292103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.292244 (+   141us) service_pool.cc:224] Handling call
0709 12:14:28.335160 (+ 42916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.411516 (+ 76356us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:28.710420 (+298904us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.166524 (+456104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.216678 (+ 50154us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.216882 (+   204us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.216931 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.217026 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.713063 (+496037us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:30.023752 (+310689us) raft_consensus.cc:1685] finished
0709 12:14:30.042404 (+ 18652us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.042564 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6579,"prepare.queue_time_us":350999,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":33908,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":68957,"spinlock_wait_cycles":25715968,"thread_start_us":608861,"threads_started":2,"wal-append.queue_time_us":569236}
I20260709 12:14:30.074465 12166 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:14:30.080101 12350 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.140527  8919 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:14:30.153978  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 86115.5us
I20260709 12:14:30.091548 12156 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:30.156232  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.084472 12333 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:30.156927  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 80352.2us
I20260709 12:14:30.094456 12354 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:30.158546  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 196348us
I20260709 12:14:30.164546 12340 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.166505 12276 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:30.164592 12387 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:30.185365 12290 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.186116  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 617) took 1097 ms. Trace:
I20260709 12:14:30.186612  9066 rpcz_store.cc:276] 0709 12:14:29.088950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.089117 (+   167us) service_pool.cc:224] Handling call
0709 12:14:29.102581 (+ 13464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.754177 (+651596us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b1800423be0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c33bfb 00007f3985c3e64b
0709 12:14:29.754373 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.754435 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.755057 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.900345 (+145288us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:29.900383 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.900444 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.185724 (+285280us) raft_consensus.cc:1685] finished
0709 12:14:30.185752 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.186030 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154125,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8962,"spinlock_wait_cycles":26517760,"thread_start_us":275850,"threads_started":2,"wal-append.queue_time_us":272773}
I20260709 12:14:30.188266 11968 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.171624  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.162546  8919 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:30.144587 12382 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.191661 12382 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.192018 12333 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.195313  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.196982  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.197535 12212 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.197714 12298 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.198096  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.198884 12298 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:30.200583  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.199208  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.201215  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.216370  8922 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:30.203927  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.204182  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.204705  8920 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:30.208755  8964 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.074s (SENT)
I20260709 12:14:30.221182  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.201588  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.222050  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.222678  8919 raft_consensus.cc:2368] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:30.193821 12382 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.225131  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.225818  8922 raft_consensus.cc:2368] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:30.225946  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:30.226883  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 138424us
I20260709 12:14:30.237092  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.238660  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.240697  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.245806  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:30.207955 12198 consensus_meta.cc:287] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.030s	user 0.010s	sys 0.002s
I20260709 12:14:30.250624  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.252054  8916 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:30.248900  9622 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:30.256541  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.265612  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:30.268086  9037 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:30.269132  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 252171us
I20260709 12:14:30.278721  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.279492  8924 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:30.253146  8820 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 6, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 6 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.285218  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:30.286190  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.199353 12298 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:30.290066  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:30.297683  9590 leader_election.cc:336] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 2.085s (SENT)
I20260709 12:14:30.239573 12212 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.299283  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.304957 12400 raft_consensus.cc:2804] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:30.317396 12353 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:30.317986 12400 raft_consensus.cc:697] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:30.201856 12286 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.200129 12219 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.317497 12214 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:30.303025  8820 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 6, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 6 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.283583 12344 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.317922  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109238us
I20260709 12:14:30.232761 12359 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:14:30.296788  9071 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:30.283188 12354 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.283697 12362 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8.
I20260709 12:14:30.284757 12276 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.295156 12290 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:30.343146  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.300264 12390 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.291756 12365 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:30.306507 12140 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:14:30.291652 12369 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:30.339967  8993 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:30.301412 12298 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.341079  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.299728 12382 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:14:30.318010 12353 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:30.335659 12367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.013s	sys 0.000s
I20260709 12:14:30.319409 12383 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.372313  8924 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:14:30.362756  8820 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 5, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:30.337708 12354 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.250075 12093 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.319106 12400 consensus_queue.cc:237] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.382054  8820 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 7, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.328801  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.385834 12369 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:30.386204  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69466.3us
I20260709 12:14:30.387279 12369 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.390694 12362 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:30.391350 12362 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:30.392263 12362 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.359362 12365 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.394088 12365 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.395578  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.396762  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.397832  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.398936 12207 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.399613 12207 raft_consensus.cc:2764] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:30.400252 12207 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:30.370607 12367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.013s	sys 0.000s
I20260709 12:14:30.372568 12383 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:30.404575 12383 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.406731  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 5, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 5 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:30.408473  8820 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 8 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.409989  8820 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 6, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 6 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:30.415154  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.415856  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:30.334913 12344 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.383419 12354 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.383989  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.423134  8924 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:30.368554  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.373792  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2605) took 1816 ms. Trace:
I20260709 12:14:30.418370  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.428936  9624 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:30.369150 12353 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.354584 12276 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.426415  9000 rpcz_store.cc:276] 0709 12:14:28.557161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.662479 (+105318us) service_pool.cc:224] Handling call
0709 12:14:28.729192 (+ 66713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:28.766148 (+ 36956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.766182 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:28.767136 (+   954us) log.cc:844] Serialized 52 byte log entry
0709 12:14:29.052402 (+285266us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:29.066647 (+ 14245us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.066863 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.066955 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.588520 (+521565us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b180032fb60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:29.592479 (+  3959us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b180032fb60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e522 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:29.699689 (+107210us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:30.127085 (+427396us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b24002bc478. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8d09d 00007f39857bf10e 00007f39857d688c 00007f39857d5bb6 00007f39857d57d8 00007f39857df221
0709 12:14:30.129611 (+  2526us) raft_consensus.cc:1685] finished
0709 12:14:30.129645 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.373563 (+243918us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54001b94d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:30.373714 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14097,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":13819,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":17983,"spinlock_wait_cycles":180051072,"thread_start_us":284752,"threads_started":1,"wal-append.queue_time_us":408373}
I20260709 12:14:30.450546  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:30.454102  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.370950 12398 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:30.430367 12332 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.000s
I20260709 12:14:30.464268  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.474550  9618 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:30.364849 12140 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.419755 12358 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:30.484159  9000 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:30.485419 11954 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.489177 12391 raft_consensus.cc:3055] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:30.496063  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.493287  9620 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:30.497498  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 129020us
I20260709 12:14:30.497988  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.498457  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.450549 12240 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.494850 12391 raft_consensus.cc:740] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:30.500609 12392 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.500629 12398 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:30.501348 12156 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.527678 12156 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:30.477731 12332 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.502700 12380 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:30.505692  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.533730  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.534477  8924 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:30.506448 12357 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.509922 12367 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:30.497579 11954 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.512882 12396 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:30.363899 12390 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:30.508958  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.521147 12392 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:30.549185  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43714.9us
I20260709 12:14:30.546973  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.567698  8924 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
W20260709 12:14:30.620684  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.649189  8923 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.521580 12358 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.657276  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:30.544538 12214 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:30.649549 12378 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.658146 11855 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:30.680182  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.680896  8916 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:30.657359 12407 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:14:30.664525  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.664852  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.692412  8924 raft_consensus.cc:2368] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:30.528797 12156 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.696074  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:30.696537 12408 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:14:30.696898  9621 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:30.697291  9071 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:30.697711  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 193498us
I20260709 12:14:30.672379  9620 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:30.674752  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.699414  9619 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:30.678542  8991 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:14:30.701151  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.658561 12240 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:30.662426 12332 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.650540 12392 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.705816  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.687644 12286 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:30.713464  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 315671us
I20260709 12:14:30.716500  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.717890  9617 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:30.718089  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:30.720096  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.720717  8999 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.720763  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.721822  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:30.724632  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.724550  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.724665  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.693014 12380 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.726995  8919 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:30.728806  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:30.730158  9621 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:30.730357  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:30.730859  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.730993  8991 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:30.734453  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.665354 12391 consensus_queue.cc:260] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.734712  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.729516 12362 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.729259 12369 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:30.735790  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.736214 12369 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.736541  8992 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:30.736688 12369 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.737217  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.737918  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.737924  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.739288  8995 raft_consensus.cc:2376] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8. Re-sending same reply.
W20260709 12:14:30.736348 12404 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:30.735677  8993 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:30.746835  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.778049  8922 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:30.774416  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.775667  9069 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:30.775429  9615 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:30.758206  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.782150  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.761673 12390 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.774058  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.767544  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.761224  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.740854  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.792402  8994 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:30.719365 12290 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.796669  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.760059  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.771175  9623 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.797931  8922 raft_consensus.cc:2410] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:30.762727  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.797402  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:30.743214  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.799865  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.801345  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.742513  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.738983 12207 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:30.812094 12207 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.777673 12365 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:30.767546 12406 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:14:30.814775 12365 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:30.768369 12344 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.811215  8995 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:30.811133  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.812546 12207 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.814891  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.810326  8996 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:30.815492  9072 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:30.815557 12381 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.836130  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.816090  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.804301  9071 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:14:30.820104  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60141.6us
I20260709 12:14:30.820618  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.787034  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.715628 12219 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.823859  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.838250  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:30.758414 12227 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.804481  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.827286  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:30.844107  9069 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.844249  8993 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:30.828308  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.829166  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:30.771956 12332 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.729681 12380 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.735679 12391 raft_consensus.cc:3060] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.857506  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.838394  9070 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:30.840201  9000 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:30.846791  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:30.866010  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.866313  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:30.851364  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:30.824790 11855 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:30.857478  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.872078  8995 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.735723 12362 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.860091  9624 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:30.860244  8889 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:30.861584  9069 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:30.867324  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:30.870831  9071 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:30.871035 12412 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.853055 12140 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.887600  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.854684 12332 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:30.875689  8994 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:30.805444 12290 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.880389  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:30.869985  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:30.892705  9070 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:30.846186 12373 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.837504 12381 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:30.770119 12214 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.826632 12398 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:30.862430 12380 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.760325 12212 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:14:30.894717  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.871708 12367 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.876415 11855 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.898725  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:30.876250 12413 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.876852 12276 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:30.913590  8923 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:30.891276 12350 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260709 12:14:30.939545 12350 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.940554 12290 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:30.942142  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:30.942595 12350 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:30.920253  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:30.946650 12362 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:30.904296 12286 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.951603  8994 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:30.952795  8992 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:30.924521  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.925293  9071 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:30.920001  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.898496 12198 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:30.901856 12382 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.956008  9074 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:30.935081 12416 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:14:30.956233  9070 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:30.984019  8999 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:30.962339  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.987704  9074 raft_consensus.cc:2410] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:30.989007  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.990454  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:30.968891 12298 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.003s
I20260709 12:14:30.991568 12298 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:30.993791 12298 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:30.993919  9621 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:30.994388  9068 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:30.962320  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:30.995608 12414 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:30.996723  8998 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:14:30.929452 11855 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.923945 12367 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:30.999394 12367 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.006628  9074 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:31.008340  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:31.020030  9074 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:31.021620  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:31.023301  9074 raft_consensus.cc:2376] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7. Re-sending same reply.
I20260709 12:14:31.024747  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:31.025704  8964 leader_election.cc:336] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.771s (SENT)
I20260709 12:14:31.026676  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.027637  9074 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:30.929293 12413 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.028589  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.916919 12370 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:14:30.962349 12418 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:14:31.035697  9074 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:30.976531 12353 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:30.931859 12398 consensus_queue.cc:1243] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:31.037050  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.037998  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:30.959913 12286 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:30.961776 12198 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:31.045950  9070 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:31.047295  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:31.047891  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.049075  9074 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:31.078529  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:31.033406 12413 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.984712 12354 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.033803 11855 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.113909 11855 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:31.086352 12397 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:14:31.040036 12367 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.087989  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:31.054308 12383 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.002s
W20260709 12:14:31.097995  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.046576 12286 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.959489 12332 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:31.131547  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.132380  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.121345  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:31.134323  9070 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:31.134806  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.046358 12198 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.128576  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.135344  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.140265  9070 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:31.136113  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:31.139433  9616 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:31.141577 12093 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.142186  9074 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:31.143205  9074 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.143503  9065 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:31.143699  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.144302  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.147369  9074 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:31.148697  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.149312  9621 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.145495  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:31.141633  9070 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:31.152271  9067 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.153826 12358 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.154373 12140 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:31.154836 12140 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:31.156515  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:31.157294 12140 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.158027  9071 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:31.158525 12140 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.149226 12007 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.175901 12358 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:14:31.161705  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.187151 12353 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:31.187852 12332 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.188231 12392 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.188647 12354 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:31.190928  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58616.1us
I20260709 12:14:31.139452 12383 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.190203  9621 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:31.192128  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:31.192983  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.145396 12093 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.193388 12383 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.194113  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.195427  8918 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.173699  9070 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:31.143086 12359 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.199426  9074 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:31.142899 12344 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.183976  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.198181  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.206337  8923 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:31.176285  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.207314  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.166149  9071 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:14:31.208345 12430 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.208628  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.209383 12430 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:31.202932  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.209753 12430 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.210175 12430 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.210362  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:31.195767 12093 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.205400  9070 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:31.211500  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:31.209774  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.221167 12265 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.211742 12353 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.190248 12392 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.231072  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.231642 12214 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.232053 12214 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.232403 12214 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.232358  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:31.233574  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.234606  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.183377 12367 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:31.239063  9590 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 2.615s (SENT)
I20260709 12:14:31.240144  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.242125  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.242375  9620 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.198684 12219 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.225858  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.264331  8919 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:31.175721 12096 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.205181 12359 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.204612 12007 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.266726  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.215550 12212 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.271302  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.236368 12428 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.264112 12392 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:31.184840 12207 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.299134 12207 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.299516  9620 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:31.299839 12207 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.300414 12207 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.271080 12391 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:31.302470 12391 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.258646 12286 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.303256 12353 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.305241 12391 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.266373 12219 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.292739 12396 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.307293  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:31.297084 12392 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:31.307910  9620 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:31.308519 12392 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.309772 12214 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.266554 12414 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.242934 12227 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.311718 12428 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.312148 12428 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.214802 12369 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.316706 12207 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.317035 12369 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.317823  8997 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:31.316322 12093 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.318295  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.295027 12007 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.273336 12359 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.320384 12007 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.320513 12093 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.321110  8919 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:31.324702  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:31.326311  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.329583  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.332919  8919 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:31.260061 12383 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.336330 12383 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:31.335088  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.337515 12383 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.193449 12198 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.340322  9620 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:31.342437  8919 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:31.342602 12198 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.345770  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.348950 12380 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.349511  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:31.383908  8920 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:31.384756  8919 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:31.364929 12413 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.386786 12380 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:31.388106  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 149061us
I20260709 12:14:31.393863  9621 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:14:31.396656 12093 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.397455 12093 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.400254 12093 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.410135 12430 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.414884 12359 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.422261 12428 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:31.424283  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 199201us
I20260709 12:14:31.424955 12096 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.441783  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.442142  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.449460  8966 leader_election.cc:400] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:31.450407  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.450707  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.453306  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.455792  9618 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.457562  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.450438 12207 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:14:31.452833 12298 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.458801 12207 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:31.459043 12298 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.461566 12298 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.452464 12369 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:31.478711  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:31.480290  8992 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 4.
I20260709 12:14:31.480834  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.482609  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:31.483503  8994 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:31.428814 12093 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:31.484102  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.478994  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.432464 12440 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:14:31.497534  8992 raft_consensus.cc:1240] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:31.497452  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.477619 12298 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:31.454661 12443 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:14:31.505426  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.505692  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.489078 12353 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.511595  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:31.510664  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:31.514384  9074 raft_consensus.cc:606] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.514858  9074 raft_consensus.cc:614] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:31.481771 12198 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:14:31.497171 12096 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.519515  8994 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:14:31.486558 12358 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:14:31.527051  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.528429  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.534001  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.545145  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.513187 12369 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.511209 12298 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:31.547802  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.550319  8994 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:31.519970 12160 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:31.547592  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 94372.6us
I20260709 12:14:31.520183 12370 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.552697 12160 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.562740  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.553187  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.543789 12265 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.545867 12396 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:31.563520  8992 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:31.565547  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60217.7us
I20260709 12:14:31.546525 11968 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.566736  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:31.567755  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 56237.7us
I20260709 12:14:31.551285 12443 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.567994  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.568948  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:31.548888 12276 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:14:31.564143 12359 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.564810 12430 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:31.584326  9000 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:31.564951 12265 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:31.588294  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.589870  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:31.593403  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:31.594826  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.575531 12353 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:31.606905  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.609544  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.596539 12265 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.616959  8995 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:31.596213 12428 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:31.605592 12359 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.600313 11630 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:31.625069  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79969.3us
I20260709 12:14:31.626247  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:31.628607  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59749.2us
I20260709 12:14:31.630185 12443 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:31.630502 12358 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.630945 12358 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:31.631124  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.633277 12358 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.633352 12456 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:31.627655 12448 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:31.640368 12448 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.640775 12448 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.641250 12443 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.613375 12353 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:31.654641 11630 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.654785 12357 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.656373  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:31.659727 12445 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:14:31.659658 12455 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:31.660068 12456 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:31.665295  8992 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:31.662017 12452 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:31.667310  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.622860 12298 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.671685 12198 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:31.672672 12198 consensus_queue.cc:1243] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:31.675884  8992 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:31.659221 12453 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.673362 12276 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.682245  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.684158  8925 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:31.683308  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:31.682245  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 72815.8us
I20260709 12:14:31.736271  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.737116  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.679709 12452 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:31.739153  9621 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:31.747308  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:31.749047  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:31.679984 12428 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 12:14:31.753250  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57676.1us
I20260709 12:14:31.758190  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:31.737926 12450 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.779873  8966 leader_election.cc:400] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
I20260709 12:14:31.780444  8966 leader_election.cc:403] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:31.716405 12396 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:14:31.692185 12430 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:14:31.784401 12454 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7.
W20260709 12:14:31.787143  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.787880  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.788250  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.789844  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.756909 11630 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.738040 12358 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.795434  9620 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:31.795722 12358 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.803581  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:31.752485 12452 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.780432 12458 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.799151 12454 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.798825 11630 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:31.828838  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.765775 12353 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.830199 12456 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:31.831575 12456 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.831974 12456 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:31.834995 12452 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.837989 12448 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.838238 12265 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.839268  8992 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:31.841343  8992 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:31.842185 11630 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.824733 12458 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:31.842875 12458 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.845680 12448 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:31.847457  8992 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:31.832973 12456 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:31.848884  8992 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:31.848999 12456 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.852639  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.857697  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.857745  8920 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:31.859283  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.860581  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:31.861801  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:31.793471 12354 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:31.863847  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.864713  8924 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:31.866219  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.867208  8992 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:31.863420 11968 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.856154 12369 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:31.873037  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:31.873068  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.873461  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:31.868481 12396 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:31.868973 12358 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.883538 12369 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:31.891726 12358 raft_consensus.cc:2764] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:31.906776  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:31.910632 12166 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:31.911125 12166 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:31.911732 12166 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.934465 12265 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:31.939491 11630 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.948812  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:31.949303 12358 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:31.952797 12453 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.953114  8993 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:31.903214 12369 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.942642 12166 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:31.967376  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2776) took 1192 ms. Trace:
I20260709 12:14:31.971773  9618 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:31.971457  9065 rpcz_store.cc:276] 0709 12:14:30.774689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.774894 (+   205us) service_pool.cc:224] Handling call
0709 12:14:30.775155 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.143873 (+368718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.966996 (+823123us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400421dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:31.967307 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846748288}
W20260709 12:14:31.975553  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69673.3us
W20260709 12:14:32.189646  9037 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.801s (SENT)
I20260709 12:14:32.190321  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.221518  8920 pending_rounds.cc:85] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 6
I20260709 12:14:32.221925  8920 pending_rounds.cc:107] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:32.222170  8920 raft_consensus.cc:2889] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.226449  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2775) took 1452 ms. Trace:
I20260709 12:14:32.226958  9067 rpcz_store.cc:276] 0709 12:14:30.774352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.774835 (+   483us) service_pool.cc:224] Handling call
0709 12:14:30.775155 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.152716 (+377561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.225996 (+1073280us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54000ad554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.226386 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866862080}
W20260709 12:14:32.245510  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 260097us
I20260709 12:14:32.222402 12357 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:32.225760 12353 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:32.225431 12457 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:32.272354 12464 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:14:32.275646  8992 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:32.273037  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 83459.7us
W20260709 12:14:32.277324  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.111806 12458 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:32.280287  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.283563 12354 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:32.278138 12457 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:32.313385  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.320639  9623 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:32.325850  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 74165.4us
I20260709 12:14:32.288658 12383 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:32.304068 12477 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.317276 12276 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 12:14:32.337126 12093 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:32.337725 12093 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:32.339355  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.341188 12457 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.342433 12414 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:32.326930 11630 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.343143 12414 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.330991  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.343884 12458 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:32.344339  9069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2266) took 1469 ms (client timeout 1729 ms). Trace:
W20260709 12:14:32.344998 12454 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 12:14:32.345387 12454 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.334784 12477 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:32.330900 12474 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:32.347354 12477 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.348750 12383 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:32.349153 12383 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.349452  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:32.350258  9000 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.350076 12383 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.351415 12479 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:32.352635 12480 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.353012 12480 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.353452 12479 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:32.353904 12286 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.353803 12480 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.359071  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:32.359377 12276 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.359853  8994 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:32.344693  9069 rpcz_store.cc:269] 0709 12:14:30.874852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.330699 (+1455847us) service_pool.cc:224] Handling call
0709 12:14:32.344273 (+ 13574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.355082 12480 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.363507 12383 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:32.364526 12428 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.365083 12428 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:32.366128 12428 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.369580 12381 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.372325 12214 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:32.373590 12413 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.381968 12376 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:32.385351  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.342617 12166 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.354161 12479 consensus_queue.cc:1243] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:32.307372 12354 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.394979  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:32.394882 12477 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:32.388387 12371 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.395185 12398 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:32.412014  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.413620  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:32.426090  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:32.435753  8991 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:32.409370 12381 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.408717 12428 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.338923 12093 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.462579  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:32.464870  8991 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:32.413151 12477 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:32.446127 12376 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:32.409403 12369 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.423838 12371 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.453485  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2625) took 1656 ms. Trace:
I20260709 12:14:32.442163 12398 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.466866  9000 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:32.469234 12376 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.473982  8991 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.469760 12093 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.476019  8994 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:32.481078  9000 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.471382  8999 rpcz_store.cc:276] 0709 12:14:30.797264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.996006 (+198742us) service_pool.cc:224] Handling call
0709 12:14:32.452520 (+1456514us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16eee 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:32.452744 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.453032 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.453072 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.453130 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:32.453179 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.453252 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.453403 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6753408}
I20260709 12:14:32.489460  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:32.470853 12477 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.492843  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2773) took 1719 ms. Trace:
I20260709 12:14:32.500795  9072 rpcz_store.cc:276] 0709 12:14:30.773734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.775340 (+  1606us) service_pool.cc:224] Handling call
0709 12:14:30.775673 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.835343 (+ 59670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.492583 (+1657240us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b5400422cd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.492780 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91109248}
I20260709 12:14:32.493422 12207 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:32.494699  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1339) took 1773 ms (client timeout 1801 ms). Trace:
W20260709 12:14:32.508747  8997 rpcz_store.cc:269] 0709 12:14:30.721264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.729046 (+  7782us) service_pool.cc:224] Handling call
0709 12:14:32.494451 (+1765405us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54003449d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:32.494622 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209155328}
I20260709 12:14:32.505838  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.488313 12482 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:32.495817  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1529) took 1632 ms. Trace:
I20260709 12:14:32.510812  8918 rpcz_store.cc:276] 0709 12:14:30.863413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.887152 (+ 23739us) service_pool.cc:224] Handling call
0709 12:14:30.894788 (+  7636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.196349 (+301561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.495514 (+1299165us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000da054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.495752 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690989312}
I20260709 12:14:32.514715  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.515378  8916 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:32.516172  8999 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:32.516991  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:32.517421  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.518070  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:32.510560 12483 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:14:32.521027  8997 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:32.521723  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.508526 12207 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:32.526505  8997 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:32.522843 12396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.014s	sys 0.010s
I20260709 12:14:32.534705  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.535475  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.518252 12286 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:32.524924 12460 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.021s	sys 0.019s
I20260709 12:14:32.546715  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:32.550170 12460 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.022s	sys 0.019s
W20260709 12:14:32.535494 12396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.015s	sys 0.010s
I20260709 12:14:32.547694  8921 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:32.557111  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:32.584753  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 95337.1us
I20260709 12:14:32.587736  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.555840 12396 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:32.590760  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.559290 12265 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:32.580130 12478 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:32.596190 12265 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.598361 12265 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.592052  8918 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:14:32.601975  8918 pending_rounds.cc:85] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 6
I20260709 12:14:32.602221  8918 pending_rounds.cc:107] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:32.602433  8918 raft_consensus.cc:2889] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.592087  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.606142  8917 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:32.548573 12286 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.625370 12286 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.548206 12487 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:14:32.534929 12477 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.588132 12207 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.583559 12354 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.589201 12371 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.626899 12207 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.627939  8916 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:32.628470  8916 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.629014 12398 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.629529  8916 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.630241 12396 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.633283  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.634217 12440 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.598912 12265 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:14:32.635615 12354 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:32.635967 12354 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:32.585615 12353 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:32.636765 12354 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.637521 12219 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:32.637390 12353 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.637951 12354 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.638952  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 629) took 2430 ms. Trace:
I20260709 12:14:32.639547 12353 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.639405  9068 rpcz_store.cc:276] 0709 12:14:30.208330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.214007 (+  5677us) service_pool.cc:224] Handling call
0709 12:14:30.242375 (+ 28368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.994762 (+752387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.638686 (+1643924us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.638883 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729084288}
W20260709 12:14:32.641108 12461 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:32.643251 12472 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:32.643652 12472 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.645097  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:32.634836 12440 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:32.626842 12477 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.645804  8999 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:32.630949  8916 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:32.650128  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62925.2us
I20260709 12:14:32.650960  9623 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:32.650410  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:32.651854  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:32.653961  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.654351  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.656112  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.656400  9618 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 6: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:32.657938  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:32.658056  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.659905  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:32.661552  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.664181  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.665201  8916 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:32.666447  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:32.667042  8999 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:32.651479 12478 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.658857 12286 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:32.647426 12414 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.662024 12494 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:32.676504 12494 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.676967 12494 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.675595 12482 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:32.683907 12482 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.684906 12482 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.687831  8991 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:32.654659 12219 consensus_queue.cc:1059] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:32.697042 12265 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.699115  8917 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:14:32.699561  8917 pending_rounds.cc:85] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 6
I20260709 12:14:32.699819  8917 pending_rounds.cc:107] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:14:32.700137  8917 raft_consensus.cc:2889] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.675587 12493 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:32.701992 12219 raft_consensus.cc:3055] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:32.702112 12493 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.702447 12219 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:32.702564 12493 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.702726  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1527) took 1919 ms. Trace:
I20260709 12:14:32.702972 12479 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:32.703498 12479 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.703466 12219 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.705185 12219 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.705322 12414 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.706113 12478 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.703263  8922 rpcz_store.cc:276] 0709 12:14:30.782864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.853832 (+ 70968us) service_pool.cc:224] Handling call
0709 12:14:30.854114 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.854307 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:14:30.978988 (+124681us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.979574 (+   586us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.702153 (+1722579us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b1800449260. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f39857f1d70 00007f39857e5293 00007f39857dacea 00007f39857db23a 00007f3985c45a2a 00007f3985c550bf 00007f3985c55038
0709 12:14:32.702397 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.702444 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:14:32.702490 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.702561 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.702672 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6367,"prepare.queue_time_us":303665,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":7709,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":4193,"spinlock_wait_cycles":98713472,"thread_start_us":124323,"threads_started":1}
I20260709 12:14:32.709105 12479 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.709852 12376 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.672883 12440 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:32.711982 12353 consensus_queue.cc:1175] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd11e77b4be14e658672599b30d51e76" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 12:14:32.712637 12472 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.713984 12472 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.715225  8921 raft_consensus.cc:2410] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:32.700068  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:32.740947  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.743788  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 82319.6us
I20260709 12:14:32.743736  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.745177  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:32.746599  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1512649809999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:14:32.744338  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 70607us
I20260709 12:14:32.747605  8999 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:32.748121  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.748690  8921 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.749050  8922 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:32.750182  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.750782  8916 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:32.750819  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.751876  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.754524  8925 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:32.754069  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.757882  8999 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:32.751860 12428 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:14:32.752044 12477 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.760097 12477 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.762003 12477 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:32.755084 12286 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.753050 12480 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:14:32.768189 12428 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:32.768316 12480 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:32.768870 12480 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.768848 12428 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.769924 12480 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.770526  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 658) took 1357 ms. Trace:
I20260709 12:14:32.771147 12480 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.778512  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.778762  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.779155  9072 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.780277  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.780820  9065 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.780864  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.781616  9067 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.772338 12494 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.771479 12428 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.772583 12160 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:32.783725 12160 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:32.784682 12160 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.785466 12494 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:32.786036 12160 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.771685  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:32.786804  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 838) took 2005 ms. Trace:
I20260709 12:14:32.752933 12207 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.752828 12479 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.776851  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.787165  9616 rpcz_store.cc:276] 0709 12:14:30.781769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.782408 (+   639us) service_pool.cc:224] Handling call
0709 12:14:31.131303 (+348895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.141094 (+  9791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.786609 (+1645515us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54006ab8d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:32.786752 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801640192}
I20260709 12:14:32.771834  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1348) took 2044 ms. Trace:
I20260709 12:14:32.787853 12479 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.788417  8998 rpcz_store.cc:276] 0709 12:14:30.727877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.943499 (+215622us) service_pool.cc:224] Handling call
0709 12:14:30.996477 (+ 52978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:30.997134 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.771644 (+1774510us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54000f4bd0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:32.771777 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121009920}
I20260709 12:14:32.786850  8999 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:32.790292 12479 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:32.755739 12353 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:14:32.778179  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.775643  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.791167  9068 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:14:32.791712  9069 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.792016 12156 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.770951  8993 rpcz_store.cc:276] 0709 12:14:31.412747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.840682 (+427935us) service_pool.cc:224] Handling call
0709 12:14:31.841013 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.962985 (+121972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.770293 (+807308us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54002373d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.770466 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257357696}
I20260709 12:14:32.789885  8998 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:32.793496  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.794108  9069 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:32.789239 12286 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:32.795348  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.796038  9069 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.797196  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.797905  9069 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.799517 12428 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:32.800066  9065 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:32.799554  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.800135  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.800957  9069 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:32.801494  9068 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:32.801910  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47923.5us
I20260709 12:14:32.802802  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.803184  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.803619  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.804049  8922 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:32.804553  9068 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.805258  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.805433  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:32.805881  8922 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.806430  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.806567  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.807358  8920 raft_consensus.cc:2410] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:32.807406  8923 raft_consensus.cc:2410] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:32.809072  8923 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:14:32.809240  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.810912  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:32.812902  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 656) took 1409 ms. Trace:
W20260709 12:14:32.813449  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.813779  9073 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:32.814384  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.814600  8922 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:32.815809  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:32.816112  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.816215  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.816496  9073 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:32.816823  9066 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.817462  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.819545  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.820446  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.821200  9067 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:32.821731  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.821913  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.823165  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.823694  9067 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:32.824446  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.824528  8918 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:14:32.825843 11968 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.825700 12428 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:32.826392 11968 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.827152  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 546) took 1142 ms. Trace:
I20260709 12:14:32.827524  9620 rpcz_store.cc:276] 0709 12:14:31.684690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.695644 (+ 10954us) service_pool.cc:224] Handling call
0709 12:14:32.826990 (+1131346us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54006f6654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:32.827087 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108225408}
I20260709 12:14:32.828598 11968 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:32.829433  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:32.830482 12207 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.834888 12207 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.836385 12481 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.836797 12481 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:32.837113 12207 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:32.837918  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.837704 12481 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:32.838816 12286 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:32.840257 12286 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:32.813272  8995 rpcz_store.cc:276] 0709 12:14:31.403104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.806054 (+402950us) service_pool.cc:224] Handling call
0709 12:14:31.806336 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.691424 (+885088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.691453 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.691491 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:32.691518 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.812693 (+121175us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54002f5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:32.812741 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.812848 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035095424}
W20260709 12:14:32.843771  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.846490  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.847263  9065 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
W20260709 12:14:32.850663  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.863786  8921 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:32.865351  9073 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:32.845856  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:32.868914  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.869973  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.871676  9620 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:32.878538  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:32.887019  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.887892  9073 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.889429  8921 raft_consensus.cc:1275] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:32.898226  9072 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:32.899199  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:32.899994  9072 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:32.838950 12481 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.907739  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 515) took 1223 ms. Trace:
W20260709 12:14:32.926133  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53912.3us
I20260709 12:14:32.926563  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.929922  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:32.934366  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:32.935366  9617 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 4.
I20260709 12:14:32.936383  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:32.939101  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70256.3us
I20260709 12:14:32.940155  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.945984  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:32.947513  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.948203  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.950634  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:32.953843  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.873536 12353 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.954198  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.908303  8919 rpcz_store.cc:276] 0709 12:14:31.684207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.684460 (+   253us) service_pool.cc:224] Handling call
0709 12:14:31.745362 (+ 60902us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:31.776240 (+ 30878us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:31.872949 (+ 96709us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.789768 (+916819us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b180036c160. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a
0709 12:14:32.790146 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.790318 (+   172us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:32.790873 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 12:14:32.790994 (+   121us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:32.791143 (+   149us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.845841 (+ 54698us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.907301 (+ 61460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.907430 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:32.907490 (+    60us) raft_consensus.cc:1685] finished
0709 12:14:32.907506 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.907669 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241575,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":1953,"raft.queue_time_us":127585,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":4685,"spinlock_wait_cycles":14701312,"thread_start_us":138840,"threads_started":2,"wal-append.queue_time_us":344978}
I20260709 12:14:32.952946  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:32.968593  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:32.841544 12286 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:32.873420 12428 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 12:14:32.958211 12470 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:32.934542 12494 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.979789  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:32.954947 12093 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:32.955022 12214 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:32.985966  9065 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:32.986411  9071 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:32.967540  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.946302 12477 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:14:32.945788 12344 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:33.025719  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.026254  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:32.992105 12392 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.972039 12353 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:32.995405 12480 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:32.965168 12499 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:32.946115 12413 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:33.036549  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:33.022258 12207 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:33.027642  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.045336  9067 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:33.001003 12381 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:33.031726  9072 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:14:33.059017  9066 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:33.024992 12354 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:33.064054  9067 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:33.065477  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.070036  9071 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:33.071930  9071 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:33.073146  9067 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:33.073393  9071 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:33.075516  9071 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:33.037417 12212 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.035756 12499 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.015121 12495 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:14:33.081053  9072 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:33.074777 12214 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:33.082990  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46536.3us
I20260709 12:14:33.038826 12093 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:33.014804 12494 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.035670 12367 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.029186 12378 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:14:33.067376 12381 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.063963 12344 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.078766 12219 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:33.095026  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 189703us
I20260709 12:14:33.079841 12353 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.100768  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.053640 12482 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:14:33.113947  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.114603  9617 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:33.115655  9620 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:33.109606  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:33.111327  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.111703  8991 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:33.066147 12207 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.062120 12491 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:14:33.088582 12499 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.089687 12471 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:33.118260  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.136004  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.138643  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.083143 12265 consensus_queue.cc:1048] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:33.140694  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:33.141407  8921 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:33.145787  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.086158 12354 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:33.148490  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:33.149641  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.108675 12381 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.151698  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:33.108834 12344 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:33.145305 12503 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:14:33.106034 12480 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:14:33.176110 12214 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.176819 12214 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.139060 12471 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.112540 12487 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:14:33.189440  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 157420us
I20260709 12:14:33.111256 12367 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.156121 12501 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:14:33.214494  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 136608us
I20260709 12:14:33.221225  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.146926 12172 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:33.150228 12478 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.153354 12276 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:33.138723 12353 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.224596  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.167256 12492 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:33.164283 12396 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:33.233268  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.238627  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:33.239753  9621 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.189901 12471 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.179179 12214 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:33.245371  9616 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:33.247619  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 100494us
I20260709 12:14:33.157160 12479 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:14:33.258930  9068 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:33.225961 12172 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:33.264500  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:33.265283  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.266430  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:33.230535 12333 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.230501 12518 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:33.281840  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.272631  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.238876 12219 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:33.215335 12093 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.288293  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:33.288679  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.273298  9621 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:33.239192 12396 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.292964 12396 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.233628 12492 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.293927 12492 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:33.285735  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 161797us
I20260709 12:14:33.269369 12265 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.230777 12478 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:33.314234  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 74046.1us
I20260709 12:14:33.316435  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:33.317158  9623 raft_consensus.cc:2368] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:33.310876  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:33.312388  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.287204 12219 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.281054 12398 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:33.320143  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65367.5us
I20260709 12:14:33.326172  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.294402 12381 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.320256  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:33.322160 12506 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 12:14:33.322572 12504 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:14:33.325477 12219 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.295924 12212 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:33.327859  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.344074  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:33.274367 12214 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:14:33.331265  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 56583.4us
I20260709 12:14:33.269158 12298 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:14:33.345738  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.340096  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:33.325789 12371 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.325358 12007 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:33.337503 12493 consensus_meta.cc:287] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 12:14:33.295462 12333 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.272181 12344 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.332901 12494 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:33.353832  9623 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:33.355049  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.342304 12383 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:33.401870  9616 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:33.409649  8922 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:33.354303 12371 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.415838 12515 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:14:33.416410 12371 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:33.417348 12513 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:33.392345 12383 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.417982 12494 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:33.418197 12383 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.418615 12494 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:33.345117 12366 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:14:33.419734 12366 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:33.420095 12366 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:33.421092 12500 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.420993 12366 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.422309 12366 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.356206 12007 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.424261 12514 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:14:33.333561 12172 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.338215 12517 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:14:33.418687 12333 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.421537 12500 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:33.416597 12156 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.003s
W20260709 12:14:33.402348 12506 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:33.462877  9615 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:33.337054 12526 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 12:14:33.476663  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 137537us
I20260709 12:14:33.356822 12522 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:33.491266  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 147014us
I20260709 12:14:33.491911  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.492079  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.492540  8994 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:33.332012 12398 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.386768 12207 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.513314  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.486112  8996 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:33.477545  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 147082us
I20260709 12:14:33.428066 12160 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.500206  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:33.521756  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.356761 12477 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:14:33.348450 12525 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:14:33.514961  8994 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:33.515188  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.518041 12007 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:33.510505 12156 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:33.357000 12493 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.527598  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.536547  9623 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:33.533206 12529 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:33.537724  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.514890 12367 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.534075 12477 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:33.533350 12534 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:33.491585 12522 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.524452 12214 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:33.514436 12448 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.526118 12545 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:33.521549 12353 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:33.521802 12333 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.519230 12160 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:33.419735 12494 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.467419 12528 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:14:33.563982  9070 raft_consensus.cc:2368] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8.
I20260709 12:14:33.552201  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.534962 12532 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.413697 12499 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.525064 12535 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:33.523545 12480 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:14:33.557214 12298 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.562871 12214 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.590585  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:33.593008  8994 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:33.588500  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 160632us
I20260709 12:14:33.529942 12207 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:14:33.594622  8889 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:33.564488 12522 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.602561  8994 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
W20260709 12:14:33.606076  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114099us
I20260709 12:14:33.606741  9066 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:33.590827 12333 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.613297  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58296.6us
I20260709 12:14:33.573931 12533 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:33.619071  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:33.619994  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.620939 12160 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.622665  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.633184  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:33.625233  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:33.625985  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:33.634927  9623 raft_consensus.cc:2376] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8. Re-sending same reply.
I20260709 12:14:33.627193  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:33.635180  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:33.627698  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.642776  9616 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:14:33.643983  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.597288 12214 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.570922 12448 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.589092 12537 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.603756 12545 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.609000 12526 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:33.648685  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.560518 12212 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.612191 12381 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.592777 12353 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:14:33.662405  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.665050  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:33.666031 12160 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.655558 12535 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.645277 12528 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:33.644840 12480 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:33.596926 12298 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.659329 12207 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.557308 12500 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.658277 12526 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:33.678165 12549 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.658785 12533 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:33.592161 12532 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.679699  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 214210us
W20260709 12:14:33.690263  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.691481  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.691123  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.675527 12480 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:33.671444 12528 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:33.698943 12548 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:33.700588 12480 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.667616 12535 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.701273 12531 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:33.684867 12549 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:33.658996 12545 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.706166 12398 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:33.764012 12548 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:33.715097 12527 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:14:33.764575 12548 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.735396  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.731720 12551 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:33.749696 12557 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:14:33.730747 12478 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.768414 12545 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:33.768689  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:33.769205 12478 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.770872 12535 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.720541 12552 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.772487 12552 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:33.772708 12371 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:33.773154 12371 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.773422 12552 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.774042  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:33.744413 12500 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.775913 12534 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:33.776551 12534 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:33.777688 12534 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.719689 12493 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:33.685245 12207 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.714555 12546 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:33.803198  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 112237us
I20260709 12:14:33.804316  8963 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.809276  8963 leader_election.cc:400] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:33.810482  8963 leader_election.cc:403] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:14:33.810977  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 142504us
I20260709 12:14:33.812875  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:33.769752 12478 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.814529  9071 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:33.817093  8963 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.819185  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:33.723984 12472 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.010s	user 0.010s	sys 0.004s
W20260709 12:14:33.724668 12481 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
I20260709 12:14:33.773495 12371 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.745349 12440 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.727968 12414 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:33.828632  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 234086us
I20260709 12:14:33.834404  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.723059 12298 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:33.734442 12532 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.784050 12531 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:33.839057  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.845042  9073 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:33.686568 12492 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.837007  8925 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:14:33.848824  8925 pending_rounds.cc:85] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 8
I20260709 12:14:33.849076  8925 pending_rounds.cc:107] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:14:33.849359  8925 raft_consensus.cc:2889] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.801524 12546 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.813700 12376 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:33.817512 12551 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:33.847330  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:33.714308 12396 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:33.851624  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.726434 12383 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.830061 12535 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:33.836159 12414 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:33.839398 12381 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.736591 12471 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.855000  9066 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:33.837250  8889 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:33.753784 12522 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.868988  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.872044  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:33.872257  8991 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:33.872676  8920 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:33.871141  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:33.869460  8994 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:33.843178 12559 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:33.871420  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:33.854692 12546 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.878875 12560 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.879952 12522 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:33.884471 12478 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.723992 12533 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.864171 12376 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.865842 12414 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.862520 12551 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:33.876916 12559 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:33.935961  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 98788.9us
I20260709 12:14:34.057368  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:34.009375  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.040518  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 223506us
I20260709 12:14:33.894543 12471 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:34.097085  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.894737 12207 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.088073  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:33.892923 12383 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:33.897001 12492 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.100129  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2197) took 1298 ms. Trace:
I20260709 12:14:33.841118 12526 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:33.876277 12381 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:34.098281  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 220225us
I20260709 12:14:34.116825  8995 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:34.115585  8925 rpcz_store.cc:276] 0709 12:14:32.801705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.801821 (+   116us) service_pool.cc:224] Handling call
0709 12:14:32.802109 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.849827 (+1047718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.099796 (+249969us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000ca8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:34.100051 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379217152}
W20260709 12:14:34.087634 12219 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.002s
I20260709 12:14:34.086501 12517 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.895345 12214 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.096131 12366 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:34.096356 12160 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:33.856626 12528 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:33.860793 12549 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.087961 12487 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:34.123668 12534 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.134330 12354 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.140509 12529 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:34.241183 12537 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.002s
I20260709 12:14:34.264015  9072 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:34.143301 12500 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:14:34.156733 12535 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:33.899430 12531 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.096444 12559 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.102770 12551 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.375725  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2808) took 1556 ms. Trace:
I20260709 12:14:34.378929  9071 rpcz_store.cc:276] 0709 12:14:32.851750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.076237 (+224487us) service_pool.cc:224] Handling call
0709 12:14:33.078027 (+  1790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.814953 (+736926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.375473 (+560520us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540026cad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:34.375660 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693319936}
I20260709 12:14:34.247174 12383 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:14:34.253264 12160 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.384434 12214 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.384434 12566 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.385360 12566 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.387324 12561 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.389055 12566 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.154203 12219 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:34.391388 12564 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:14:34.391438 12219 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.289950 12537 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.156543 12517 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.251106 12366 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.299830 12563 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.229s
W20260709 12:14:34.399528 12569 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:14:34.300700 12545 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.251787 12492 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:14:34.420377 12574 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.421140 12574 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.429332 12535 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.288959 12354 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.382205 12160 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:34.449972  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 297394us
W20260709 12:14:34.450158  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 299424us
I20260709 12:14:34.284749 12534 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.469656  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 529) took 1151 ms. Trace:
I20260709 12:14:34.471321  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:34.472654  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:34.470278  8921 rpcz_store.cc:276] 0709 12:14:33.318226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.318684 (+   458us) service_pool.cc:224] Handling call
0709 12:14:33.318983 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.529216 (+210233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.529252 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:33.529292 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:33.529322 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.469404 (+940082us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:34.469452 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.469591 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483071232}
W20260709 12:14:34.476341  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.443511 12376 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:34.479416 12376 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.443737 12396 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.451421 12531 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.487596  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:34.489006  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.483062 12561 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.490094  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.491544  8924 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:14:34.493461  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.493096  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:34.495846  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.496040  8920 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:34.439045 12545 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.462070 12428 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:34.524639  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.531160  9066 raft_consensus.cc:2376] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7. Re-sending same reply.
W20260709 12:14:34.488680 12548 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.001s
I20260709 12:14:34.507265  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.535465  9073 raft_consensus.cc:2376] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9. Re-sending same reply.
I20260709 12:14:34.506353  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.506435  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:34.537146  8917 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:34.506003  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:34.538694  8923 raft_consensus.cc:2410] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:34.537163  9069 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:34.465310 12160 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:14:34.489274 12219 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:34.571833  9071 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:14:34.576413 12413 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:34.577064 12532 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:34.577028 12413 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.577661 12532 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.578147 12532 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:34.581396  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 519927us
I20260709 12:14:34.582329  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.490731 12383 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:14:34.528385 12214 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:34.602331  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.496492 12561 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.551600 12574 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.609582  9615 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:34.542104 12381 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.606331  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:34.544095 12428 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.626865  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:34.599294 12494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.017s	sys 0.009s
I20260709 12:14:34.627564  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:34.579972 12413 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.640774  9615 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.639225 12212 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.625452 12540 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.642242  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:34.655644  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:34.656526  9068 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.595432 12539 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:34.646669 12517 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.659569  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.660164  9066 raft_consensus.cc:2376] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8. Re-sending same reply.
I20260709 12:14:34.646742 12354 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.647611 12551 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.648689  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:34.651064  9070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 645) took 1838 ms (client timeout 1742 ms). Trace:
I20260709 12:14:34.662010  9074 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:34.652923 12366 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:34.661923  9070 rpcz_store.cc:269] 0709 12:14:32.812134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.814157 (+  2023us) service_pool.cc:224] Handling call
0709 12:14:34.650851 (+1836694us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54002d41d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:34.650991 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721964928}
I20260709 12:14:34.593621 12576 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:34.657287  9065 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 6. Current term is 8. Ops: []
I20260709 12:14:34.661724 12212 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.544405 12548 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.693404 12548 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.653615 12559 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:34.639454 12494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.018s	sys 0.009s
I20260709 12:14:34.699523  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:34.700222 12428 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.700594 12540 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:34.702087 12560 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.776s	user 0.005s	sys 0.003s
I20260709 12:14:34.702715 12540 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:34.663210  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.580605 12219 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:34.700363  9066 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:34.646834 12489 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:34.757486  9615 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:34.702567 12560 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:34.819967  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.725925 12219 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.603048 12580 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.197s
I20260709 12:14:34.693616 12212 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.818652  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.625794 12214 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:34.720069 12371 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.003s
I20260709 12:14:34.792099 12540 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.841768  9066 raft_consensus.cc:2376] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10. Re-sending same reply.
I20260709 12:14:34.845731  9074 raft_consensus.cc:2376] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8. Re-sending same reply.
I20260709 12:14:34.703431 12413 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.854044  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:34.854808  9615 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:34.749626 12489 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:34.831025 12383 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.704217 12539 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.030056  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2656) took 1930 ms. Trace:
W20260709 12:14:35.038980  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.053297  8995 rpcz_store.cc:276] 0709 12:14:33.099909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.100307 (+   398us) service_pool.cc:224] Handling call
0709 12:14:35.029789 (+1929482us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.029962 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298376576}
W20260709 12:14:34.860294  9037 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.530s (SENT) [suppressed 44 similar messages]
I20260709 12:14:34.870355  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.859723  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:34.848033 12545 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:34.918453  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:34.883163  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:34.857260  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:34.849887 12580 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:35.064584  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.070058  9066 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
W20260709 12:14:34.942268 12414 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.003s
W20260709 12:14:34.919697 12562 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.081s	user 0.005s	sys 0.000s
W20260709 12:14:34.911111 12578 log.cc:927] Time spent T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.760s	user 0.001s	sys 0.000s
I20260709 12:14:35.072064  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.072268  9067 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:35.005488 12286 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.049142 12561 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:34.905225 12591 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:35.024441 12529 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:35.079026  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 218758us
I20260709 12:14:35.081977  9067 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:14:34.978845 12366 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.917420 12392 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:34.890504 12477 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:35.037802 12577 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.012979 12489 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.855707 12540 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.080090  9615 raft_consensus.cc:2410] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:14:34.942602 12448 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.086091  9074 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:35.107625  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.108498  9074 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:35.109428  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:34.900480 12546 consensus_meta.cc:287] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.001s
I20260709 12:14:35.097903 12286 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.110384 12546 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.086850 12529 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:35.111356  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 651) took 1496 ms. Trace:
I20260709 12:14:35.111960 12286 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:35.088243 12587 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:14:35.113613  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1380) took 1243 ms. Trace:
I20260709 12:14:35.114753  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2789) took 2300 ms. Trace:
I20260709 12:14:35.113943  8993 rpcz_store.cc:276] 0709 12:14:33.870003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.870170 (+   167us) service_pool.cc:224] Handling call
0709 12:14:33.887490 (+ 17320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.251554 (+364064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.251590 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.269642 (+ 18052us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.601683 (+332041us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.601718 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.601786 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.113407 (+511621us) raft_consensus.cc:1685] finished
0709 12:14:35.113425 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.113557 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":258234,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":4217,"thread_start_us":572638,"threads_started":2,"wal-append.queue_time_us":383952}
I20260709 12:14:35.115098  9065 rpcz_store.cc:276] 0709 12:14:32.814267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.025634 (+211367us) service_pool.cc:224] Handling call
0709 12:14:34.657110 (+1631476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.691500 (+ 34390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.114572 (+423072us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002d41d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.114700 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3720884096}
I20260709 12:14:35.116020  8922 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:35.116266  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:35.116858  9065 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.117483 12546 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.118158  9074 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:35.111900 12529 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:35.094600 12510 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.870s	user 0.002s	sys 0.004s
I20260709 12:14:35.120625 12529 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.083760 12591 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.121655  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1551) took 2318 ms. Trace:
I20260709 12:14:35.122586 12591 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.122009  8916 rpcz_store.cc:276] 0709 12:14:32.803084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.803283 (+   199us) service_pool.cc:224] Handling call
0709 12:14:32.803598 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.928411 (+124813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.928461 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.929036 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.060359 (+131323us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:33.060407 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.060482 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.093858 (+2033376us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:35.121349 (+ 27491us) raft_consensus.cc:1685] finished
0709 12:14:35.121370 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.121577 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124407,"raft.queue_time_us":142505,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2500,"spinlock_wait_cycles":17089920,"thread_start_us":130964,"threads_started":1,"wal-append.queue_time_us":225273}
I20260709 12:14:35.124327 12581 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:35.124779 12581 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:35.125626 12581 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.126886 12581 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.119166  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.111737  9068 rpcz_store.cc:276] 0709 12:14:33.615193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.615419 (+   226us) service_pool.cc:224] Handling call
0709 12:14:34.655110 (+1039691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.656938 (+  1828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.111141 (+454203us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002d41d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.111294 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390211968}
I20260709 12:14:35.099555  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.073076 12580 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:34.886294 12500 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.100453  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:34.871097 12534 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:35.097671 12531 consensus_meta.cc:287] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.002s
I20260709 12:14:35.128542  9074 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:35.138370 12214 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.105333 12477 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:34.855983 12413 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:35.105683 12584 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 12:14:35.137367 12571 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.991s	user 0.008s	sys 0.009s
I20260709 12:14:34.849798 12371 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.098737 12392 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:35.064319 12383 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.145861 12344 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.146324  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.145908  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.147954  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.102727 12366 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.128827 12539 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.132187 12489 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.156944 12333 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.157299 12371 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:35.157907  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.158334  9621 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:35.150719  9070 raft_consensus.cc:2376] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10. Re-sending same reply.
I20260709 12:14:35.147605 12214 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:14:35.106724 12577 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.162338 12577 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.165251 12499 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.141933 12286 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:35.193192 12286 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.193702 12286 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.195580  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.196381  9067 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:35.193898  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:35.198041  9072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 654) took 1574 ms (client timeout 2009 ms). Trace:
W20260709 12:14:35.198426  9072 rpcz_store.cc:269] 0709 12:14:33.623857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.627362 (+  3505us) service_pool.cc:224] Handling call
0709 12:14:35.197783 (+1570421us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54004218d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.197967 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442708352}
I20260709 12:14:35.086707 12414 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:35.168251  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.170410  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:35.208510  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.208873  9617 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 5: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:35.172895 12526 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.180930 12477 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.183348 12480 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.183485 12539 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.184151  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.184468 12549 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.183377 12521 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.224733  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.185784 12378 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.186753 12532 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 12:14:35.187031  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.236922  9068 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:35.187602 12546 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.189782  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:35.191639 12499 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.192057 12212 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.191881 12580 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.200914  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1381) took 1330 ms. Trace:
I20260709 12:14:35.148425 12534 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.210577  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.262138  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:35.261991 12534 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.262593 12583 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.210889  9065 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:35.210999  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.212407  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2660) took 1921 ms. Trace:
I20260709 12:14:35.263139 12583 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.264497 12534 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.263382  8999 rpcz_store.cc:276] 0709 12:14:33.290708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.291016 (+   308us) service_pool.cc:224] Handling call
0709 12:14:33.291462 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:33.753836 (+462374us) spinlock_profiling.cc:243] Waited 952 us on lock 0x7b1800322780. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c33bfb 00007f3985c3e64b
0709 12:14:33.754033 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.754074 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:33.754885 (+   811us) log.cc:844] Serialized 52 byte log entry
0709 12:14:34.053802 (+298917us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:34.124008 (+ 70206us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.211881 (+1087873us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b54003af5a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb6733 00007f3985c3bdbf 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c
0709 12:14:35.211960 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.212067 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.212143 (+    76us) raft_consensus.cc:1685] finished
0709 12:14:35.212161 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.212337 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21457,"prepare.queue_time_us":81661,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":1086810,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":6127,"spinlock_wait_cycles":11540608,"thread_start_us":324970,"threads_started":2,"wal-append.queue_time_us":361994}
I20260709 12:14:35.265247 12580 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.265486 12583 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.216526  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:35.267176  8918 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.220438  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.267990  8920 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:35.140161 12500 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:35.222786  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.208050 12518 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.235903  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.214201 12531 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.254920  8992 rpcz_store.cc:276] 0709 12:14:33.870308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.870428 (+   120us) service_pool.cc:224] Handling call
0709 12:14:33.886112 (+ 15684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.886508 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:33.897314 (+ 10806us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.136783 (+1239469us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:35.167527 (+ 30744us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b1800266080. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:35.179458 (+ 11931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.179979 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.180112 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.180145 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.180211 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.200725 (+ 20514us) raft_consensus.cc:1685] finished
0709 12:14:35.200743 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.200860 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":955831,"prepare.queue_time_us":12676,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1304010,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":1925,"spinlock_wait_cycles":167247616,"thread_start_us":245246,"threads_started":1,"wal-append.queue_time_us":248964}
I20260709 12:14:35.258924  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.266139 12588 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.214464  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.287801  8924 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:35.288938  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.283607  8925 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:14:35.285874  8916 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:35.292382  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.293066  8916 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:35.237883 12540 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.261336 12383 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.288615 12583 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.294180 12575 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.294286 12548 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:35.239096 12392 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.304751 12414 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.306633 12366 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.308281  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.225590 12539 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.255906 12552 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:35.317988 12531 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.254408 12546 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.273865 12499 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.313109  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.417601  8917 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:35.278502 12212 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.314484 12413 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.314961  8923 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:35.316710 12528 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.420419  8922 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:35.320384  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.324592 12500 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.328863  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.421370  8916 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:35.422056  8992 raft_consensus.cc:2410] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:14:35.391376 12560 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:35.330359 12557 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:35.330647  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.426549  8994 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.331142  8919 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:35.336205  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:35.331776  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.339834 12480 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:35.340535  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.342911 12579 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:35.345441  8996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2626) took 4529 ms (client timeout 1880 ms). Trace:
W20260709 12:14:35.438814  8996 rpcz_store.cc:269] 0709 12:14:30.803059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.835762 (+ 32703us) service_pool.cc:224] Handling call
0709 12:14:35.331937 (+4496175us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b5400236ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.332074 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6092225280}
I20260709 12:14:35.396992 12575 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.236562 12521 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.353726 12007 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.250630 12532 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.318197 12588 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:35.375537  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.437186 12530 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.382946 12537 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.383623  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1383) took 1512 ms. Trace:
I20260709 12:14:35.240355 12378 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.363463 12207 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:35.359520 12572 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:14:35.410290 12539 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.410718 12552 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.319044  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:35.329965  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.391638 12583 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.476297  8924 raft_consensus.cc:2410] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:35.423947  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:35.424381  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.477200  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.477679  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.448457 12566 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.476095  8993 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:35.425028  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.396809 12548 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.416456 12366 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.427640  8998 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.495090  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.496512  8924 raft_consensus.cc:2410] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:14:35.427651  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 91527.4us
I20260709 12:14:35.439993  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.499336  8996 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.289196 12518 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.441659  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:35.446883  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.379724 12477 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.443011 12383 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:35.465631  8994 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:14:35.469709 12212 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.480253  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.466617  8991 rpcz_store.cc:276] 0709 12:14:33.870962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.872993 (+  2031us) service_pool.cc:224] Handling call
0709 12:14:33.873300 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:34.137034 (+263734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.137069 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:34.154751 (+ 17682us) log.cc:844] Serialized 52 byte log entry
0709 12:14:34.491581 (+336830us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.568481 (+ 76900us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.023062 (+454581us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b48000cda58. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:35.360282 (+337220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.360363 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.360403 (+    40us) raft_consensus.cc:1685] finished
0709 12:14:35.383401 (+ 22998us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.383563 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1109758,"prepare.queue_time_us":77706,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1062842,"raft.run_cpu_time_us":11161,"raft.run_wall_time_us":895878,"spinlock_wait_cycles":4198144,"thread_start_us":599688,"threads_started":2,"wal-append.queue_time_us":505845}
I20260709 12:14:35.472867 12378 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.514892  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:35.520332  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.527465  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.540015  8993 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.502311  8992 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:35.541025  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.439734 12557 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.446345 12579 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.478005 12207 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.477053 12530 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.478440 12537 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.454710 12007 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.559725  8964 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:35.541761  8917 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:35.606427  8997 raft_consensus.cc:2410] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:14:35.581615  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.530794  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.564426  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:35.653162  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 88834.4us
I20260709 12:14:35.541949  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.653932  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:35.654600  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 432346us
I20260709 12:14:35.652529  8992 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:35.655891  8993 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:35.658382  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.660189  8993 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:35.622308  8918 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:35.661401  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.662031  8918 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:35.573064  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.646337  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 263292us
I20260709 12:14:35.656208  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.621970  8924 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:35.663762  8992 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:35.529886 12549 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:35.673789  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114137us
I20260709 12:14:35.674067  8924 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:14:35.541692  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.665904  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.666631  8996 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 5.
I20260709 12:14:35.676158  8991 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.676607  9617 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:35.664614  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.675060  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:35.679739  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.680235  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.655069  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:35.681092  8993 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:35.668268  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:35.669283  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 148609us
I20260709 12:14:35.676795  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.680622  8992 raft_consensus.cc:2410] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:35.577981 12575 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.678574 12559 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.687161  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.732820  9000 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:35.579520 12548 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.764544 12537 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.766284 12579 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.533752 12477 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.767656 12007 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.768603 12477 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:35.770617 12601 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:14:35.776594  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:35.779438 12413 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:35.780532 12413 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:35.781296 12413 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:35.781675 12413 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:35.576710 12521 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.568365 12286 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.790522 12286 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.791468 12530 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.792493  9040 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:35.793329  9040 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:35.795359  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.796422 12546 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.665887 12376 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.796986 12603 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:35.797343 12172 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.797667 12530 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.797308 12376 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.751755  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:35.798640  8993 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.639321 12499 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.553117 12516 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.803305 12552 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.803771 12516 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.804195 12516 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.754281 12535 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.804965 12535 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.673151 12378 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.807541 12378 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.807960 12605 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.808655 12605 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.809728 12378 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.758877  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.039572  8917 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:36.040706  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.041359  8917 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:36.042232  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.754259  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:35.754251  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 79240.9us
I20260709 12:14:36.429435  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:36.429469  8921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.007s	sys 0.016s
W20260709 12:14:36.430683  8921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.008s	sys 0.016s
I20260709 12:14:35.734746  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:35.760629  9616 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.061s
W20260709 12:14:36.518038  9616 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.297s	user 0.021s	sys 0.061s
I20260709 12:14:35.751171  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.553416  8994 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:36.553959  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1393) took 1193 ms. Trace:
I20260709 12:14:36.554227  8994 rpcz_store.cc:276] 0709 12:14:35.360383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.653363 (+292980us) service_pool.cc:224] Handling call
0709 12:14:36.553909 (+900546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.787346 12007 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.585716 12518 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:35.798070 12530 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.531157 12366 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.570053 12366 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.540697 12383 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:36.572207 12383 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:35.583552 12531 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.673700 12491 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:35.673861 12500 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:36.576102 12500 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.578070 12500 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.574364 12532 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.733090 12533 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:36.579877 12533 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.580261 12533 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.674659 12534 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:36.583976 12534 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:36.584415 12534 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.845396 12535 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.810720 12557 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.525564 12566 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:35.572032 12480 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.686782 12549 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.593448 12480 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.595376 12549 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:36.595645  8918 raft_consensus.cc:2410] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:14:35.578289 12583 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.641235 12588 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.816859 12572 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:36.599057 12572 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.599504 12572 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.600690  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.601312  8918 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:36.602119  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:35.817188 12603 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.604115 12603 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:35.810943 12605 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:35.897593 12286 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:35.821233 12499 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:14:36.610314 12499 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:36.610764 12499 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:35.928570  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 114485us
I20260709 12:14:36.614146  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:35.959921  8998 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:36.615105  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1388) took 1285 ms. Trace:
I20260709 12:14:36.615494  8998 rpcz_store.cc:276] 0709 12:14:35.329594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.331534 (+  1940us) service_pool.cc:224] Handling call
0709 12:14:36.615041 (+1283507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.616397  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.617238 12533 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.617596  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.618376  9619 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:36.618747  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:35.988919  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:36.620453  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1564) took 1349 ms. Trace:
I20260709 12:14:36.620805  8925 rpcz_store.cc:276] 0709 12:14:35.275990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.490359 (+214369us) service_pool.cc:224] Handling call
0709 12:14:35.988721 (+498362us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:36.620394 (+631673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665856}
I20260709 12:14:36.000514 12551 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.622164  8998 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:36.622277 12551 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.623745 12499 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.624666 12551 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:36.026343  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.625128 12499 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.676146  8924 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:36.038201  8992 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:14:36.626792  8924 pending_rounds.cc:85] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 4
I20260709 12:14:36.627091  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1401) took 1074 ms. Trace:
I20260709 12:14:36.043090  8917 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:14:36.627091  8924 pending_rounds.cc:107] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:36.627995  8924 raft_consensus.cc:2889] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:36.071671 12528 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.007s
I20260709 12:14:36.628355 12286 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:36.628815 12286 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:35.802994 12376 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:36.190165  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.206518  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.629148  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.629297 12286 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:36.629676  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:36.629773  9000 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:36.630302 12534 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.232057  8993 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:36.155042  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.631268  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1399) took 1164 ms. Trace:
I20260709 12:14:36.236866 12448 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:36.631629  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.261045  8999 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:14:36.263510  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 536) took 1053 ms. Trace:
I20260709 12:14:36.250808  8821 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.782627 12413 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.632296 12532 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:36.632321  8999 pending_rounds.cc:85] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 2
W20260709 12:14:36.292989  8991 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.002s
I20260709 12:14:36.633090  8991 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:36.633193 12528 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.627496  8992 rpcz_store.cc:276] 0709 12:14:35.553171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.686931 (+133760us) service_pool.cc:224] Handling call
0709 12:14:36.627031 (+940100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:36.633904  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.350543 12219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.023s	sys 0.048s
I20260709 12:14:36.631207  8918 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
W20260709 12:14:36.359767  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2211) took 1871 ms (client timeout 1580 ms). Trace:
W20260709 12:14:36.634598 12219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.024s	sys 0.050s
I20260709 12:14:36.381098 12617 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.635113  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.635792  8925 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:36.635461 12617 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.635926  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.636509  8918 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
W20260709 12:14:36.634819  8919 rpcz_store.cc:269] 0709 12:14:34.488340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.488455 (+   115us) service_pool.cc:224] Handling call
0709 12:14:36.359539 (+1871084us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54000cbcd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:36.359685 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919445760}
I20260709 12:14:36.636762  8821 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:36.637365  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.383993  9073 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:36.385380  9068 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:36.637921  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.638600  8919 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:36.639195  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.639649  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.640578  8919 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 5: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:36.640515  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.641152 12413 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.641662  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.641764  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.642295  8919 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:36.633800 12528 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.386531  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.386668  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.643520  9069 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:36.643662  9065 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:36.633008 12534 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:36.644349  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.638123  9073 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:36.391860 12479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.022s	sys 0.032s
W20260709 12:14:36.645885 12479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.023s	sys 0.033s
I20260709 12:14:36.405184 12589 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.407389  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.632905  8999 pending_rounds.cc:107] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:14:36.408176  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.647120  9620 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:36.629773  8924 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:36.647552  9618 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:36.636663  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.424532 12172 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:36.648475  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.649006 12172 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:36.649358 12172 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:36.649540  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.650202 12172 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.650594  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:35.666448 12344 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.426978  9066 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:36.422982  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:36.430187  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:36.432296  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:35.682017  8995 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:36.430183  9067 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:36.438378  9621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.002s
I20260709 12:14:36.443562  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:36.455315 12623 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.477766  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:36.481763 12540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.019s	sys 0.033s
W20260709 12:14:36.485904 12516 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.681s	user 0.015s	sys 0.000s
W20260709 12:14:36.486575 12580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.005s	sys 0.000s
I20260709 12:14:36.488075 12156 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.497084 12545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.005s	sys 0.015s
W20260709 12:14:36.512652  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.516090  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:36.523900  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44843.7us
I20260709 12:14:36.529894 12207 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:36.532295  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 577) took 1320 ms. Trace:
I20260709 12:14:36.537015  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 545) took 1257 ms. Trace:
I20260709 12:14:36.535301  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:36.542033  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1558) took 1272 ms. Trace:
I20260709 12:14:36.548110  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:36.550494 12392 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.555251 12093 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.557132  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:36.558251  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 543) took 1303 ms. Trace:
I20260709 12:14:36.560143 12007 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.566890 12530 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:36.575366 12491 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.592258 12566 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:35.817607 12559 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.597612 12480 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:35.981444  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1375) took 2638 ms (client timeout 1530 ms). Trace:
W20260709 12:14:36.149029  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.628400  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.630537  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.222878 12214 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.283847  9590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.005s	sys 0.001s
I20260709 12:14:36.632881 12532 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.633759  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2669) took 1288 ms. Trace:
I20260709 12:14:36.300743  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 858) took 1671 ms. Trace:
W20260709 12:14:36.302400  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.015s	sys 0.004s
I20260709 12:14:36.646013  9073 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.646890 12589 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.648120  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.423894  9071 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:36.424484 12560 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:36.408599  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:36.632447  8922 rpcz_store.cc:276] 0709 12:14:35.209759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.210265 (+   506us) service_pool.cc:224] Handling call
0709 12:14:36.263294 (+1053029us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003dfed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:36.263432 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357102080}
I20260709 12:14:36.651564  8925 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:36.647167  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.642879  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:36.653170  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:36.731797  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:36.916071  9621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.006s	sys 0.008s
I20260709 12:14:36.915930  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:36.916852  8997 rpcz_store.cc:269] 0709 12:14:33.343171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.343821 (+   650us) service_pool.cc:224] Handling call
0709 12:14:35.981124 (+2637303us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54002f6054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:35.981332 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5200593792}
I20260709 12:14:36.918238  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:36.918800  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.917340  8994 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:36.927659  9590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.010s	sys 0.006s
I20260709 12:14:36.927790  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 695) took 1125 ms. Trace:
I20260709 12:14:36.638111  8821 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 6, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 6 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:36.915060  8917 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:36.666553  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.928596  8991 rpcz_store.cc:276] 0709 12:14:35.345138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.665554 (+320416us) service_pool.cc:224] Handling call
0709 12:14:36.633702 (+968148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.929091  8998 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:36.929710  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.647050  8999 raft_consensus.cc:2889] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.928776  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1583) took 1156 ms. Trace:
W20260709 12:14:36.737399  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.929705  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 697) took 1127 ms. Trace:
I20260709 12:14:36.727461  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.931560  9072 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:36.931133  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 395931us
I20260709 12:14:36.932973  8998 rpcz_store.cc:276] 0709 12:14:35.802347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.623010 (+820663us) service_pool.cc:224] Handling call
0709 12:14:36.929657 (+306647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.918953  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.925724  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:36.919286  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.914131  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:36.677855  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.927812  9620 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:36.940290  9000 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:36.631880 12448 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.936501  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:36.931057  8917 rpcz_store.cc:276] 0709 12:14:35.772158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.628148 (+855990us) service_pool.cc:224] Handling call
0709 12:14:36.928718 (+300570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.928222  8994 rpcz_store.cc:276] 0709 12:14:35.801864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.555078 (+753214us) service_pool.cc:224] Handling call
0709 12:14:36.927730 (+372652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.933295  8924 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:36.915880  8921 rpcz_store.cc:276] 0709 12:14:35.255344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.255508 (+   164us) service_pool.cc:224] Handling call
0709 12:14:35.288129 (+ 32621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.422949 (+134820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.422978 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.439618 (+ 16640us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.431021 (+991403us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:36.431064 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.557868 (+126804us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540008acd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:36.557915 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.557970 (+    55us) raft_consensus.cc:1685] finished
0709 12:14:36.557982 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.558199 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1909,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":13106,"spinlock_wait_cycles":309228800,"thread_start_us":957262,"threads_started":1,"wal-append.queue_time_us":845912}
I20260709 12:14:36.916169  8916 rpcz_store.cc:276] 0709 12:14:35.279966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.557135 (+277169us) service_pool.cc:224] Handling call
0709 12:14:36.536296 (+979161us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:14:36.536505 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.536684 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.536711 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.536752 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:36.536781 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.536835 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.536961 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11160960}
I20260709 12:14:36.938341  8997 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:36.941496  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:36.970460  9000 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:36.943796  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 520850us
I20260709 12:14:36.944361  9068 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:36.932514  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1392) took 1574 ms. Trace:
I20260709 12:14:36.971447  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:36.971601  8995 rpcz_store.cc:276] 0709 12:14:35.357707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.667965 (+310258us) service_pool.cc:224] Handling call
0709 12:14:36.932462 (+1264497us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:36.928128  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 1.27302e+06us
I20260709 12:14:36.928735  9073 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:36.972653  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.657s	user 0.018s	sys 0.012s
I20260709 12:14:36.915807  8992 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:36.631640  8993 rpcz_store.cc:276] 0709 12:14:35.466588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.681655 (+215067us) service_pool.cc:224] Handling call
0709 12:14:36.631189 (+949534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.949668  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.950640  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:36.939205  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.942160 12344 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.952587 12207 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.952682 12480 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.941987 12214 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.878170 12606 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:36.954254  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 524121us
I20260709 12:14:36.915047  9616 rpcz_store.cc:276] 0709 12:14:35.212043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.212223 (+   180us) service_pool.cc:224] Handling call
0709 12:14:35.212575 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.212818 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:36.518481 (+1305663us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.531921 (+ 13440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.531982 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:36.532031 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.532104 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.532232 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":358036,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":100,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1310013,"threads_started":2,"wal-append.queue_time_us":11668}
I20260709 12:14:36.954854 12156 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:36.881115 12376 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.954308  8821 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 7, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 7 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:36.955651 12623 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.956771  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:36.957221 12534 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:36.958508  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1385) took 1629 ms. Trace:
I20260709 12:14:36.959056  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 862) took 1275 ms. Trace:
I20260709 12:14:37.005138  8999 rpcz_store.cc:276] 0709 12:14:35.328724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.329334 (+   610us) service_pool.cc:224] Handling call
0709 12:14:36.260628 (+931294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.930658 (+670030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.958314 (+ 27656us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54002f6050. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:36.958448 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141027072}
I20260709 12:14:37.005213  9621 rpcz_store.cc:276] 0709 12:14:35.684190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.684388 (+   198us) service_pool.cc:224] Handling call
0709 12:14:35.760711 (+ 76323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.761126 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:35.803637 (+ 42511us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.916825 (+1113188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.917278 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.917464 (+   186us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:36.917495 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.917572 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.958851 (+ 41279us) raft_consensus.cc:1685] finished
0709 12:14:36.958870 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.958990 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258,"prepare.queue_time_us":42599,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":193,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":18579,"thread_start_us":1109194,"threads_started":1,"wal-append.queue_time_us":491576}
I20260709 12:14:36.913944  9623 rpcz_store.cc:276] 0709 12:14:34.629039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.629181 (+   142us) service_pool.cc:224] Handling call
0709 12:14:34.643011 (+ 13830us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:34.643393 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.643422 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:34.644037 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:14:35.795930 (+1151893us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b18000f15a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:36.023070 (+227140us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:36.023479 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.026956 (+  3477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.027044 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.300418 (+273374us) raft_consensus.cc:1685] finished
0709 12:14:36.300520 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.300678 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":251320,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3595,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":11842,"spinlock_wait_cycles":21996032,"thread_start_us":226873,"threads_started":1,"wal-append.queue_time_us":1648227}
I20260709 12:14:36.952762 12219 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.960028 12566 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.961031 12589 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:36.927811 12491 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:36.692646 12212 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:36.673635 12528 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:36.686250 12617 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:36.962741  9620 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:36.964299  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:37.023341  8923 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:37.024268  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:37.024816  8923 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:36.915370  8920 rpcz_store.cc:276] 0709 12:14:35.269469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.275190 (+  5721us) service_pool.cc:224] Handling call
0709 12:14:36.427953 (+1152763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.455876 (+ 27923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.455909 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.456428 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:14:36.509234 (+ 52806us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:36.509294 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.509396 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.509463 (+    67us) raft_consensus.cc:1685] finished
0709 12:14:36.509480 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.541729 (+ 32249us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003dfed0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:36.541965 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26622,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":2576257792,"thread_start_us":79751,"threads_started":2,"wal-append.queue_time_us":36279}
I20260709 12:14:36.966557  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.025925  8998 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:37.026413  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 696) took 1224 ms. Trace:
I20260709 12:14:37.026717  8998 rpcz_store.cc:276] 0709 12:14:35.802125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.937775 (+1135650us) service_pool.cc:224] Handling call
0709 12:14:37.026358 (+ 88583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.969200  8889 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:36.918890  8922 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:36.992146 12588 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:37.027995  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.972689  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:36.979166  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.999114 12500 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.980690  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:36.980870  8996 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
W20260709 12:14:36.930553 12580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.014s	sys 0.001s
W20260709 12:14:36.853502  8854 debug-util.cc:398] Leaking SignalData structure 0x7b0800091840 after lost signal to thread 7719
I20260709 12:14:36.981338  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 687) took 1181 ms. Trace:
I20260709 12:14:36.982918  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2664) took 1639 ms. Trace:
I20260709 12:14:37.040408  8997 rpcz_store.cc:276] 0709 12:14:35.799987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.918733 (+1118746us) service_pool.cc:224] Handling call
0709 12:14:36.981277 (+ 62544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.040475  8993 rpcz_store.cc:276] 0709 12:14:35.343905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.982208 (+1638303us) service_pool.cc:224] Handling call
0709 12:14:36.982475 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.982641 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.982665 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.982703 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:36.982731 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.982778 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.982868 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.983829  8992 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:36.984545  8995 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:36.986006  9588 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:36.986316  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 549) took 1303 ms. Trace:
I20260709 12:14:36.978771  9617 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:36.987931  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:37.041849  8917 rpcz_store.cc:276] 0709 12:14:35.683161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.980034 (+1296873us) service_pool.cc:224] Handling call
0709 12:14:36.985595 (+  5561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.985841 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.985886 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.985950 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:36.986002 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.986077 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.986224 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:37.042580  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54727.6us
W20260709 12:14:36.993548  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.996029  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:37.045567  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 700) took 1242 ms. Trace:
I20260709 12:14:37.045992  8994 rpcz_store.cc:276] 0709 12:14:35.802996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.969237 (+1166241us) service_pool.cc:224] Handling call
0709 12:14:37.045492 (+ 76255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.997007  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:37.047159  8921 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:36.921698 12518 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.973161 12540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.439s	user 0.023s	sys 0.039s
I20260709 12:14:36.880188 12551 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:36.940117 12414 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.967698 12605 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.007715  8999 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:37.052002  8820 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 331) took 17545 ms (client timeout 15000 ms). Trace:
I20260709 12:14:37.009447  9073 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:14:37.053169  9073 pending_rounds.cc:85] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 9
I20260709 12:14:36.977726 12549 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:37.012926  8821 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:37.059270 12214 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.049503 12528 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:37.060338 12219 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.060652 12156 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.060851 12219 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.061656  8821 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.029752  8916 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:14:37.052062 12207 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:37.062898  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1579) took 1330 ms. Trace:
I20260709 12:14:37.063038 12207 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:36.980553  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.063560 12207 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.000825 12606 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.029996  8918 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:37.065796 12606 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.066421  8918 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:37.066879  8996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1394) took 1687 ms (client timeout 2104 ms). Trace:
W20260709 12:14:37.030210  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61091.8us
W20260709 12:14:37.011763 12545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.696s	user 0.005s	sys 0.026s
I20260709 12:14:37.063059 12219 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.035773  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:37.068703 12344 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:37.036221  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 63607.9us
I20260709 12:14:37.004436 12376 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.069953  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.070003 12605 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.071039 12376 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.071429 12589 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:37.072050 12589 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:37.072974 12605 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.072886 12589 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.060081 12533 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.075402  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 683) took 1343 ms. Trace:
I20260709 12:14:37.043344  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:37.075549  8821 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.077229  8821 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 6 to 5, leader changed from <none> to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 5 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:14:37.049769  8854 debug-util.cc:398] Leaking SignalData structure 0x7b0800342dc0 after lost signal to thread 8857
W20260709 12:14:37.050431  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70605.4us
W20260709 12:14:37.067261  8996 rpcz_store.cc:269] 0709 12:14:35.380014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.676566 (+296552us) service_pool.cc:224] Handling call
0709 12:14:37.066736 (+1390170us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400171e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:37.066828 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985456000}
I20260709 12:14:37.079312 12518 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:37.080044  8854 debug-util.cc:398] Leaking SignalData structure 0x7b0800302300 after lost signal to thread 8949
I20260709 12:14:37.080420  9070 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:37.081261  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08001df400 after lost signal to thread 9024
I20260709 12:14:37.041875  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2666) took 1697 ms. Trace:
I20260709 12:14:37.082041 12518 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.082679 12549 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:37.083921  8854 debug-util.cc:398] Leaking SignalData structure 0x7b080009b4e0 after lost signal to thread 9098
I20260709 12:14:37.010524  9000 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:37.053834  9073 pending_rounds.cc:107] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:14:37.085845  9073 raft_consensus.cc:2889] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.086135  8997 rpcz_store.cc:276] 0709 12:14:35.732350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.074279 (+1341929us) service_pool.cc:224] Handling call
0709 12:14:37.074698 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.074932 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.074969 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.075027 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:37.075073 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.075145 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.075326 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.052167  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2663) took 1708 ms. Trace:
I20260709 12:14:37.047679  8923 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:37.055274 12534 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:37.055405  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:37.087131  8995 rpcz_store.cc:276] 0709 12:14:35.343636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.983997 (+1640361us) service_pool.cc:224] Handling call
0709 12:14:36.984320 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.051901 (+ 67581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.052115 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.087666  8925 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:37.056258  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2668) took 1711 ms. Trace:
I20260709 12:14:37.057396 12623 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.057659 12551 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.053120 12617 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:37.060009 12528 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.062323  8994 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:14:37.041450 12480 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:37.103906  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1398) took 1655 ms. Trace:
I20260709 12:14:37.029520 12212 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.063323  8916 rpcz_store.cc:276] 0709 12:14:35.732379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.978719 (+1246340us) service_pool.cc:224] Handling call
0709 12:14:37.062839 (+ 84120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.070966  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.080240  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.083742 12549 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:37.051142  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65217us
I20260709 12:14:37.081898  8992 rpcz_store.cc:276] 0709 12:14:35.344420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.983223 (+1638803us) service_pool.cc:224] Handling call
0709 12:14:36.983502 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.041603 (+ 58101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.041820 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.004710 12603 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.067649  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:37.118896  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51319.5us
I20260709 12:14:37.120929  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:37.088287  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.121753  8995 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:37.122758  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:36.948833 12093 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:36.998236 12172 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.088304  8999 rpcz_store.cc:276] 0709 12:14:35.344892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.006871 (+1661979us) service_pool.cc:224] Handling call
0709 12:14:37.007507 (+   636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.055991 (+ 48484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.056206 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.085047 12007 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.126685  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.085629  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 685) took 1298 ms. Trace:
I20260709 12:14:37.127475  9000 rpcz_store.cc:276] 0709 12:14:35.787187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.941157 (+1153970us) service_pool.cc:224] Handling call
0709 12:14:37.085573 (+144416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.128379  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1577) took 1463 ms. Trace:
I20260709 12:14:37.128600  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.129375  9000 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:37.130600  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.088841  8821 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 2 to 5, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 5 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:37.092547  9070 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:36.970829 12516 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.002941 12383 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.094274  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.085086  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:37.087294  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.101583  8993 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:37.149271  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1396) took 1732 ms. Trace:
I20260709 12:14:37.149732  8993 rpcz_store.cc:276] 0709 12:14:35.416711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.052628 (+1635917us) service_pool.cc:224] Handling call
0709 12:14:37.101268 (+ 48640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.148947 (+ 47679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.149203 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.150799  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.104413  8994 rpcz_store.cc:276] 0709 12:14:35.448970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.061761 (+1612791us) service_pool.cc:224] Handling call
0709 12:14:37.062095 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.103504 (+ 41409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.103830 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.151793  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.152355  8994 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:37.153199  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.153771  8994 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:37.154613  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.106485  8996 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:37.155791  8995 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:14:37.156088  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.100699 12376 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:37.114020  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:37.085453  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0900 after lost signal to thread 9099
I20260709 12:14:37.160586  9618 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:37.049671 12500 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.099871 12588 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:37.138036 12286 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:37.052647  8820 rpcz_store.cc:269] 0709 12:14:19.506802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.514997 (+  8195us) service_pool.cc:224] Handling call
0709 12:14:37.051886 (+17536889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:31.034302 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:31.128000 (+ 93698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:31.128061 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:14:31.128080 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:31.153447 (+ 25367us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:31.153553 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:31.153583 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:14:31.155048 (+  1465us) tablet.cc:701] Row locks acquired
0709 12:14:31.155114 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:14:31.155359 (+   245us) write_op.cc:270] Start()
0709 12:14:31.155529 (+   170us) write_op.cc:276] Timestamp: P: 1783599271155276 usec, L: 0
0709 12:14:31.155562 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:14:31.187358 (+ 31796us) log.cc:844] Serialized 6677 byte log entry
0709 12:14:31.794170 (+606812us) op_driver.cc:464] REPLICATION: finished
0709 12:14:32.333735 (+539565us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f3982b310ac 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f3989671ef0
0709 12:14:32.573442 (+239707us) write_op.cc:301] APPLY: starting
0709 12:14:32.579215 (+  5773us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:32.604640 (+ 25425us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:32.604664 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:32.615837 (+ 11173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:32.616274 (+   437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:14:32.616347 (+    73us) write_op.cc:312] APPLY: finished
0709 12:14:32.616848 (+   501us) log.cc:844] Serialized 119 byte log entry
0709 12:14:32.643518 (+ 26670us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:32.643701 (+   183us) write_op.cc:454] Released schema lock
0709 12:14:32.643765 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:32.644230 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:32.644261 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1833797,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":745655,"apply.run_cpu_time_us":5141,"apply.run_wall_time_us":89586,"num_ops":17,"prepare.queue_time_us":192465,"prepare.run_cpu_time_us":8347,"prepare.run_wall_time_us":399831,"raft.queue_time_us":132716,"raft.run_cpu_time_us":41732,"raft.run_wall_time_us":757726,"replication_time_us":638421,"spinlock_wait_cycles":7996800,"thread_start_us":1175724,"threads_started":4,"wal-append.queue_time_us":305455,"wal-append.run_cpu_time_us":74490,"wal-append.run_wall_time_us":2122935}]]}
I20260709 12:14:37.145731  8991 raft_consensus.cc:2410] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:14:37.128944  8924 rpcz_store.cc:276] 0709 12:14:35.665366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.981692 (+1316326us) service_pool.cc:224] Handling call
0709 12:14:37.015998 (+ 34306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.048578 (+ 32580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.048609 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.048652 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:37.048683 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.128058 (+ 79375us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400018e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:37.128124 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.128303 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74467584}
I20260709 12:14:37.130823  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.157114  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.109982  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.172612  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 688) took 1372 ms. Trace:
I20260709 12:14:37.158887  8997 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:37.104722 12518 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.103672 12617 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:14:37.124284  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.186708  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.138331  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:37.149052  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:37.161849  8854 debug-util.cc:398] Leaking SignalData structure 0x7b080035e0e0 after lost signal to thread 9649
I20260709 12:14:37.188515  8999 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:37.188678  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7680 after lost signal to thread 12276
I20260709 12:14:37.123948 12534 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.165388 12531 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:37.166532 12551 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.167091 12212 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.173403  9074 raft_consensus.cc:2368] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6.
I20260709 12:14:37.179855  8994 rpcz_store.cc:276] 0709 12:14:35.800234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.171787 (+1371553us) service_pool.cc:224] Handling call
0709 12:14:37.172133 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.172318 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.172342 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.172383 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:14:37.172415 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.172464 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.172559 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.181658  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 690) took 1381 ms. Trace:
I20260709 12:14:37.257946  8995 rpcz_store.cc:276] 0709 12:14:35.800670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.180701 (+1380031us) service_pool.cc:224] Handling call
0709 12:14:37.181052 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.181268 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.181305 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.181362 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:37.181407 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.181475 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.181594 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.179687  8992 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:37.184224  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70325.4us
I20260709 12:14:37.073000 12207 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:37.189255  8854 debug-util.cc:398] Leaking SignalData structure 0x7b080037e7c0 after lost signal to thread 12381
I20260709 12:14:37.137061 12480 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:37.196622  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 684) took 1440 ms. Trace:
I20260709 12:14:37.171193 12588 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:37.175426 12533 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:37.212044 12617 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.173009 12603 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.177268 12376 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.248659 12534 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.211611 12518 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:37.179224  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48545us
I20260709 12:14:37.326351  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.271606  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:37.273319  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd640 after lost signal to thread 12471
W20260709 12:14:37.328166  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1580 after lost signal to thread 12541
W20260709 12:14:37.328603  8854 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9da0 after lost signal to thread 12553
W20260709 12:14:37.329596  8854 debug-util.cc:398] Leaking SignalData structure 0x7b080038f740 after lost signal to thread 12607
I20260709 12:14:37.102267 12572 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.176445 12528 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.276542  8997 rpcz_store.cc:276] 0709 12:14:35.756034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.158483 (+1402449us) service_pool.cc:224] Handling call
0709 12:14:37.158733 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.196272 (+ 37539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.196547 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.199172  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 692) took 1398 ms. Trace:
I20260709 12:14:37.336390  8991 rpcz_store.cc:276] 0709 12:14:35.801170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.198420 (+1397250us) service_pool.cc:224] Handling call
0709 12:14:37.198692 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.198856 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.198880 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.198920 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:37.198948 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.198998 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.199087 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.337292  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.279062  8994 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:37.339753  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 693) took 1538 ms. Trace:
I20260709 12:14:37.255752 12007 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:37.282881  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.284147  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 701) took 1480 ms. Trace:
I20260709 12:14:37.293702  9623 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.296514  8992 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:37.298754  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.299742  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.348698  9624 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:37.300040  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.349349  8992 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.350188  9615 raft_consensus.cc:2410] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:37.297081 12533 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.319010 12532 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.195561 12214 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:37.302868  9616 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:37.304549  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.336179 12534 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:37.307888  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 373275us
W20260709 12:14:37.383816 12632 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:14:37.385746  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:37.317032  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.387156  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.241068 12531 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.160394 12383 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.334410  8919 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:37.340183  8994 rpcz_store.cc:276] 0709 12:14:35.801389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.278421 (+1477032us) service_pool.cc:224] Handling call
0709 12:14:37.278755 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.339361 (+ 60606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.339680 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.280937  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 691) took 1480 ms. Trace:
I20260709 12:14:37.333313  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.336199  8997 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:37.356886  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 271862us
I20260709 12:14:37.392549  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2679) took 1035 ms. Trace:
I20260709 12:14:37.346781  8995 rpcz_store.cc:276] 0709 12:14:36.323769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.283368 (+959599us) service_pool.cc:224] Handling call
0709 12:14:37.283650 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.283834 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.283877 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.283916 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:37.283950 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.283998 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.284098 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.392930  8997 rpcz_store.cc:276] 0709 12:14:36.357399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.335563 (+978164us) service_pool.cc:224] Handling call
0709 12:14:37.335956 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.392318 (+ 56362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.392495 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.391885  9000 rpcz_store.cc:276] 0709 12:14:35.800931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.187741 (+1386810us) service_pool.cc:224] Handling call
0709 12:14:37.269231 (+ 81490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.269405 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.269429 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.269468 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:37.269497 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.269547 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.280785 (+ 11238us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b54003dc550. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:37.280884 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186535680}
I20260709 12:14:37.395117  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.397480  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.398869  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.351893 12634 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:37.351737 12212 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:37.368342  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 383125us
I20260709 12:14:37.354718 12533 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.353312 12448 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.381861  9622 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:37.367406  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:37.400260  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.380224 12559 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:37.460115  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.504253  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 136983us
I20260709 12:14:37.387650 12286 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.355481 12528 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:37.410565 12606 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:37.470541 12588 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.490051 12207 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.464949 12212 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.353574 12007 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.500541  9616 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:37.306041  8999 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:37.501652  9619 raft_consensus.cc:2410] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:14:37.501628  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 380761us
I20260709 12:14:37.386868 12532 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.393740 12531 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:37.462191  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64798.8us
W20260709 12:14:37.471625 12392 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 12:14:37.515831 12540 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:37.506170  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:37.516629  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 420964us
I20260709 12:14:37.473006 12214 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:37.527633  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 418677us
I20260709 12:14:37.497262 12551 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.534447  8889 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:37.536723  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.411064 12605 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:14:37.399204 12545 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:37.394932 12491 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.539983  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 686) took 1752 ms. Trace:
I20260709 12:14:37.569273  8993 rpcz_store.cc:276] 0709 12:14:35.799670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.167802 (+1368132us) service_pool.cc:224] Handling call
0709 12:14:37.168126 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.354433 (+186307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.354479 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.354536 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:37.354581 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.539686 (+185105us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002f5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:37.539744 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.539909 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427921280}
W20260709 12:14:37.569442  8917 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.006s
W20260709 12:14:37.571138  8917 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.010s	sys 0.006s
I20260709 12:14:37.576607  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.578900  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.579321 12286 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:37.579814 12606 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:37.547955  8921 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:37.580408 12606 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.548178  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 865) took 1036 ms. Trace:
I20260709 12:14:37.580485 12286 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:37.531358 12212 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.581121 12286 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:37.582325 12286 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.531114 12516 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.532600 12532 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:37.588119 12491 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.588578 12532 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:37.589461  9618 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:37.580902  9619 rpcz_store.cc:276] 0709 12:14:36.511940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.646921 (+134981us) service_pool.cc:224] Handling call
0709 12:14:37.547972 (+901051us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54006f6654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:37.548116 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312157952}
I20260709 12:14:37.591993 12286 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:37.592154 12491 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:37.593705 12491 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.580847 12606 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:37.555296  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49214.1us
I20260709 12:14:37.594765  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.596030  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:37.597456  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:37.598718 12634 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:37.599442 12634 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:37.599800 12634 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:37.600168 12634 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:37.601610 12606 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.601995 12532 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.579777  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.604781 12606 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:37.604991 12491 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:37.605446 12606 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:37.605613 12491 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:37.544020  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:37.497834 12480 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:37.607287  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 63392.4us
I20260709 12:14:37.538117 12093 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.614151  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.611789  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.615068  8992 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:37.606024  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:37.555536 12214 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:37.617586  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59156.4us
I20260709 12:14:37.558624 12219 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:37.625802  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.626668  8992 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:37.566741 12540 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:37.560403 12500 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.568951 12545 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.608153 12479 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.566431 12644 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:37.606022 12606 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:37.664955  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:37.683326  8993 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:37.625293 12214 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.559808 12551 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.620656 12383 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.628782 12603 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:37.704918  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.705830  9619 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:37.645546 12540 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:37.747025  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.747712  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.707634  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.712888 12551 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.713457 12383 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.716012 12606 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.717571 12643 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:37.718122 12623 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:37.653743 12172 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:37.718691 12639 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:37.725631 12533 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.734428 12007 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.654062 12545 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.735153 12572 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.737816 12532 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:37.744653  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:37.754593  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.788785  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:37.786055 12603 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:37.785311 12623 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:37.805213  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:37.803748  9624 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
W20260709 12:14:37.794559  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 218020us
I20260709 12:14:37.785048 12643 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:37.787447 12172 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:37.812809  9620 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:37.753286 12540 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:37.809893 12499 consensus_meta.cc:287] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.184s	user 0.012s	sys 0.003s
I20260709 12:14:37.758842 12518 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.681653 12479 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.818001 12623 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:37.817627 12643 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:37.864087 12636 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:37.867717 12533 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:37.904480 12656 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:37.907649 12603 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:37.932772 12617 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
I20260709 12:14:37.933561 12617 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.947142 12634 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:37.954984 12617 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.960588 12623 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:38.003911  8891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.008s	sys 0.017s
I20260709 12:14:38.005438  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1591) took 1020 ms. Trace:
I20260709 12:14:38.006153  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1580) took 2246 ms. Trace:
W20260709 12:14:38.006601  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.009742  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1590) took 1024 ms. Trace:
W20260709 12:14:38.005491  8888 connection.cc:256] RPC call timeout handler was delayed by -1.0886277089998657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:14:38.021237  8966 leader_election.cc:336] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.549s (SENT)
I20260709 12:14:38.145306  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:38.143791  8917 rpcz_store.cc:276] 0709 12:14:35.760149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.042775 (+1282626us) service_pool.cc:224] Handling call
0709 12:14:37.050447 (+  7672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.050709 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:37.571774 (+521065us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.005256 (+433482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.005383 (+   127us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:38.005486 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.005650 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.005963 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":573718,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":34078,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":252,"thread_start_us":936896,"threads_started":2,"wal-append.queue_time_us":304206}
W20260709 12:14:38.024019  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.787952  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2674) took 2436 ms. Trace:
I20260709 12:14:38.148504  8998 rpcz_store.cc:276] 0709 12:14:35.351843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.050616 (+1698773us) service_pool.cc:224] Handling call
0709 12:14:37.098950 (+ 48334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.099221 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:37.503198 (+403977us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.761260 (+258062us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.787381 (+ 26121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.787433 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:37.787483 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.787771 (+   288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.787895 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27272,"prepare.queue_time_us":546010,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":52595,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":11664,"spinlock_wait_cycles":23597184,"thread_start_us":659024,"threads_started":2,"wal-append.queue_time_us":407435}
W20260709 12:14:37.818604  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 418310us
I20260709 12:14:38.152643  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.154311 12479 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.154520 12623 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:38.032833  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 214357us
I20260709 12:14:38.157477  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2220) took 1631 ms. Trace:
I20260709 12:14:38.157891  8921 rpcz_store.cc:276] 0709 12:14:36.526320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.047984 (+521664us) service_pool.cc:224] Handling call
0709 12:14:37.060973 (+ 12989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.580613 (+519640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.156948 (+576335us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400414bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:38.157226 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107897728}
I20260709 12:14:38.159693 12366 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.160245 12366 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:38.033931  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 436372us
I20260709 12:14:38.160799 12588 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:38.161491 12286 consensus_meta.cc:287] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.007s
I20260709 12:14:38.161731  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:38.034950  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 430430us
I20260709 12:14:38.160791 12366 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:37.835534 12530 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.003s
I20260709 12:14:38.167313 12413 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:38.167908 12530 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.055853 12533 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:37.963311 12634 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:37.970741 12643 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:37.837497 12518 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.095312 12572 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.038120 12172 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.116595  8996 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:38.182173  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 551073us
I20260709 12:14:38.183971 12663 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:38.184612  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.184850 12413 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.117424 12647 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:38.187404 12647 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:38.189167  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:38.189015 12647 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.155117  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.191649 12533 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:38.192188 12533 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.192623 12533 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.193665 12540 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.194936 12639 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:38.181802 12518 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.196116 12572 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.196974 12639 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:38.197544 12639 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:38.197994 12518 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.198855 12572 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.140398 12376 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.143713  8925 rpcz_store.cc:276] 0709 12:14:36.987710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.100663 (+112953us) service_pool.cc:224] Handling call
0709 12:14:37.135615 (+ 34952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.135865 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:37.523983 (+388118us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.004030 (+480047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.004224 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:38.004439 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.004632 (+   193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.005057 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":517428,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":34856,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":340,"thread_start_us":841100,"threads_started":2,"wal-append.queue_time_us":396993}
W20260709 12:14:38.022895  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.143662  8891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.008s	sys 0.017s
W20260709 12:14:38.144393  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.142247 12638 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.580s	user 0.014s	sys 0.038s
W20260709 12:14:38.147676  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126829us
I20260709 12:14:38.144826  8918 rpcz_store.cc:276] 0709 12:14:36.984746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.086809 (+102063us) service_pool.cc:224] Handling call
0709 12:14:37.087138 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.353132 (+265994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.353171 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.357685 (+  4514us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.635247 (+277562us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:37.635299 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.635372 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.009063 (+373691us) raft_consensus.cc:1685] finished
0709 12:14:38.009111 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.009507 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17125,"raft.queue_time_us":24612,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":19377,"thread_start_us":427379,"threads_started":2,"wal-append.queue_time_us":405078}
I20260709 12:14:38.180931 12643 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.186126 12413 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.170936 12530 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.199669 12093 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:38.207702 12172 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.133988 12545 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.190953 12647 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.225484 12413 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.227643 12551 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.228132 12551 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:38.229436 12366 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.230144  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.218993  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.231948  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.232733  9618 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:14:38.232971  9065 raft_consensus.cc:2368] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8.
I20260709 12:14:38.233486 12413 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.229282 12551 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.206527 12639 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.231989  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.225375 12286 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:38.237366  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88896.4us
W20260709 12:14:38.238600  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.238884 12286 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:38.239949 12545 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.240231 12286 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.241083  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.243510  9074 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:38.243968  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.243852  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.245662  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 689) took 2445 ms. Trace:
I20260709 12:14:38.245745 12643 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.246842 12617 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:38.247990 12661 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:38.248586  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59617.9us
I20260709 12:14:38.249732 12661 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.250074 12606 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:38.250751  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.250389 12661 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.246627 12413 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.252768 12376 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:38.265033  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:38.278913 12219 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.011s
I20260709 12:14:38.279784 12605 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.279729  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.280414 12605 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:38.280560 12531 consensus_meta.cc:287] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.007s
I20260709 12:14:38.246186  8996 rpcz_store.cc:276] 0709 12:14:35.800454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.179960 (+1379506us) service_pool.cc:224] Handling call
0709 12:14:37.180266 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.182158 (+1001892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.245314 (+ 63156us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54002125d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:38.245574 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152138496}
I20260709 12:14:38.280846 12605 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.281428 12093 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.281721  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.282265 12093 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.282820  8921 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:38.280826 12214 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.007s
I20260709 12:14:38.284017 12214 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.286113 12376 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.286599 12376 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:38.286957 12214 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.288156 12413 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.287959 12376 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.288125 12214 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:38.289835 12376 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.290153  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.290921  9072 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.292131  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.292918  8922 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.184983 12663 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.247895  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.253144  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2224) took 1720 ms. Trace:
I20260709 12:14:38.263367 12545 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:38.254470  8966 leader_election.cc:336] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.580s (SENT)
I20260709 12:14:38.259124 12617 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:38.266039  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.252099 12551 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.274288  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:38.275960 12491 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.007s
W20260709 12:14:38.277513 12534 consensus_meta.cc:287] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.009s
W20260709 12:14:38.286615 12212 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.705s	user 0.017s	sys 0.004s
I20260709 12:14:38.281026 12531 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.280817  9618 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:38.246738 12643 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.279582 12219 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.310173  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:38.308450 12617 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:38.319746  9073 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:38.308421 12545 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:38.319993  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.277391  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:38.334057  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96450.9us
I20260709 12:14:38.291484 12093 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.335253  8918 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:38.337437  8917 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:38.337297  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.338060  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:38.342527  8919 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.342741 12540 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.298666  8920 rpcz_store.cc:276] 0709 12:14:36.532910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.052520 (+519610us) service_pool.cc:224] Handling call
0709 12:14:37.062862 (+ 10342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.085884 (+ 23022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.085913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.086354 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.351570 (+265216us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:37.547309 (+195739us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.555861 (+  8552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.555937 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.137898 (+581961us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:38.252519 (+114621us) raft_consensus.cc:1685] finished
0709 12:14:38.252671 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.252930 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39993,"prepare.queue_time_us":359781,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":177225,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":7357,"spinlock_wait_cycles":3427712,"thread_start_us":423387,"threads_started":2,"wal-append.queue_time_us":450951}
I20260709 12:14:38.352144  8922 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:38.331853 12545 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.362080 12207 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:38.362982  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 108587us
I20260709 12:14:38.377205 12207 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:38.379325  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.380981  8921 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:38.383440 12366 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.383653 12666 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.384280 12666 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.384769  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.385545  8923 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:38.386401  9624 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:38.386284 12617 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.386636 12666 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.388834 12617 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.393770 12643 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.335467 12534 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.400139 12588 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:38.403107 12531 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.339264 12491 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.405467  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.406848  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.343947 12212 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.411453 12534 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.405895 12491 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.385540  9073 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:38.398869  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:38.411084 12212 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.430301  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:38.435719  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.436800  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:38.441309  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.441680  9072 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:38.442574  9619 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:38.448479 12663 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.454460  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.442631 12219 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:38.465734  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.467621  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.468627  9618 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:38.468477  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.472848  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:38.474054 12678 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:14:38.474246  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.474866  8923 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.479550 12661 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.480379  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.480706  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.481123  8920 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.481491  8922 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.481691  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.483422 12219 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:38.483821 12219 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:38.484174 12219 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.487695  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.483076  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:38.488528  8922 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:38.489756  9040 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:38.490043  8920 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:38.491513 12663 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:38.492054 12663 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.492518 12663 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.495769  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.496660  8924 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 5.
I20260709 12:14:38.497638 12212 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:38.426512 12533 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.499536  9620 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:38.500006  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.500833  9074 raft_consensus.cc:2368] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:14:38.503226  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.503926  9074 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:38.509833 12533 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:38.511615  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:38.516192  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.520030  9624 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
W20260709 12:14:38.520745  8888 leader_election.cc:336] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.880s (SENT)
W20260709 12:14:38.528947  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.491122  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:38.514917  8923 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:38.539724  8966 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.740s (SENT)
W20260709 12:14:38.561296  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.566201  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:38.547717  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 148990us
W20260709 12:14:38.559402  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 139523us
I20260709 12:14:38.587975  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.591113  9074 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:38.571645  8963 leader_election.cc:400] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:38.563879  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.600935  8963 leader_election.cc:403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.564646  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.566684  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:38.605916  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 114885us
I20260709 12:14:38.565223  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.567986  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.565608  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:38.566107  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:38.567608  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:38.617259  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.618146  9617 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
W20260709 12:14:38.619148  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 47770us
I20260709 12:14:38.557667 12376 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:38.561041 12639 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:38.615780 12214 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:38.628625  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.633297  9616 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:14:38.630223  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.626003  9622 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:38.634328  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.535126 12605 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.644205  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.644845  9070 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:38.647535  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.639626  9588 leader_election.cc:400] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8.
I20260709 12:14:38.652036  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.652774  9072 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:38.653129  9615 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:38.653512  9070 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:38.654386 12214 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:38.654561  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.655455  9065 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.655485 12214 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.653539  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.660377 12491 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:38.660871 12491 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.659384 12580 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:38.661382 12491 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.662040 12617 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:38.663777 12666 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:38.665339  9618 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:38.640710  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:38.664160 12666 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:38.669883 12666 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.671290 12666 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:38.674744  9619 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:38.631827 12551 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:38.680487  9588 leader_election.cc:400] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:14:38.681005  9588 leader_election.cc:403] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:14:38.683838  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 163119us
W20260709 12:14:38.684298  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49526.1us
I20260709 12:14:38.684955 12531 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:38.687784  9073 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.690047 12603 raft_consensus.cc:2764] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:38.693199  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:38.634030 12376 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:38.705612  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.702936  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:38.699156 12639 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.714741 12639 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.641675 12545 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.712669 12580 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.711663  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.727135  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:38.729444  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 189784us
I20260709 12:14:38.733681  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.735507  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.734786 12606 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:38.737277 12606 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:38.740383 12617 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:38.715531 12533 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.746883 12376 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:38.747871  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 134546us
I20260709 12:14:38.743975 12606 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.744065 12588 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.747267 12644 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:38.751708  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:38.749570  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:38.757634  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:38.741061 12654 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.759624 12634 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:38.760433  8996 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:38.778465 12219 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:38.793763 12681 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:38.761224 12644 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:38.768415  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.801460  8923 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.769731  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.802150  8920 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:38.770008  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.770445  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.771196  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.771611  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.803704  8924 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.772455  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.780138  8925 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:38.781585  8919 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:38.804409  8916 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:38.782339  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.744480 12286 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:38.786147 12605 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.744138 12580 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:38.791791  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.792624  8963 leader_election.cc:400] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:38.792903  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.793017 12654 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.752146 12617 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:38.795498  9065 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:38.799940  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60744.1us
I20260709 12:14:38.822264  8963 leader_election.cc:403] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.823946  8998 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:38.825421  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.830607  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.831084  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.832000  9073 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:38.832171  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.832861  9071 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:38.832687  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.833194  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:38.833841  9067 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.832049  9066 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
W20260709 12:14:38.836150  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 43729.3us
I20260709 12:14:38.837708  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.838452 12093 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.838599  8963 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:38.839288 12207 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:38.839715 12207 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.840158 12207 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.806926 12286 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.842227 12286 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.843964  8922 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:38.844885  8917 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.849686 12617 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.851521  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:38.820109  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70660us
I20260709 12:14:38.823778  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.858964  8919 raft_consensus.cc:2368] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:14:38.805084 12376 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:38.754449 12588 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:38.867808  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59114us
I20260709 12:14:38.854956  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.826701 12654 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.874159  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.847609 12540 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:38.877149  8922 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:38.874409  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.878638  8992 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.824211 12634 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:38.884666  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.853018 12551 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:38.865988 12212 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:38.889935  8889 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:38.888283  8921 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:38.891099  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.897171  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.897984  9067 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:38.884522 12540 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:38.904284  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.905454  8919 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:38.916390  8923 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:38.907114  8922 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
W20260709 12:14:38.904286  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 67665.3us
I20260709 12:14:38.891072 12219 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:38.920073  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.870143 12376 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.899740 12639 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:38.934633  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.936378 12634 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.944190 12580 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.946626 12588 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:38.950767  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:38.953110  8889 leader_election.cc:400] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6.
I20260709 12:14:38.953413  8889 leader_election.cc:403] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.954007 12639 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:38.954466 12549 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 5. Current term is 6.
I20260709 12:14:38.954468 12639 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.955329 12639 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:38.963340  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.963882 12639 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.966353 12639 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:38.973991 12534 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:38.975297 12644 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:38.976959  9074 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:38.982764  8991 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:38.932483  9070 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:38.987169  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:38.910246 12540 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:38.992859  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:38.996301  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.997520  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.998677  9066 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:38.998871  9073 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:38.999452  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:38.999673  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.000344  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.001050 12207 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:39.003392  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.003602 12661 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:14:39.006060  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.009136  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.010155  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:38.995808  8924 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:39.060006  8917 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:38.918872 12551 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:38.918363 12212 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:39.044615  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.088186  8993 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.047256  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:38.962924 12533 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:14:39.061635  8921 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.088935  9000 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.060549  8919 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:39.024959 12376 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.076900  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:39.077145 12661 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:38.984892 12663 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:38.975142 12534 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:39.078956  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.100296  8991 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 5.
I20260709 12:14:39.080300 12207 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.080497  8992 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:39.081004  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:39.082314  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.082295  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 243772us
I20260709 12:14:39.086711  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:39.102972  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:39.106323  8916 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:38.979563 12545 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.081637 12551 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:39.109833  9066 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:39.096012 12661 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:39.132550 12661 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.133786 12661 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.110229 12605 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:39.115384  9070 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:39.116950 12663 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:39.099913 12534 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:39.117511  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.118357  9000 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
W20260709 12:14:39.119396  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.119287  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.119781 12588 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:39.121569  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:39.122277  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.152539  9616 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.122143 12207 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:39.123595  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:39.124032 12603 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:39.151729  9619 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:39.125027  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:39.147140  9071 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:39.126673  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:39.144188  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:39.157006  8924 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.146111  9072 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.124887  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:39.158247  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.161772  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.162309  8916 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.158190  8997 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.172727  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.176364  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.176826 12376 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:39.177093  9070 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:39.177268 12376 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:39.178077  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.178828  9066 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:39.179483  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.179584  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.180357  9065 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:39.180730  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.181190  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.181455  9066 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:39.182375  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.182678  9065 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:39.183696  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.184356  9071 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:39.184623  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.185254  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.178082 12376 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.187304 12376 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:39.188210  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61638.1us
I20260709 12:14:39.191717  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:39.192924  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:39.193775  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.194362  9000 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:39.188277  8924 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:39.196406  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:39.196601  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:39.179425  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:39.199507  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.188979 12580 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:39.199717  9072 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:39.189603  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.190263  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.190822  9616 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:39.200935  9067 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.204020  8997 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:39.168156 12603 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:39.209568  9069 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:39.209955 12606 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:39.210615 12606 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:39.210760 12603 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.211616 12606 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:39.212311 12212 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:39.210770 12551 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.215693 12534 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.216713 12534 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.134959 12654 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.221341  9067 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:39.223676  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:39.226059  8966 leader_election.cc:336] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.890s (SENT)
I20260709 12:14:39.226745  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.226958  8916 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:39.229622  8919 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:39.235083  9067 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:39.218891 12666 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.004s
I20260709 12:14:39.252499  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.255622  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.259346  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.259573  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.260214  9069 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:39.261438  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.261772  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.262068  9068 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:39.262333  8992 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.280040  8917 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:39.280503  8917 pending_rounds.cc:85] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 4
I20260709 12:14:39.285804  8993 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:39.206687 12580 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:39.296007  8992 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:39.281574 12533 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.311537 12654 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:39.311405 12286 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.218081 12531 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:14:39.313678 12286 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.299383 12580 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:39.314968 12491 consensus_meta.cc:287] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.005s
I20260709 12:14:39.315438 12491 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.317606 12491 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:39.321470 12692 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.322039 12692 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.324235 12692 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.328773 12093 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:39.334713  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.280745  8917 pending_rounds.cc:107] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:39.345603  8917 raft_consensus.cc:2889] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.348222  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.352859  8921 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:39.350134  9000 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.358529  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:39.358397  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.359206  8924 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.345199 12588 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.364744  8993 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:39.365983  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 143338us
W20260709 12:14:39.390540  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.281795 12413 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:14:39.357148 12639 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.421300  8924 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:39.448328  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:39.475266  9000 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:39.362718 12214 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:14:39.483114  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.492839  9000 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.411209 12588 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:39.499137  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:39.484220 12549 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.490010 12605 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:39.507741  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.500142  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.510272  9068 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:39.520192  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 321339us
I20260709 12:14:39.505789 12551 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:39.522416  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.524472  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.537627  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.539784  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.540555  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.541427  9072 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.537748  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.540714  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:39.550835  9000 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:39.552502  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.559619  9619 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.561197  8995 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:39.561686  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 365361us
I20260709 12:14:39.563561  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.564152  8994 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.565749  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.566313  9000 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.569110  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.572788  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:39.579739  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:39.583077 12695 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:14:39.584722 12693 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:14:39.586844 12694 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:14:39.588773 12696 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:39.589673  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.590193  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:39.591737  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.594502 12549 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:39.594986 12549 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.590432  8999 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:39.595574  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.596063 12588 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:39.628191  8924 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:39.628764  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.599738  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.600610  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:39.601866  9624 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:39.602247  9072 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:39.631191  9068 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:39.631636  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:39.632355  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.602531  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:39.632867  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.606842  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.633543  9074 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:39.633791  8921 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:39.599795 12705 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.608855  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.637377  9070 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:39.637488  9617 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:39.610010  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.614056  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:39.560164 12699 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:39.541234 12551 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:39.610940 12605 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:39.520901 12540 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.623692  9615 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:39.603878  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:39.635509  9623 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:14:39.634971  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 90395.2us
I20260709 12:14:39.647775  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.636173  8996 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:39.639640  9066 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.642493  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.643599  8994 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:39.650838  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.647357  8998 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:39.657051  9072 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:39.662015  9068 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:39.637081 12705 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:39.669305  8998 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:39.673099  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:39.673903  8991 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:39.676132  9067 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.664508  9000 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:39.688330  9618 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:39.675869  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.714179  8999 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:39.655033 12093 raft_consensus.cc:2764] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:39.646636 12172 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:39.730667  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:39.733074  8994 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:39.717484  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.721397  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:39.738265  9068 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.674651 12644 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.710049 12588 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.744153  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:39.742529  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.676855 12705 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:39.759372  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.803361  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59627.2us
I20260709 12:14:39.675539 12634 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:14:39.646726 12699 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:39.820941  9590 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.947s (SENT)
I20260709 12:14:39.815104  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:39.821682  9072 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:39.819166  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:39.778178 12545 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.815819 12666 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.803382 12644 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:39.860606  9620 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 4.
W20260709 12:14:39.865196  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 46093.2us
W20260709 12:14:39.868878  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 296358us
I20260709 12:14:39.783831 12588 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.745915  9073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:39.887060  9073 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:39.887641  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:39.887635  9073 raft_consensus.cc:614] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:39.870163 12666 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:39.868584  9068 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
W20260709 12:14:39.884289 12580 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.001s
I20260709 12:14:39.834692 12605 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.868515 12663 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:14:39.884933 12701 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:39.869779 12545 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:39.919094  9619 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
W20260709 12:14:39.929153  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45051.6us
I20260709 12:14:39.906870 12704 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:39.931288 12719 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:39.931901 12706 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:39.931599 12701 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:39.932564  8966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.793s (SENT) [suppressed 64 similar messages]
I20260709 12:14:39.972031  8996 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:39.933373 12666 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.860132 12551 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:39.912926 12207 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:14:39.981081 12207 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:39.893007 12691 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:14:39.901819 12690 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.264s
I20260709 12:14:39.940986 12545 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:39.911511 12634 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.942415 12588 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:39.943106  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:39.944082 12699 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:39.945127  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67261us
W20260709 12:14:39.986922  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43889.7us
I20260709 12:14:39.957015  9622 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:39.968140  9621 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:14:39.987720 12699 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:39.944496 12540 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:40.002246 12549 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.009234 12549 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.018241  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.019232  8916 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:39.995759 12715 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:14:39.996569 12718 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:14:40.000241 12724 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:40.025202  8919 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:39.913204 12580 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.027602 12699 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:40.036373 12700 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:14:39.991355 12704 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:40.039255  9040 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.041522 12701 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:40.015599 12644 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:40.020421 12376 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 12:14:40.059228  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.076354  8923 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
W20260709 12:14:40.078241  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56581.7us
W20260709 12:14:40.090354  8966 leader_election.cc:336] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.576s (SENT)
W20260709 12:14:40.091130  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 205234us
I20260709 12:14:40.059682 12603 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:40.094413  8966 leader_election.cc:336] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.623s (SENT)
I20260709 12:14:40.095041  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.099323 12603 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.099978 12603 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.075004 12212 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:14:40.104112  8966 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.623s (SENT)
I20260709 12:14:40.104686  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.105706 12691 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:40.106053  8966 leader_election.cc:336] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.726s (SENT)
I20260709 12:14:40.106408 12691 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:40.117724 12727 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.118511 12727 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:40.118963 12727 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.117842  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.123423  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.117779  8919 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:40.126171  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.129889 12716 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.130710 12716 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.133657 12716 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.136098 12727 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.138720 12727 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.143465 12699 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.145318  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.148113  8924 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:40.048493 12724 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:40.162021  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 54686.7us
I20260709 12:14:40.160554  8925 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.174576  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.196987  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:40.214918  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 69777.8us
I20260709 12:14:40.216223  9624 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:40.217752  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.159354 12534 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:40.222347  9623 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:40.182473 12551 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:40.223090  8966 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.851s (SENT)
W20260709 12:14:40.228215  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.183881 12727 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.183528 12661 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:40.234450  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 78360.3us
W20260709 12:14:40.263820  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81525.6us
I20260709 12:14:40.269783  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:40.236058 12727 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.273409  8925 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:40.263463 12588 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:14:40.278533 12733 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:14:40.273643  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.280835  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.280673  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.284864  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.237062 12534 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.287995 12531 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.288554 12531 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.288946 12531 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.290213 12534 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.287066  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.268239 12606 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.291662  8925 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:40.291800 12606 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.293845  9622 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.293933  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:40.294085 12606 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:40.269032 12716 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.294667  9621 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.294863 12716 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:40.295406 12716 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.296748  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:40.299602 12730 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.299712  9621 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:40.300282 12730 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:40.302726  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 85492.9us
W20260709 12:14:40.303871  8966 leader_election.cc:336] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.922s (SENT)
I20260709 12:14:40.304279  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.310063  8916 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.310213  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.273916 12691 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.280601 12727 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.317539  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.320327  8925 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:40.185199 12704 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.320626 12606 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:40.321507 12605 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.322001 12605 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.265798 12661 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.307783 12580 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.332494  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.305286 12551 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:14:40.337455  9621 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:40.335901  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.314255 12690 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.317324 12691 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:40.340086  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62771us
I20260709 12:14:40.323227 12605 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.334522 12207 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.347584  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:40.346056  8888 connection.cc:256] RPC call timeout handler was delayed by -2.1636146669998197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 12:14:40.337270 12588 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.347438  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.318815 12531 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:40.351882  8888 connection.cc:256] RPC call timeout handler was delayed by -1.129629752000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 12:14:40.343813 12691 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:40.353433  8888 connection.cc:256] RPC call timeout handler was delayed by -1.0369297520001055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:14:40.362568 12734 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:14:40.363845 12739 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:14:40.363727  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.348870 12745 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:40.364821 12731 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:14:40.365470 12745 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:40.366493 12745 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:40.367764 12736 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:14:40.368135 12745 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.375837 12724 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:40.375978  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.378785  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.352517 12605 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.388320 12661 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:40.389014 12735 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:14:40.389315 12720 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:40.389741 12720 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.389894 12730 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:40.390645 12720 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.391718  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.392064 12720 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.391891 12603 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.395282 12603 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:40.396256 12737 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:40.380843 12705 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.004s
I20260709 12:14:40.403780 12705 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.405443 12737 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.406702 12705 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:40.406922  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.412357 12732 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.416478  8925 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:40.419967  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.420665  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.468710  8917 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:40.421577  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.422489  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:40.464111  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 154043us
I20260709 12:14:40.469669  8920 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:40.423005  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.423684  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.423684  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.469980  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.470230  8916 raft_consensus.cc:2368] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 5. Current term is 6.
I20260709 12:14:40.468182 12732 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:40.471314  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.471405  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.466326 12716 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.472170  8917 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:40.472427  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.473122  8916 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.451510  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.473845 12716 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.474151  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.474337  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.474485 12716 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.475266  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.475739  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:40.476696  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:40.478440  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.446597 12737 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.479370 12737 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:40.463830 12727 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.480713  8922 raft_consensus.cc:2368] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
W20260709 12:14:40.455288  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.460843  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 89301.4us
I20260709 12:14:40.481767 12727 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.471587 12732 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:40.434237  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 613278us
I20260709 12:14:40.475342  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.472930  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.484081  8917 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 5.
I20260709 12:14:40.485430  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.433847 12531 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.486423  8918 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:40.475227 12716 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.453878  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:40.472060  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.485682  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.479871 12737 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.470408  8921 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:40.488695  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.492265  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.493064  9072 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
W20260709 12:14:40.493949  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.489061  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.489830  9073 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.491549  8964 leader_election.cc:400] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:14:40.489835 12207 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:40.496161  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.496270  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.498309  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.498577  9069 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:40.498823  9065 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:40.499017  9071 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.497027  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.499639  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.500365  9067 raft_consensus.cc:2376] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9. Re-sending same reply.
I20260709 12:14:40.501202  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.501377  9066 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 8: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.501780  8924 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.490118 12376 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.503727 12207 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:40.503904 12580 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:40.504742 12207 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.504767 12531 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:14:40.508309 12531 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:40.508652 12531 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:40.509500 12531 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.510675 12531 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.489944 12093 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:40.511729 12093 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.512075 12093 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.512676  8922 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:40.514201  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.507519  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.515023  8921 raft_consensus.cc:2376] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10. Re-sending same reply.
I20260709 12:14:40.515468  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.515952  8919 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:40.516999 12580 consensus_queue.cc:1243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:40.517274  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.517555 12580 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.517868  8917 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.517966 12580 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:40.518436 12714 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.626s	user 0.002s	sys 0.001s
I20260709 12:14:40.521731  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:40.523344  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.524121  8920 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:40.524315  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.526648  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:40.528066  9066 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:40.530520  8924 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
W20260709 12:14:40.531816  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 227949us
I20260709 12:14:40.536577  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.490396 12716 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.489818 12727 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:40.538369  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 55338.8us
I20260709 12:14:40.539987  9074 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:40.541507  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:40.547003  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:40.539942  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50965.2us
I20260709 12:14:40.541028  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:40.548463  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.540462  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.542703  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.543609  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.544744  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.544863  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.544685  8992 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:40.551532  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.563174  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.563637  9000 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 6: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:40.539059 12214 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:14:40.592593 12690 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:40.593058 12690 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.594121 12690 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.564800  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.600963 12705 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.601224  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.601713 12705 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.564391  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:40.535133 12644 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:40.607860 12644 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:40.566532  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.566860  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.568908  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.545939 12716 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.574913  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.612736  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.575399  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.575264  8917 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:40.576659  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.614141  8919 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:40.577486  8993 raft_consensus.cc:2368] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:14:40.536933 12692 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:14:40.617165 12644 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:40.567514 12726 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.629s	user 0.004s	sys 0.000s
I20260709 12:14:40.539203 12699 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:40.581130 12751 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.619061 12751 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.619380 12720 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:40.619719 12751 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.619876  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.620146 12720 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.519083 12580 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.621356 12720 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.622663 12580 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.619297  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.623873  8920 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.624661  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.625214  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.625779  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.626463  8925 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:40.585808 12747 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:14:40.546053 12727 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:40.627146 12727 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.628064  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.628747  8919 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:40.548763 12413 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.535557 12719 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:14:40.588230 12704 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:40.637118  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.574532 12724 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.637713  9065 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.637933 12724 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.638883  9067 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:40.591509 12750 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.639326  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.639768 12750 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.597216  8922 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.640122 12724 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:40.535310 12701 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:40.601171  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.551062  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.641664  8996 raft_consensus.cc:2376] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8. Re-sending same reply.
I20260709 12:14:40.608841  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.608894  8991 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:40.609457  8995 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:14:40.613268  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64871.4us
I20260709 12:14:40.644133  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.644269  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.626276  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:40.548031 12617 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:14:40.628129  8917 raft_consensus.cc:1217] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:14:40.645370  8917 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:40.645792  9624 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:14:40.646123  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.634042 12691 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.634522  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:40.586687 12732 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.642083  8924 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:40.642865  9040 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:40.654299  8916 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:40.830240  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.853842  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.730609  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:40.779968  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 135752us
I20260709 12:14:40.680439  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.862325  9068 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.862500  9067 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:40.862920  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.861763  8919 raft_consensus.cc:2368] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
W20260709 12:14:40.732379  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 87751.1us
W20260709 12:14:40.784427  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.665231  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.764420  9074 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:40.751315  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 176003us
I20260709 12:14:40.866528  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.868865  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.869984  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.870713  9000 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:40.870401  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.670552 12737 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.831573  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:40.681504  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.778893  9071 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:40.756441  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:40.870523  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 227735us
I20260709 12:14:40.872817  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:40.882153  9615 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.873353  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.879290  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:40.881348  8917 raft_consensus.cc:2376] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8. Re-sending same reply.
I20260709 12:14:40.829560  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.884658  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.887745  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.888757  8999 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:40.829020  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:40.890537  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:40.892145  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.897195  9068 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:40.902225  8922 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:40.911057  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.918197  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:40.913285  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.921682  8999 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.922380  9624 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:40.640149 12750 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:40.930912  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47676.8us
I20260709 12:14:40.729868 12286 raft_consensus.cc:2764] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:40.925119  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.931738  8992 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:14:40.930946  8995 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:40.651532 12588 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.929174  9622 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:40.935675  8916 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:40.829450 12661 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.666188 12704 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:40.957048 12704 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:40.957986 12719 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.959098 12719 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:40.960927 12605 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.961371 12605 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.961472 12692 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.932180  8992 pending_rounds.cc:85] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 3
I20260709 12:14:40.962145 12413 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:40.962347 12286 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:40.962311 12605 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.963640 12663 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.963819 12605 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.964156 12663 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:40.929895  9000 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:40.965109 12663 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.966282 12663 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.966475  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.926852  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.967952  8996 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.975659  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.976483  9066 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.977679 12705 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:40.978263  8999 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:40.666436 12701 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:40.941813  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.980244  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.980772 12093 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:40.981675  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:40.982156  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:40.982744  9619 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:40.985281 12701 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.988771 12745 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.946837  9615 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:40.934119  8923 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:40.949386 12690 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.950940  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.938001 12214 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.956557 12603 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:40.975932 12219 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:40.948576  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:40.669996 12727 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.036302  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:40.993542  8996 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:41.015903  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.029026  8993 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:40.962178  8992 pending_rounds.cc:107] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:41.037778  8992 raft_consensus.cc:2889] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:41.032773  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 101481us
I20260709 12:14:40.809530 12716 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:40.990190 12606 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.036173  8920 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:41.037106  8999 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.990796  8994 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:40.992347  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.075748  8998 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:41.033116  8995 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:40.983119 12093 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:41.088052  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.096992  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:41.128547  8921 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:41.134514  8995 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:41.143401  8964 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.542s (SENT)
I20260709 12:14:41.143931  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:41.094247  8999 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:41.154356  9071 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:41.161985  9065 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 12:14:41.162595  9065 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:41.081669 12219 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:41.164037  8918 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 8: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:41.164834  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:41.165577  8999 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.168913  8992 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:40.989383 12745 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.027617 12661 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.182262  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:41.236985  8993 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.035537 12214 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:41.185993  9000 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:41.186364  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:41.238955  8996 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:41.191954 12219 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:41.193223  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.198771 12704 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:41.211999 12756 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:14:41.148610 12724 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.165479 12606 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:41.217934  8994 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:41.232326  9066 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:41.234086  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.241257  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.242810  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.250340  8999 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:41.212525 12093 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:41.215140  8820 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:41.261458  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:41.266481  8992 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
W20260709 12:14:41.281052  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 320338us
W20260709 12:14:41.281677  8964 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.683s (SENT)
I20260709 12:14:41.179113 12376 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:41.171291 12732 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:41.296687  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 336149us
I20260709 12:14:41.283066  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:41.303489  8820 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:41.312716 12757 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:14:41.318212  8820 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:41.322556  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:41.324467  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 90497.1us
I20260709 12:14:41.328892  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:41.330515  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:41.331616 12699 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:41.332571 12699 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.333155 12699 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:41.334415 12699 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.338302  8993 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:41.340708 12172 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:41.342357 12531 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.342978 12531 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.345396 12531 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.345808  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:41.347007 12617 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.347759 12617 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:41.349181 12617 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.352439  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.359194  8964 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.740s (SENT)
I20260709 12:14:41.300019 12639 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.309669 12704 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.300937 12691 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:41.310465 12700 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:41.362442  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 169317us
I20260709 12:14:41.379994  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.316579 12729 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:41.292707 12724 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:41.389585  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.376639  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61091.5us
I20260709 12:14:41.290988 12093 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:41.366392  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43919.7us
I20260709 12:14:41.393106 12639 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.374445 12605 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:41.400597  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 363759us
W20260709 12:14:41.400255  8964 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.794s (SENT)
I20260709 12:14:41.399098 12720 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:41.387665 12737 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.404325 12701 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:41.452201 12759 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:14:41.424285  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44367.8us
W20260709 12:14:41.455438 12758 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:41.456739 12720 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:41.384927 12729 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:41.458091 12214 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:41.458528 12729 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:41.445312  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47683.4us
I20260709 12:14:41.461710  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:41.407387 12606 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:41.463440 12540 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:41.445103 12766 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:14:41.404848  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.389355 12666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.018s
I20260709 12:14:41.446744 12093 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:41.523866  9069 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:41.455014  8888 leader_election.cc:400] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:14:41.526752  8888 leader_election.cc:403] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:14:41.484182  8820 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:14:41.414800  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.533483  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.534243  8820 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:41.535085  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:41.536334  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 97152.9us
I20260709 12:14:41.442575 12661 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:41.501010 12666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.005s	sys 0.018s
I20260709 12:14:41.561934  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.548709  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 300757us
I20260709 12:14:41.563431  8820 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:41.502223 12639 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:41.510159 12716 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.578365  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:41.557818  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:41.583627  8918 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:41.584738  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:41.585820  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:41.587460 12605 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.588642 12605 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:41.589074 12605 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:41.589974 12605 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:41.592248  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 137368us
I20260709 12:14:41.595221  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:41.538889 12720 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.601007  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.502456 12580 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:14:41.562450 12531 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.583477 12724 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.576656 12413 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:14:41.576356 12719 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:14:41.657413  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 220679us
I20260709 12:14:41.600291 12764 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:14:41.597256 12762 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:41.633394 12663 consensus_meta.cc:287] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.667s	user 0.017s	sys 0.003s
I20260709 12:14:41.615461 12737 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:41.664574  9073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.016s
W20260709 12:14:41.668123  9073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.017s
I20260709 12:14:41.624979 12286 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.679145  8964 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.074s (SENT)
I20260709 12:14:41.679860  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:41.680150  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:41.610525 12093 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:14:41.615839 12214 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:14:41.657998 12716 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:41.618355 12720 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.664633 12762 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.698158  8995 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.528s	user 0.017s	sys 0.000s
I20260709 12:14:41.698688  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:41.681504 12531 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.685770 12580 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:41.687014 12764 raft_consensus.cc:2764] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:14:41.713587  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2705) took 1137 ms. Trace:
W20260709 12:14:41.714886  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 362563us
I20260709 12:14:41.724709  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.731155  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 144632us
I20260709 12:14:41.699761 12716 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:41.684937 12286 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.719066  8997 rpcz_store.cc:276] 0709 12:14:40.576102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.599780 (+ 23678us) service_pool.cc:224] Handling call
0709 12:14:40.600185 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.600665 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.600695 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.601281 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.802560 (+201279us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:41.305300 (+502740us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.713295 (+407995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.713366 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.713406 (+    40us) raft_consensus.cc:1685] finished
0709 12:14:41.713417 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.713529 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":648702,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":12349,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":10196,"thread_start_us":1003111,"threads_started":3,"wal-append.queue_time_us":348197}
W20260709 12:14:41.735596  9037 connection.cc:256] RPC call timeout handler was delayed by -1.0707383349999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:14:41.705451 12730 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:41.699944 12762 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:41.776096  9037 connection.cc:256] RPC call timeout handler was delayed by -1.0608383349999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 12:14:41.741276  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.756893  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 142461us
I20260709 12:14:41.734017  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.780505  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46575.2us
I20260709 12:14:41.780671  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:41.781489  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:41.782469  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:41.784758  8889 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:14:41.862757  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78673.9us
I20260709 12:14:41.863737  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:41.729305 12617 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.730192 12093 consensus_queue.cc:1243] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:41.718230 12580 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:41.883589  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 158946us
W20260709 12:14:41.890841  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 297188us
I20260709 12:14:41.732766 12207 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.892458  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.766019 12765 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.897301  9590 leader_election.cc:400] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
I20260709 12:14:41.898808  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:41.899091  9590 leader_election.cc:403] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:41.879314 12588 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.745488 12732 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 12:14:41.867959 12773 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.882751 12745 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.716719 12531 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.907196  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.897246  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109490us
I20260709 12:14:41.879571 12777 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:41.895478 12093 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:41.906230 12767 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:14:41.916040  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:14:41.907847 12769 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:14:41.943117  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.943836  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 162438us
I20260709 12:14:41.944660  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:41.947973  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55592.6us
I20260709 12:14:41.949996  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:41.903177 12788 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:41.891824 12617 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:41.912036 12787 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.898568 12789 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:14:41.916841 12768 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.954267  8966 leader_election.cc:400] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:41.954892  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:41.933522 12540 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:41.947662 12704 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:14:41.965821  8966 leader_election.cc:403] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:41.931895 12791 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.981482  9619 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:41.904232 12765 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:41.973217  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.973053 12603 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:41.953765 12644 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.975111 12776 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:41.911054 12588 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:41.961583 12777 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:41.902359 12778 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6.
W20260709 12:14:41.988560  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 125034us
I20260709 12:14:41.983892 12531 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:41.956648 12788 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.974246 12774 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:14:41.992622  8964 leader_election.cc:336] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.096s (SENT)
I20260709 12:14:42.025801  9065 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:41.931133 12580 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:41.960863 12093 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:42.032387  9066 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:14:42.033625  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79482.6us
I20260709 12:14:42.049988  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.037056  9074 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:41.976255 12540 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.949035 12666 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:14:42.057221  9615 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:41.981900 12376 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:42.039912 12794 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:42.115999  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 715) took 1188 ms. Trace:
I20260709 12:14:42.116477  9067 rpcz_store.cc:276] 0709 12:14:40.870843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.906935 (+ 36092us) service_pool.cc:224] Handling call
0709 12:14:40.939737 (+ 32802us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.982710 (+ 42973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.982742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.983400 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.343283 (+359883us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:41.343545 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.343947 (+   402us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.058883 (+714936us) raft_consensus.cc:1685] finished
0709 12:14:42.058910 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.059114 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42567,"raft.queue_time_us":43911,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":358633,"threads_started":1,"wal-append.queue_time_us":540219}
I20260709 12:14:42.118568 12701 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:42.033183 12644 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:42.119436 12775 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:14:41.990490  9620 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:14:42.120548 12771 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:14:42.104808 12376 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:42.120826 12588 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:42.104646 12737 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:42.121562 12376 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.048370 12791 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.123306 12791 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.029742 12207 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:41.934908 12716 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.048689 12724 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:42.044750  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128845us
I20260709 12:14:42.127749  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:42.022565 12603 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:42.052636  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60067.8us
W20260709 12:14:42.136093  8964 leader_election.cc:336] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.162s (SENT)
W20260709 12:14:42.136703  8964 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.217s (SENT)
I20260709 12:14:42.066978 12787 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.074857 12727 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.075857 12692 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:42.123088 12376 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.094960  8820 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 8 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.170789  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:42.177903  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.179739  8992 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:42.046092 12788 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.056524 12540 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:42.040235 12797 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.122084 12737 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.128674  8889 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:42.024757 12720 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:42.128883  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78973.4us
I20260709 12:14:42.188058  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.109159  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1664) took 1217 ms. Trace:
I20260709 12:14:42.188807  8922 rpcz_store.cc:276] 0709 12:14:40.891328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.902898 (+ 11570us) service_pool.cc:224] Handling call
0709 12:14:40.903222 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.925610 (+ 22388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.925647 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.936705 (+ 11058us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.358018 (+421313us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.358060 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.358137 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.108854 (+750717us) raft_consensus.cc:1685] finished
0709 12:14:42.108883 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.109074 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23061,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":11672,"thread_start_us":271851,"threads_started":1,"wal-append.queue_time_us":487594}
I20260709 12:14:42.140769  8995 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:41.961406 12790 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:14:42.092402 12730 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:42.191319 12730 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:42.131752 12732 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:42.182554  8918 raft_consensus.cc:2410] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:42.184720  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:42.195468 12732 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:42.195775  8923 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:42.196029 12732 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.133846 12724 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:42.207572  8997 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:42.204589  8966 leader_election.cc:400] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 7. Current term is 8.
I20260709 12:14:42.209208  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:42.103754  8821 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 208) took 25371 ms (client timeout 15000 ms). Trace:
W20260709 12:14:42.148795 12750 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.185s	user 0.007s	sys 0.006s
I20260709 12:14:42.146505 12580 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:42.218510  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89915.3us
I20260709 12:14:42.150513 12692 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:42.149132 12764 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:42.205933  8820 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:42.233361  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 124922us
I20260709 12:14:42.235896  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.181728 12286 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:42.217950 12690 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.178s	user 0.012s	sys 0.001s
I20260709 12:14:42.105258 12777 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 12:14:42.239827  8820 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 8, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 8 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.234344  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.243777  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1666) took 1351 ms. Trace:
W20260709 12:14:42.216054 12770 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:14:42.211369 12093 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.249109  8917 rpcz_store.cc:276] 0709 12:14:40.891875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.959542 (+ 67667us) service_pool.cc:224] Handling call
0709 12:14:40.959918 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.260925 (+301007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.260953 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.289881 (+ 28928us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.614974 (+325093us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:41.615012 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.615088 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.243292 (+628204us) raft_consensus.cc:1685] finished
0709 12:14:42.243313 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.243697 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18746,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":76,"thread_start_us":555108,"threads_started":2,"wal-append.queue_time_us":455805}
I20260709 12:14:42.151459 12606 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
W20260709 12:14:42.231889 12792 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:14:42.256296  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.132519 12778 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 12:14:42.255947  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 301114us
I20260709 12:14:42.241808 12789 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.248574  8820 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:42.296108  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60300.1us
I20260709 12:14:42.296931  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.305182  8820 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.307432  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:42.307613  8820 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 8, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 8 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.310698  9072 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:42.312107  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:42.312463  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:42.312696  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:42.310715  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45075.6us
I20260709 12:14:42.257222 12773 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.223452 12750 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.259929 12724 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.375568  8923 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:42.313685  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.295739 12413 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:42.405833  8918 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:42.356304  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:42.241425 12764 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:42.406635  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 93077.2us
I20260709 12:14:42.411564  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.314740  8922 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:42.314771 12751 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.694s	user 0.013s	sys 0.002s
I20260709 12:14:42.355448  8820 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 6, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 6 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.375106  8924 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:42.353121  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 45919.3us
I20260709 12:14:42.314179 12214 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:42.420627  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.421440  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.251928 12787 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:42.422684  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45859us
W20260709 12:14:42.423336 12782 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 12:14:42.423856  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:42.424427  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.424926  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 713) took 1781 ms. Trace:
I20260709 12:14:42.425390 12795 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.426115 12800 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.426276 12605 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:42.425289  9073 rpcz_store.cc:276] 0709 12:14:40.643429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.643574 (+   145us) service_pool.cc:224] Handling call
0709 12:14:40.643866 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.644204 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:41.027007 (+382803us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.668865 (+641858us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.701509 (+ 32644us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.701649 (+   140us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:41.701681 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.701743 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.424746 (+723003us) raft_consensus.cc:1685] finished
0709 12:14:42.424765 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.424877 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13079,"prepare.queue_time_us":184620,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":349,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":28546,"thread_start_us":770833,"threads_started":2,"wal-append.queue_time_us":839802}
I20260709 12:14:42.426805 12605 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.422772 12796 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.416549  8820 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 8, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 8 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.426612 12800 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.427416 12803 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.352350 12789 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.314914 12797 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.376752 12719 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:42.211392  8821 rpcz_store.cc:269] 0709 12:14:16.732738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.735410 (+  2672us) service_pool.cc:224] Handling call
0709 12:14:38.343106 (+21607696us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b540016f228. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab8b9b4 00007f398966f3dc 00007f3989630e0b 00007f3989630be4 00007f398bb30fa1 00007f398bb317ff 00007f398b9f0a1b 00007f398baf890e 00007f3989fb92a4 00007f3989fb9232
0709 12:14:42.103431 (+3760325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:38.844106 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:38.844911 (+   805us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:38.844979 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:14:38.845020 (+    41us) tablet.cc:662] Decoding operations
0709 12:14:38.846188 (+  1168us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:38.846268 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:38.846303 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:14:38.847186 (+   883us) tablet.cc:701] Row locks acquired
0709 12:14:38.847231 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:14:38.890625 (+ 43394us) write_op.cc:270] Start()
0709 12:14:38.904579 (+ 13954us) write_op.cc:276] Timestamp: P: 1783599278883146 usec, L: 0
0709 12:14:38.909198 (+  4619us) op_driver.cc:348] REPLICATION: starting
0709 12:14:38.968415 (+ 59217us) log.cc:844] Serialized 3608 byte log entry
0709 12:14:39.872010 (+903595us) op_driver.cc:464] REPLICATION: finished
0709 12:14:40.330651 (+458641us) write_op.cc:301] APPLY: starting
0709 12:14:40.335838 (+  5187us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:40.337839 (+  2001us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:40.348442 (+ 10603us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:40.376309 (+ 27867us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:40.376616 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:14:40.376664 (+    48us) write_op.cc:312] APPLY: finished
0709 12:14:40.377134 (+   470us) log.cc:844] Serialized 71 byte log entry
0709 12:14:40.377393 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:40.377588 (+   195us) write_op.cc:454] Released schema lock
0709 12:14:40.377678 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:40.427657 (+ 49979us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:40.427697 (+    40us) write_op.cc:454] Released schema lock
0709 12:14:40.461823 (+ 34126us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3832a 00007f3985bbdf14 00007f3985bbdec3 00007f3985bbde38 00007f3985bbddf3 00007f3985bbd0dc 00007f3985be6e16 00007f3985bcecbb 00007f3985bb939d 00007f3985bbcd75
Metrics: {"mutex_wait_us":1556505,"reported_tablets":34,"spinlock_wait_cycles":22095104,"child_traces":[["op",{"apply.queue_time_us":400640,"apply.run_cpu_time_us":4932,"apply.run_wall_time_us":114994,"num_ops":9,"prepare.queue_time_us":369976,"prepare.run_cpu_time_us":17414,"prepare.run_wall_time_us":351864,"raft.queue_time_us":229010,"raft.run_cpu_time_us":24282,"raft.run_wall_time_us":639345,"replication_time_us":937066,"spinlock_wait_cycles":4027136,"thread_start_us":747596,"threads_started":4,"wal-append.queue_time_us":446926,"wal-append.run_cpu_time_us":12471,"wal-append.run_wall_time_us":1936134}]]}
W20260709 12:14:42.437075  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 227653us
W20260709 12:14:42.434139 12767 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:42.440925 12802 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:42.483901  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.433926 12795 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.441532  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 185192us
I20260709 12:14:42.490418  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.405344 12172 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.352571 12207 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:14:42.405871 12790 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.445060  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.445827  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.502439  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.446663  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:42.371722 12093 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.414943 12805 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:42.440018  8820 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:42.421592 12791 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.473109  9069 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:42.434520 12605 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.476373  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:42.473986  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50169.4us
I20260709 12:14:42.457382 12214 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.492673  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.481026  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:42.499068  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:42.445358 12606 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.510370  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.570436  9615 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.542232  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.542352  9065 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:42.540040  8820 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 7, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 7 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:42.479841 12720 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:14:42.547333  9070 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:42.487608 12765 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.419173 12751 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.371057 12737 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.352918 12692 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:42.570407  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 77849.8us
I20260709 12:14:42.511046 12794 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.571504  9620 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:42.577286 12799 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:14:42.577783 12810 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:42.578797 12787 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.579206 12773 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.579420 12750 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:42.580097  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.617734  9623 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:42.577288 12093 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:42.583391 12809 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:14:42.585832 12811 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:14:42.480764 12716 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:14:42.544272 12805 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:42.586653 12724 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.587920 12797 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.591638 12214 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:42.500293 12719 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:42.644016  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.509807 12413 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:42.649560 12413 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.601828  8820 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:14:42.637308 12729 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.178s	user 0.013s	sys 0.000s
I20260709 12:14:42.606153  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:42.607714  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114571us
I20260709 12:14:42.510094 12172 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.609084  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:42.609165  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 170978us
I20260709 12:14:42.611184  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:42.611853  8918 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:42.454488 12803 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.547029 12704 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:14:42.438014 12796 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.630779  9615 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:42.635896  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:42.668005  9623 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:42.668053  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:42.636449  8925 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:42.550066 12791 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:42.640682  8888 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.509s (SENT)
I20260709 12:14:42.540122 12790 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.513612 12795 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.646644 12719 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.647545 12786 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:14:42.639005 12805 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.633695 12787 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.732446  9621 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:42.679937 12833 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:14:42.735814  8925 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:42.606304 12606 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.570530  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:42.663262 12093 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:42.656710  8916 raft_consensus.cc:2376] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10. Re-sending same reply.
W20260709 12:14:42.656881  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.666177  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:42.747506  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 106848us
I20260709 12:14:42.680941  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.681278  8922 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:42.680285  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:42.749961  9074 raft_consensus.cc:606] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.750239  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.750500  9074 raft_consensus.cc:614] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:42.684051  9069 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 12:14:42.701094  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 92086.4us
I20260709 12:14:42.752872  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.701246  8991 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:42.701202  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.683218  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.706776  8998 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:42.654704  8820 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 6, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 6 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.740773  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.741190  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.612928 12789 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.618032 12794 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.741119  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.757907  8918 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:42.756532  9620 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:42.759690  8820 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.634523 12773 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.681277 12820 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.687906 12745 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.767488  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.732551 12787 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.769857  8820 catalog_manager.cc:5697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.768734  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.777125  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:42.779798  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.663866 12729 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.785297  8916 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:42.785337  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:42.787500 12837 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:42.679832 12214 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:14:42.791342  9070 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:42.787147  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:42.781982  8820 catalog_manager.cc:5697] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:42.777619 12207 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.798311  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:42.808753  9066 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:42.678995 12821 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:14:42.824162 12724 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:42.824656 12724 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.824954 12172 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:42.825502 12724 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.826905 12724 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:42.772965 12802 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:42.828469 12376 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.003s
I20260709 12:14:42.833667  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.828341 12802 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:42.831099  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:42.852643  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 65596.1us
I20260709 12:14:42.853411  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.855875 12837 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.856069 12826 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:42.856796 12826 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:42.857378 12826 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:42.799060 12750 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.854698  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:42.792308 12833 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:14:42.888065  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:42.888873  9070 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:42.790380 12820 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:42.877842 12093 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:42.875839  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126540us
I20260709 12:14:42.890718  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:42.852303  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 113775us
I20260709 12:14:42.877170  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.878049 12751 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.871070 12800 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.905905  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.913483  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:42.888407 12716 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:42.926685  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:42.935166  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:42.917212 12732 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.003s
I20260709 12:14:42.936757  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.938017  8997 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:42.938537  9000 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:42.942600  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.909462 12764 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.915886 12719 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.915740 12750 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.947213  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.953748  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:42.938614 12798 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:14:42.961784  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.937903 12376 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.969889  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.937116 12716 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:42.970619  8996 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:42.978619  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.922045 12172 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:14:42.991354  8922 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:42.992026  8922 pending_rounds.cc:85] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 7
I20260709 12:14:42.992336  8922 pending_rounds.cc:107] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:14:42.992658  8922 raft_consensus.cc:2889] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:42.932045 12779 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:14:42.945351 12791 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:42.998031  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.984091  8997 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
W20260709 12:14:43.001174  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64503.7us
I20260709 12:14:43.006544  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:42.945832 12778 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:43.025413  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:42.945526 12732 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.035012  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:42.981176 12751 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:43.079720  9623 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:42.965469 12719 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:43.068004  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126850us
I20260709 12:14:43.007956 12843 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:43.075886  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118837us
I20260709 12:14:43.066834  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:42.956120 12827 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.238s
I20260709 12:14:43.008589 12606 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:43.090649  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:43.066834 12787 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.067559 12376 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:43.072033 12729 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:42.994537 12823 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.282s
I20260709 12:14:43.099539  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:43.093853  8996 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:43.088550  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:43.067709 12207 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.073890 12750 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.081326 12797 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:43.095043 12730 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.005s
I20260709 12:14:43.082057 12795 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.072288 12826 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.103147 12794 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.093683 12787 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:43.121881  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:43.104959  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.066740 12791 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:14:43.128724  8996 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:43.139860  8966 leader_election.cc:336] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.873s (SENT)
I20260709 12:14:43.103627 12773 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.163733  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:43.165421  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43611.2us
I20260709 12:14:43.166704  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.167682  8996 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:14:43.167618 12851 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.168303 12851 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:43.141808 12832 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:14:43.128130 12787 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:43.162245 12808 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:14:43.173765  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:43.168635 12779 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.124967 12797 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:43.108983 12750 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.171702 12820 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:43.120971 12730 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.105410 12172 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:14:43.101799 12716 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:43.178599 12815 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:14:43.170105 12851 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.188792 12700 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:43.207063  9073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:43.207719  9073 raft_consensus.cc:606] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:43.208029  9073 raft_consensus.cc:614] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:43.208321 12719 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:43.212383 12834 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:14:43.212535  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1450) took 1069 ms. Trace:
W20260709 12:14:43.213961 12848 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:14:43.212977  8994 rpcz_store.cc:276] 0709 12:14:42.143632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.143763 (+   131us) service_pool.cc:224] Handling call
0709 12:14:42.178324 (+ 34561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.203431 (+ 25107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.203461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.221153 (+ 17692us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.434822 (+213669us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.684297 (+249475us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.684993 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.685063 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.212314 (+527251us) raft_consensus.cc:1685] finished
0709 12:14:43.212333 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.212475 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7600,"prepare.queue_time_us":149337,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":26702,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":25069,"thread_start_us":352915,"threads_started":2,"wal-append.queue_time_us":371419}
W20260709 12:14:43.191864 12846 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:14:43.226102  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.226930  8996 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:43.228178 12850 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:43.231315 12730 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.228633 12851 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.236399  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:43.238220  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:43.240139  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:43.195960  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 229237us
I20260709 12:14:43.192411 12750 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.240981  8992 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:43.242077  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.242496  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:43.242895  8992 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:14:43.243974  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:43.199728  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 115362us
I20260709 12:14:43.245497  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:43.215186  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.249070  8994 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:43.259783  9073 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:43.273166  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:43.202071 12843 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:43.275332  8925 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:43.271459 12789 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:43.259060 12827 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.283576  8996 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:43.285861  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:43.298318  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51315.5us
I20260709 12:14:43.299641 12764 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:43.300179 12764 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:43.300755 12764 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.303478 12795 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:43.250023 12719 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:43.293787  8994 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:43.307489  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:43.309198  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.310432  8994 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:43.278230  8991 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:43.294874 12794 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:43.293531 12788 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.066s	user 0.007s	sys 0.007s
I20260709 12:14:43.319221  9073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
W20260709 12:14:43.313571 12762 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.428s	user 0.012s	sys 0.003s
I20260709 12:14:43.314987  8992 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:43.324450  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:43.324510  8996 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:43.318209 12855 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.335752  9073 raft_consensus.cc:606] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:43.348362  9073 raft_consensus.cc:614] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:43.320343 12172 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.355612 12172 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.358516 12172 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:43.361886 12724 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.002s
I20260709 12:14:43.363284  9615 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:43.363637  8916 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:43.364382  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:43.365831 12605 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.002s
I20260709 12:14:43.366335 12605 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.334406  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:43.363394 12540 consensus_meta.cc:287] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.002s
I20260709 12:14:43.371615  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:43.354694 12805 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.003s
I20260709 12:14:43.377221  8996 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.378533  8992 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:43.382144  8994 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:43.313017 12827 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.344754 12826 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.348048 12797 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.342286 12788 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:43.380107 12779 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.420989  8991 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:43.421981  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:43.345924 12762 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:43.427114 12807 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.051s	user 0.002s	sys 0.000s
I20260709 12:14:43.430825  8994 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:43.376411 12766 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:14:43.432660  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.431924  8991 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:43.375810 12540 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:43.437479  8992 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:43.441989  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
W20260709 12:14:43.419222 12580 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.184s	user 0.004s	sys 0.009s
I20260709 12:14:43.372727 12855 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.442351  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:43.376057 12805 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.379405 12843 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.607412  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:43.546078  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1447) took 1404 ms. Trace:
I20260709 12:14:43.613094  9615 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:43.776978  8996 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:43.594452  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:43.554203  9072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2864) took 2723 ms (client timeout 1799 ms). Trace:
I20260709 12:14:43.670733  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:43.867228  9070 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:43.865747  8995 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:43.612406  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1673) took 2031 ms. Trace:
I20260709 12:14:43.772924  8994 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:43.734861  8925 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:43.610284  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:43.868218  8920 rpcz_store.cc:276] 0709 12:14:41.581188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.581404 (+   216us) service_pool.cc:224] Handling call
0709 12:14:41.605486 (+ 24082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.770443 (+164957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.770478 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.862315 (+ 91837us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.975297 (+112982us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b48002dc0d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:42.033277 (+ 57980us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:42.033323 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.045399 (+ 12076us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.609335 (+1563936us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b2400135f08. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8cfb0 00007f3985803488 00007f3985803be8 00007f39857db398 00007f39857d676a 00007f39857d5bb6
0709 12:14:43.612142 (+  2807us) raft_consensus.cc:1685] finished
0709 12:14:43.612168 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.612337 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85550,"raft.queue_time_us":72380,"raft.run_cpu_time_us":7455,"raft.run_wall_time_us":293799,"spinlock_wait_cycles":205377792,"thread_start_us":261279,"threads_started":2,"wal-append.queue_time_us":174118}
W20260709 12:14:43.717522  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75273.8us
I20260709 12:14:43.869400  8917 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:43.500736  8992 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:43.663866  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:43.871753  9073 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:43.489210  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:43.482661  8991 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:43.639384  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:43.430089 12858 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:43.866727  9072 rpcz_store.cc:269] 0709 12:14:40.831093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.831290 (+   197us) service_pool.cc:224] Handling call
0709 12:14:43.553999 (+2722709us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540028b9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:43.554107 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3157671680}
I20260709 12:14:43.862764  8993 rpcz_store.cc:276] 0709 12:14:42.141406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.141543 (+   137us) service_pool.cc:224] Handling call
0709 12:14:42.141881 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.151480 (+  9599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.151513 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.151551 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:42.151583 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.545833 (+1394250us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b54000f41d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:43.545876 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.546005 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10662,"raft.queue_time_us":352,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":55604,"spinlock_wait_cycles":21318016}
I20260709 12:14:43.882867  8995 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:43.884584  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 442280us
I20260709 12:14:43.886181  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:43.886723  8923 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:43.888598  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:43.888684  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:43.889348  8925 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
W20260709 12:14:43.891505  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 252215us
I20260709 12:14:43.875694 12751 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.896445 12751 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:43.897347 12540 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:43.898918  9074 raft_consensus.cc:2368] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:43.900928  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2364) took 1216 ms. Trace:
I20260709 12:14:43.901253  9074 rpcz_store.cc:276] 0709 12:14:42.684884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.790073 (+105189us) service_pool.cc:224] Handling call
0709 12:14:43.900704 (+1110631us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000ad554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:43.900839 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508788480}
I20260709 12:14:43.902838  9074 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:14:43.552032 12806 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.948s	user 0.002s	sys 0.000s
W20260709 12:14:43.607385 12873 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:14:43.451692 12814 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.788s	user 0.003s	sys 0.000s
W20260709 12:14:43.452376 12854 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:14:43.531808 12860 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:14:43.558097 12862 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 12:14:43.648290 12800 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.666074 12737 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:43.666798 12531 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:43.543016 12764 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.561443 12803 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.550958 12603 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.980265 12803 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:43.980536 12603 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:43.982223 12823 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:43.985632 12764 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.540462 12605 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.998337  9071 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:43.999094  9066 raft_consensus.cc:606] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:14:43.907202 12789 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:43.535452 12833 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.549292 12796 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:43.537783 12827 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.634344 12821 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.445688 12644 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.560876 12788 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.875988 12826 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.854259 12219 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:43.939136  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:43.754812 12606 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:43.545346 12732 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:43.523365 12663 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:43.734282 12666 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:43.946645  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 726) took 1820 ms. Trace:
I20260709 12:14:44.031337  9067 rpcz_store.cc:276] 0709 12:14:42.126017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.146685 (+ 20668us) service_pool.cc:224] Handling call
0709 12:14:42.181925 (+ 35240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.182262 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.182292 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.208017 (+ 25725us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.371381 (+163364us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:42.371431 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.371525 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.338910 (+967385us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:43.946228 (+607318us) raft_consensus.cc:1685] finished
0709 12:14:43.946261 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.946555 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25035,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10961,"spinlock_wait_cycles":35450624,"thread_start_us":68325,"threads_started":1,"wal-append.queue_time_us":212988}
I20260709 12:14:43.432850 12779 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:43.924039  8917 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:44.033813  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2290) took 1074 ms. Trace:
I20260709 12:14:43.995081 12780 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.890803 12864 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:43.906932 12207 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:14:43.663291 12172 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.260s
I20260709 12:14:43.734599 12729 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.250s
I20260709 12:14:43.912539 12716 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 12:14:43.650429 12704 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.290s
I20260709 12:14:43.752781 12804 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.262s
I20260709 12:14:43.967149  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:43.986609 12839 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.845s	user 0.001s	sys 0.001s
I20260709 12:14:43.999560  9066 raft_consensus.cc:614] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:43.447587 12851 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.828938 12762 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:43.740947 12787 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:43.911707 12797 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:14:43.962459  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.097441  8920 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:43.908599 12580 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.028456  9070 raft_consensus.cc:2368] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:43.961865 12531 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:43.965826 12737 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:44.034448  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:44.034258  8917 rpcz_store.cc:276] 0709 12:14:42.959783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.610009 (+650226us) service_pool.cc:224] Handling call
0709 12:14:44.033723 (+423714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:43.935297  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:43.916544 12791 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:14:43.982928 12823 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.067840  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:44.071729  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 462696us
W20260709 12:14:44.072666  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 184055us
I20260709 12:14:44.064244  8923 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:44.073642  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 725) took 1155 ms. Trace:
I20260709 12:14:44.119952  8998 rpcz_store.cc:276] 0709 12:14:42.918635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.924480 (+  5845us) service_pool.cc:224] Handling call
0709 12:14:42.934209 (+  9729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.938273 (+  4064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.938302 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.948687 (+ 10385us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.200403 (+251716us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:43.200450 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.200526 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.073348 (+872822us) raft_consensus.cc:1685] finished
0709 12:14:44.073377 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.073554 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3720,"raft.queue_time_us":3842,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3801,"thread_start_us":191887,"threads_started":1,"wal-append.queue_time_us":288047}
I20260709 12:14:44.074653  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 730) took 1154 ms. Trace:
I20260709 12:14:43.633862 12875 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.329s
I20260709 12:14:44.008550 12849 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.077369  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:44.025262 12796 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.905783 12858 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.128938  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.129766  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2292) took 1052 ms. Trace:
I20260709 12:14:44.076380  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:43.965212 12800 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.080132 12732 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.070398 12780 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:44.086238  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 200411us
I20260709 12:14:44.039438 12724 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.085320  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1671) took 2502 ms. Trace:
I20260709 12:14:44.150938  8921 rpcz_store.cc:276] 0709 12:14:41.576954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.577530 (+   576us) service_pool.cc:224] Handling call
0709 12:14:41.597937 (+ 20407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.756243 (+158306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.756276 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.770878 (+ 14602us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.275715 (+504837us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.275758 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.275851 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.551302 (+1275451us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:44.068348 (+517046us) raft_consensus.cc:1685] finished
0709 12:14:44.068379 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.079528 (+ 11149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15947,"raft.queue_time_us":79424,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5240,"spinlock_wait_cycles":9403264,"thread_start_us":517377,"threads_started":2,"wal-append.queue_time_us":709515}
I20260709 12:14:44.009222 12789 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.100302  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.013034 12833 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.112033  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:44.039891 12826 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.086005 12286 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.117019  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:44.164803  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:44.165244 12787 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:44.121373  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 216636us
I20260709 12:14:44.030269 12821 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.047760 12666 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.069954 12663 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.177839 12805 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.179209 12663 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.180033 12821 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.181200 12858 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.182073 12617 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.124185  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 613) took 1414 ms. Trace:
I20260709 12:14:44.140594 12881 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:44.121855  9000 rpcz_store.cc:276] 0709 12:14:42.920275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.945193 (+ 24918us) service_pool.cc:224] Handling call
0709 12:14:42.962381 (+ 17188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.999043 (+ 36662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.999078 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.008511 (+  9433us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.194976 (+186465us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:43.195029 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.195332 (+   303us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.074399 (+879067us) raft_consensus.cc:1685] finished
0709 12:14:44.074425 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.074573 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7582,"raft.queue_time_us":18818,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12060,"thread_start_us":87124,"threads_started":1,"wal-append.queue_time_us":240048}
I20260709 12:14:44.130766  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.039760 12219 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.130141  8923 rpcz_store.cc:276] 0709 12:14:43.077454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.128665 (+1051211us) service_pool.cc:224] Handling call
0709 12:14:44.129710 (+  1045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.186393  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.187354  8923 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:44.153779  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.046319 12606 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.157334  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:44.139832 12796 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.157804  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:44.158105 12727 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:44.165841 12826 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.176035  9621 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:44.176201  8925 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:44.189565 12855 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:44.175822 12791 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:14:44.189814 12666 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:44.190261  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:44.191618 12779 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:44.128646 12849 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.192727 12821 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:44.194290 12858 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:44.174788  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.163071 12724 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:44.573210  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.331779  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 284339us
I20260709 12:14:44.590545  8921 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:14:44.519737  9073 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.001s
I20260709 12:14:44.267841  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:44.591722  9073 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:44.218106  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2288) took 1259 ms. Trace:
W20260709 12:14:44.592284  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 324578us
I20260709 12:14:44.592597  8917 rpcz_store.cc:276] 0709 12:14:42.959174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.130525 (+1171351us) service_pool.cc:224] Handling call
0709 12:14:44.218015 (+ 87490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.510492  8919 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:44.593225  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:44.209162  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1688) took 1010 ms. Trace:
I20260709 12:14:44.291064  8922 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:44.324345  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:44.602517  9065 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.183470  9622 rpcz_store.cc:276] 0709 12:14:42.699044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.699162 (+   118us) service_pool.cc:224] Handling call
0709 12:14:42.733913 (+ 34751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.734252 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.734276 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.734750 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.913582 (+178832us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:42.913619 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.913682 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.985854 (+1072172us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:44.096757 (+110903us) raft_consensus.cc:1685] finished
0709 12:14:44.096781 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.113516 (+ 16735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5404,"raft.queue_time_us":3301,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17693,"spinlock_wait_cycles":39353600,"thread_start_us":178422,"threads_started":1,"wal-append.queue_time_us":350780}
I20260709 12:14:44.594061  8923 rpcz_store.cc:276] 0709 12:14:43.198399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.186078 (+987679us) service_pool.cc:224] Handling call
0709 12:14:44.209077 (+ 22999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.598189  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:44.600339  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1692) took 1400 ms. Trace:
I20260709 12:14:44.607682  8921 rpcz_store.cc:276] 0709 12:14:43.200149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.162123 (+961974us) service_pool.cc:224] Handling call
0709 12:14:44.600251 (+438128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.198068  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:44.285487  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.610697  8920 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:44.611610  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 604) took 1194 ms. Trace:
I20260709 12:14:44.610464  9067 raft_consensus.cc:2376] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12. Re-sending same reply.
I20260709 12:14:44.173818 12732 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.617193  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:44.189569 12876 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:14:44.590642 12172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.020s	sys 0.056s
W20260709 12:14:44.267045 12880 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:14:44.616460  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.289556 12888 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:44.650060  9072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.023s
I20260709 12:14:44.561467 12540 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.652112  8917 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:44.678610  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2287) took 1719 ms. Trace:
I20260709 12:14:44.658099  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:44.679134  8917 rpcz_store.cc:276] 0709 12:14:42.958897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.616351 (+1657454us) service_pool.cc:224] Handling call
0709 12:14:44.651879 (+ 35528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.678254 (+ 26375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.678539 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.176774 12716 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.482s
I20260709 12:14:44.583038 12780 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.663996  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:44.595469 12802 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.462178 12207 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:44.589978 12727 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:44.649570  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:44.664261 12797 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:44.327387 12864 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:44.673117  9072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.023s
I20260709 12:14:44.710155  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2371) took 1069 ms. Trace:
I20260709 12:14:44.710752  9072 rpcz_store.cc:276] 0709 12:14:43.640597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.906138 (+265541us) service_pool.cc:224] Handling call
0709 12:14:43.906371 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.913237 (+  6866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.913271 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.950743 (+ 37472us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.105195 (+154452us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:44.115310 (+ 10115us) log.cc:844] Serialized 14 byte log entry
0709 12:14:44.709632 (+594322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.709749 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.709820 (+    71us) raft_consensus.cc:1685] finished
0709 12:14:44.709846 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.710072 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6849,"prepare.queue_time_us":9659,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":10440,"raft.queue_time_us":123058,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":13711744,"thread_start_us":711809,"threads_started":2,"wal-append.queue_time_us":192220}
I20260709 12:14:44.713918  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.615419 12833 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.676842  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.652714  8920 rpcz_store.cc:276] 0709 12:14:43.416903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.242141 (+825238us) service_pool.cc:224] Handling call
0709 12:14:44.611521 (+369380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.679811  9616 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:44.715886  9073 raft_consensus.cc:2410] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:14:44.680815  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.001s	sys 0.031s
W20260709 12:14:44.716552  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.031s
W20260709 12:14:44.716949  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 597555us
I20260709 12:14:44.683808  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.684878  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:44.241336 12762 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.427s
I20260709 12:14:44.439687 12868 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.229s
I20260709 12:14:44.685290  9065 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:44.686398  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.729702  8917 raft_consensus.cc:2410] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:44.172341 12286 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.644661 12787 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:14:44.689502 12219 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.659472 12732 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.694257  9621 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:44.669200  8923 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:44.741381  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1687) took 1552 ms. Trace:
I20260709 12:14:44.741550  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.741839  8923 rpcz_store.cc:276] 0709 12:14:43.188578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.626615 (+1438037us) service_pool.cc:224] Handling call
0709 12:14:44.627090 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.741059 (+113969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.741314 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:44.691617 12875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.009s
I20260709 12:14:44.268383 12704 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.405s
I20260709 12:14:44.552119 12729 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.757660 12729 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.760362 12729 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.724082  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:44.763578 12875 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.764227 12875 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:44.764721 12796 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:44.728700 12762 consensus_queue.cc:1243] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:44.765319 12875 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.768152 12849 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:44.694329 12885 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:44.769501 12885 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:44.241489 12881 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:44.783360  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.019s	sys 0.030s
I20260709 12:14:44.682752 12540 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.697510 12207 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:44.735482  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.798776  9073 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:44.737242  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.687379 12789 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:44.744050  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 139611us
I20260709 12:14:44.749024  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1690) took 1549 ms. Trace:
I20260709 12:14:44.800581  8923 rpcz_store.cc:276] 0709 12:14:43.199509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.747736 (+1548227us) service_pool.cc:224] Handling call
0709 12:14:44.748216 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.748473 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.748513 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:44.748576 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:44.748638 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.748753 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.748935 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.754042  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:44.801743  8917 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:44.173168 12737 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:44.740156 12617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.023s
I20260709 12:14:44.756920 12732 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:44.784755  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.019s	sys 0.030s
W20260709 12:14:44.791968  9619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.007s	sys 0.034s
I20260709 12:14:44.722424 12797 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.750830  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.731695  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:44.802464  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.021s	sys 0.024s
W20260709 12:14:44.884045  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.022s	sys 0.024s
W20260709 12:14:44.884352  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 729910us
I20260709 12:14:44.754565 12606 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:44.803231  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1695) took 1478 ms. Trace:
I20260709 12:14:44.733932 12894 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:14:44.807299  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.725394 12172 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:44.812390  9074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.018s	sys 0.029s
W20260709 12:14:45.003679  9074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.018s	sys 0.029s
I20260709 12:14:45.004679  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2370) took 1364 ms. Trace:
I20260709 12:14:45.005127  9074 rpcz_store.cc:276] 0709 12:14:43.640318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.903946 (+263628us) service_pool.cc:224] Handling call
0709 12:14:43.941156 (+ 37210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:43.941377 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:44.131321 (+189944us) log.cc:844] Serialized 14 byte log entry
0709 12:14:44.148665 (+ 17344us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.004157 (+855492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.004260 (+   103us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.004326 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.004421 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.004614 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122,"prepare.queue_time_us":69932,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":3353,"raft.queue_time_us":73995,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10645,"spinlock_wait_cycles":275232256,"thread_start_us":1018623,"threads_started":2}
I20260709 12:14:44.845034  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.007656  9073 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:44.852684  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 617) took 1506 ms. Trace:
I20260709 12:14:45.009123  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:44.865953  9619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.040s
I20260709 12:14:45.008682  9624 rpcz_store.cc:276] 0709 12:14:43.345827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.346295 (+   468us) service_pool.cc:224] Handling call
0709 12:14:43.355604 (+  9309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.421618 (+ 66014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.421649 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.422079 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.826813 (+404734us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:43.826851 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.826928 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.852420 (+1025492us) raft_consensus.cc:1685] finished
0709 12:14:44.852443 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.852617 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32137,"raft.queue_time_us":61289,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":437787,"threads_started":2,"wal-append.queue_time_us":539754}
W20260709 12:14:44.844110 12617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.005s	sys 0.024s
I20260709 12:14:44.845350  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1694) took 1585 ms. Trace:
I20260709 12:14:44.730684 12864 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.885040  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:45.018842  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 133885us
I20260709 12:14:45.020272  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:44.887095  8917 rpcz_store.cc:276] 0709 12:14:43.324793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.802436 (+1477643us) service_pool.cc:224] Handling call
0709 12:14:44.802740 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.802909 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.802945 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:44.802994 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:44.803024 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.803076 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.803182 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.902249  9070 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:45.024392  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2878) took 1059 ms. Trace:
I20260709 12:14:44.888970  9065 raft_consensus.cc:2410] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:44.693771 12888 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:44.927698  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:44.886291 12796 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:44.998477  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.048s	sys 0.086s
I20260709 12:14:44.770807 12885 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.013569  8918 rpcz_store.cc:276] 0709 12:14:43.259868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.796483 (+1536615us) service_pool.cc:224] Handling call
0709 12:14:44.844638 (+ 48155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.844888 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.844928 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:44.844988 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:44.845033 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.845105 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.845267 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.015473  9073 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:14:45.189956  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2879) took 1224 ms. Trace:
I20260709 12:14:44.984376 12894 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:45.190485  9073 rpcz_store.cc:276] 0709 12:14:43.965497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.014746 (+1049249us) service_pool.cc:224] Handling call
0709 12:14:45.015169 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.189570 (+174401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.189884 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.066005  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:45.024940  9070 rpcz_store.cc:276] 0709 12:14:43.965166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.888298 (+923132us) service_pool.cc:224] Handling call
0709 12:14:44.888587 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.024061 (+135474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.024320 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.067965  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2881) took 1101 ms. Trace:
I20260709 12:14:45.010620 12875 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:45.194857  9065 rpcz_store.cc:276] 0709 12:14:43.966103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.806911 (+840808us) service_pool.cc:224] Handling call
0709 12:14:45.067897 (+260986us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:45.047109  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 188750us
I20260709 12:14:44.882649 12886 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 12:14:44.998906 12843 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.177493  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 736) took 1167 ms. Trace:
W20260709 12:14:45.179831  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.049s	sys 0.086s
I20260709 12:14:45.186115  9074 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:45.017642 12881 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.201112  9070 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:45.203370  9073 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:45.223872  9072 rpcz_store.cc:276] 0709 12:14:44.010569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.886750 (+876181us) service_pool.cc:224] Handling call
0709 12:14:45.177398 (+290648us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.226343  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2885) took 1237 ms. Trace:
I20260709 12:14:45.224846 12843 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.224910  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2882) took 1258 ms. Trace:
I20260709 12:14:45.232096  9074 rpcz_store.cc:276] 0709 12:14:43.966393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.016259 (+1049866us) service_pool.cc:224] Handling call
0709 12:14:45.177446 (+161187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.224522 (+ 47076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.224839 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.225672  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2886) took 1236 ms. Trace:
I20260709 12:14:45.235080  9070 rpcz_store.cc:276] 0709 12:14:43.989175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.200440 (+1211265us) service_pool.cc:224] Handling call
0709 12:14:45.200767 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.225341 (+ 24574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.225602 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.236918  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 732) took 1238 ms. Trace:
I20260709 12:14:45.237282  9070 rpcz_store.cc:276] 0709 12:14:43.998373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.235972 (+1237599us) service_pool.cc:224] Handling call
0709 12:14:45.236362 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.236553 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.236589 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.236637 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:45.236673 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.236733 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.236860 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.230641  9073 rpcz_store.cc:276] 0709 12:14:43.988933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.202522 (+1213589us) service_pool.cc:224] Handling call
0709 12:14:45.202894 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.226031 (+ 23137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.226277 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.186666 12729 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:45.240387  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 735) took 1241 ms. Trace:
I20260709 12:14:45.240724  9073 rpcz_store.cc:276] 0709 12:14:43.999208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.239666 (+1240458us) service_pool.cc:224] Handling call
0709 12:14:45.239931 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.240083 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.240109 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.240151 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:45.240188 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.240239 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.240340 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.242393  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 740) took 1214 ms. Trace:
W20260709 12:14:45.244113 12892 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 12:14:45.244588  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 741) took 1176 ms. Trace:
I20260709 12:14:45.245041  9072 rpcz_store.cc:276] 0709 12:14:44.067954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.243730 (+1175776us) service_pool.cc:224] Handling call
0709 12:14:45.244008 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.244209 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.244252 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.244305 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.244341 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.244402 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.244515 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.246811  9072 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:45.247601  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2891) took 1160 ms. Trace:
I20260709 12:14:45.248023  9072 rpcz_store.cc:276] 0709 12:14:44.087448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.246117 (+1158669us) service_pool.cc:224] Handling call
0709 12:14:45.246413 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.247177 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.247532 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.249601  9072 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:45.250692  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2892) took 1134 ms. Trace:
I20260709 12:14:45.251139  9072 rpcz_store.cc:276] 0709 12:14:44.116241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.248926 (+1132685us) service_pool.cc:224] Handling call
0709 12:14:45.249238 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.250407 (+  1169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.250635 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.239039  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 733) took 1240 ms. Trace:
I20260709 12:14:45.253712  9070 rpcz_store.cc:276] 0709 12:14:43.998646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.238264 (+1239618us) service_pool.cc:224] Handling call
0709 12:14:45.238595 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.238763 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.238786 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.238824 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:45.238851 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.238897 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.238990 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.242751  9073 rpcz_store.cc:276] 0709 12:14:44.027947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.241630 (+1213683us) service_pool.cc:224] Handling call
0709 12:14:45.241908 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.242081 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.242109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.242150 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.242185 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.242243 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.242343 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:45.255551  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 189637us
I20260709 12:14:45.257148  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:45.178612 12821 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:45.264460 12789 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.068785 12606 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 12:14:45.195566 12875 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.258663  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:45.194247 12796 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.277633 12789 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.261067 12881 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:45.294473 12900 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.295315 12875 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:45.295925 12864 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.200685 12902 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.253301 12888 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.266024 12720 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.467197 12789 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.283072 12207 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.468922 12207 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.471510 12207 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.476202 12737 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.476862 12207 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.477391 12207 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.477835 12207 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.327131 12219 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:45.304409  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 598) took 1912 ms. Trace:
I20260709 12:14:45.304477  9065 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:45.467396 12720 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.473376 12906 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:45.473875 12907 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:14:45.466591 12913 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:45.304790  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.480777  8918 rpcz_store.cc:276] 0709 12:14:43.392096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.195958 (+1803862us) service_pool.cc:224] Handling call
0709 12:14:45.238841 (+ 42883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.239230 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:45.239277 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.239783 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.276610 (+ 36827us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:45.276674 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.276780 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.304210 (+ 27430us) raft_consensus.cc:1685] finished
0709 12:14:45.304230 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.304353 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1870,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":36339,"threads_started":1,"wal-append.queue_time_us":57211}
I20260709 12:14:45.479727 12219 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.482096 12906 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:45.483319 12720 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.483618 12797 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.303838 12796 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.415035 12843 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.392634 12606 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.497342 12729 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:45.493227 12902 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.531780  8918 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: [6.7-9.8]
I20260709 12:14:45.538931 12914 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.494239 12913 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.563795  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 599) took 2171 ms. Trace:
I20260709 12:14:45.499527 12219 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:45.566216  8918 rpcz_store.cc:276] 0709 12:14:43.392392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.498883 (+2106491us) service_pool.cc:224] Handling call
0709 12:14:45.531514 (+ 32631us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.563478 (+ 31964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.563732 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.498449 12900 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.562211 12918 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.561022 12729 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.576787 12745 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.577381 12745 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.582089  8812 maintenance_manager.cc:419] P a8a9637095964e1e964bf3e778be9bbd: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033502
I20260709 12:14:45.559582 12906 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.583925 12906 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.565167 12207 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.588656 12900 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.589509 12902 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.590454 12729 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.531168 12606 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.605347 12923 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:45.606216 12841 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:14:45.606637 12923 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.618795  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 596) took 2227 ms. Trace:
W20260709 12:14:45.625830  9040 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.639s (SENT) [suppressed 17 similar messages]
I20260709 12:14:45.621011 12745 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.567584 12914 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.628404 12606 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.636164 12720 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.624595 12913 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.643416 12914 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.646826 12820 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:45.652969 12875 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:45.653440  9071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2871) took 3209 ms (client timeout 1685 ms). Trace:
W20260709 12:14:45.653985  9071 rpcz_store.cc:269] 0709 12:14:42.443591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.446339 (+  2748us) service_pool.cc:224] Handling call
0709 12:14:45.653276 (+3206937us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:45.653378 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3265050368}
I20260709 12:14:45.604554 12918 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.653492 12820 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:45.656163 12820 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.656345 12219 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.657023 12918 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.657176 12820 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.658443 12219 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.662665  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 854) took 1629 ms. Trace:
I20260709 12:14:45.655164  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1451) took 2964 ms. Trace:
I20260709 12:14:45.663045  9620 rpcz_store.cc:276] 0709 12:14:44.033730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.033843 (+   113us) service_pool.cc:224] Handling call
0709 12:14:44.071754 (+ 37911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.183536 (+111782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.183581 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:44.183636 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:44.183681 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.662426 (+1478745us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400477a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:45.662474 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.662606 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256468736}
I20260709 12:14:45.652618 12720 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:45.663374  8999 rpcz_store.cc:276] 0709 12:14:42.691184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.691440 (+   256us) service_pool.cc:224] Handling call
0709 12:14:42.691864 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.692325 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.692366 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.692911 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.892162 (+199251us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.933621 (+ 41459us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.938273 (+  4652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.938347 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.370176 (+2431829us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180032ef60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:45.654851 (+284675us) raft_consensus.cc:1685] finished
0709 12:14:45.654948 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.655084 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4133,"prepare.queue_time_us":42221,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":5168,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":39608,"spinlock_wait_cycles":5634816,"thread_start_us":114152,"threads_started":1,"wal-append.queue_time_us":187427}
I20260709 12:14:45.669732 12923 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.672014  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 731) took 1674 ms. Trace:
I20260709 12:14:45.672443  9074 rpcz_store.cc:276] 0709 12:14:43.998059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.233040 (+1234981us) service_pool.cc:224] Handling call
0709 12:14:45.233569 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.286266 (+ 52697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.286303 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:45.286961 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 12:14:45.574888 (+287927us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:45.574950 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.575042 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.671776 (+ 96734us) raft_consensus.cc:1685] finished
0709 12:14:45.671797 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.671952 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52125,"raft.queue_time_us":59841,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":118266,"threads_started":1,"wal-append.queue_time_us":336761}
I20260709 12:14:45.674362 12797 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.674989 12797 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.675529  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 597) took 2283 ms. Trace:
I20260709 12:14:45.642369 12901 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.675891  8917 rpcz_store.cc:276] 0709 12:14:43.391803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.022348 (+1630545us) service_pool.cc:224] Handling call
0709 12:14:45.022798 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.023083 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.023119 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.023734 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.501669 (+477935us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:45.501704 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.501856 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.675306 (+173450us) raft_consensus.cc:1685] finished
0709 12:14:45.675327 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.675469 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":301871,"threads_started":1,"wal-append.queue_time_us":491857}
I20260709 12:14:45.677151 12797 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.676764 12901 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.666144 12737 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.679359 12737 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.681880 12737 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.686635 12724 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:45.688573  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 62790.6us
I20260709 12:14:45.691852  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:45.692624 12219 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:45.693810  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:45.694550 12219 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:45.694864  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2282) took 2742 ms. Trace:
I20260709 12:14:45.695952 12931 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:45.664646 12875 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.695444  8916 rpcz_store.cc:276] 0709 12:14:42.952240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.952369 (+   129us) service_pool.cc:224] Handling call
0709 12:14:42.977746 (+ 25377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:43.363965 (+386219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.694557 (+2330592us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000cadd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:45.694792 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886713728}
I20260709 12:14:45.705426  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:45.705855  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.706302  8916 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:45.710813  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.711898  8916 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:45.712899  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.714903  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:45.715359  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 591) took 3091 ms. Trace:
I20260709 12:14:45.720129  8916 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.715909  8924 rpcz_store.cc:276] 0709 12:14:42.623689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.730825 (+107136us) service_pool.cc:224] Handling call
0709 12:14:42.731213 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.748658 (+ 17445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.748689 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.764290 (+ 15601us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.806683 (+ 42393us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:42.806752 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.708246 (+2901494us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b540008b6d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:45.708313 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.708377 (+    64us) raft_consensus.cc:1685] finished
0709 12:14:45.708395 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.715271 (+  6876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11954,"raft.queue_time_us":650,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20595,"spinlock_wait_cycles":20239744,"thread_start_us":13391,"threads_started":1,"wal-append.queue_time_us":22205,"wal-append.run_cpu_time_us":2030,"wal-append.run_wall_time_us":1031860}
I20260709 12:14:45.710510 12785 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.721344  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.722986  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.724990  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.725971  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:45.726819  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:45.727276  8924 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.731351 12823 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.722002 12785 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.742427  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:45.751546  8920 raft_consensus.cc:2376] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11. Re-sending same reply.
I20260709 12:14:45.751987  8916 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:45.752521  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33456 (request call id 23) took 2312 ms. Trace:
I20260709 12:14:45.752661  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.752941  9066 rpcz_store.cc:276] 0709 12:14:43.439916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.441600 (+  1684us) service_pool.cc:224] Handling call
0709 12:14:45.752318 (+2310718us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c35853 00007f398ac0360a 00007f39841897d4 00007f3984189762 00007f3984189691 00007f398418960c 00007f39841888c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:45.752435 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278875008}
I20260709 12:14:45.744213  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 616) took 2398 ms. Trace:
I20260709 12:14:45.753813  9623 rpcz_store.cc:276] 0709 12:14:43.345493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.345623 (+   130us) service_pool.cc:224] Handling call
0709 12:14:43.345941 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.415031 (+ 69090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.415054 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.417899 (+  2845us) log.cc:844] Serialized 26 byte log entry
0709 12:14:43.842802 (+424903us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:43.842848 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.743730 (+1900882us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400787154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:45.743785 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.743837 (+    52us) raft_consensus.cc:1685] finished
0709 12:14:45.743853 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.744109 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35892,"raft.queue_time_us":58121,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":29925760,"thread_start_us":411289,"threads_started":1,"wal-append.queue_time_us":476818}
I20260709 12:14:45.745971  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 588) took 3127 ms. Trace:
I20260709 12:14:45.755568  8919 rpcz_store.cc:276] 0709 12:14:42.618968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.621497 (+  2529us) service_pool.cc:224] Handling call
0709 12:14:42.621768 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.604403 (+1982635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.745734 (+1141331us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400331154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:45.745910 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4342973184}
I20260709 12:14:45.756740  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.757531  8919 raft_consensus.cc:2410] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:45.757674  8924 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:45.758026 12785 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.758493  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.759717  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.760406 12779 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.762466  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:45.752806  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.763991  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.763864 12785 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:45.764218  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:45.762763 12779 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:45.776366  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:45.776055 12820 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:45.787431 12931 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:45.788362 12931 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:45.789628 12931 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.793696 12606 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.794718 12820 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:45.794416 12606 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.816010 12820 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.844781 12800 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:45.847486  8925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 606) took 2300 ms (client timeout 1938 ms). Trace:
W20260709 12:14:45.848038  8925 rpcz_store.cc:269] 0709 12:14:43.547164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.942074 (+394910us) service_pool.cc:224] Handling call
0709 12:14:45.847183 (+1905109us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:45.847356 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209437056}
I20260709 12:14:45.842237 12531 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.780143 12785 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:45.857112  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 601) took 2464 ms. Trace:
I20260709 12:14:45.861922 12923 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.863555  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.856206  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.876220 12923 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.875895  8917 rpcz_store.cc:276] 0709 12:14:43.392988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.677189 (+2284201us) service_pool.cc:224] Handling call
0709 12:14:45.677531 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.677891 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.677916 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.678358 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.720510 (+ 42152us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.720548 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.720609 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.856864 (+136255us) raft_consensus.cc:1685] finished
0709 12:14:45.856887 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.857051 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1038,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":40827,"threads_started":1,"wal-append.queue_time_us":85802}
I20260709 12:14:45.877538  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1697) took 2401 ms. Trace:
I20260709 12:14:45.877887  8916 rpcz_store.cc:276] 0709 12:14:43.475743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.876730 (+2400987us) service_pool.cc:224] Handling call
0709 12:14:45.877076 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.877241 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.877265 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.877302 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:45.877336 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.877384 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.877475 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39296}
W20260709 12:14:45.873077  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61319.9us
W20260709 12:14:45.879719  8964 leader_election.cc:336] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.950s (SENT)
I20260709 12:14:45.880147  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:45.872071 12919 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.881825  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 603) took 2467 ms. Trace:
I20260709 12:14:45.882376  8925 rpcz_store.cc:276] 0709 12:14:43.414082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.855125 (+2441043us) service_pool.cc:224] Handling call
0709 12:14:45.881214 (+ 26089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.881432 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.881469 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.881527 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.881573 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.881642 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.881758 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
I20260709 12:14:45.878784 12923 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.889578  8916 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:45.892578  8964 leader_election.cc:336] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.236s (SENT)
I20260709 12:14:45.893078  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:45.893082 12913 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:45.891791 12531 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.891000 12918 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.896425 12918 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.898487 12918 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.891342 12923 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:45.899350 12923 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:45.901594 12923 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.902077 12923 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.903694 12901 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.904909  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:45.905941  8916 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:45.899067 12732 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:45.909070 12732 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:45.909567  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2285) took 2951 ms (client timeout 1803 ms). Trace:
W20260709 12:14:45.909960  8922 rpcz_store.cc:269] 0709 12:14:42.958303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.097123 (+138820us) service_pool.cc:224] Handling call
0709 12:14:45.909345 (+2812222us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400244354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:45.909467 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738722048}
I20260709 12:14:45.911118 12732 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:45.911652 12902 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:45.911933  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 729) took 2991 ms (client timeout 2128 ms). Trace:
I20260709 12:14:45.911994 12913 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:45.917821  8966 connection.cc:256] RPC call timeout handler was delayed by -1.3410248600000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 12:14:45.918270  8966 connection.cc:256] RPC call timeout handler was delayed by -1.0449248600000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 12:14:45.918570  8966 connection.cc:256] RPC call timeout handler was delayed by -1.0359248600000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 12:14:45.913416  8997 rpcz_store.cc:269] 0709 12:14:42.920028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.945950 (+ 25922us) service_pool.cc:224] Handling call
0709 12:14:45.911742 (+2965792us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540039c1d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:45.911836 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49214336}
I20260709 12:14:45.920116  8991 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:14:45.920570  8991 pending_rounds.cc:85] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 5
I20260709 12:14:45.920887  8991 pending_rounds.cc:107] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:14:45.921157  8991 raft_consensus.cc:2889] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.891567 12914 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.926472  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:45.907397 12207 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.929364  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:45.930195  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:45.935062  9066 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:45.935977  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:45.938889  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.940286  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 607) took 2319 ms. Trace:
I20260709 12:14:45.943851  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:45.931136  8991 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:45.944700  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.913007 12935 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.885607 12919 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.946610  9071 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:45.956684  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.957541  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.964877  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:45.959551  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.965395  8991 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:45.960412  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.961203  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.966434  9621 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:45.961449  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.905272 12719 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:14:45.916016 12286 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:45.916364 12918 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:45.976445  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 83895us
I20260709 12:14:45.922931 12884 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:45.971756  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.977831  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.979300  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:45.961969  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.972833  9618 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:45.912274 12902 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.973829  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.974117  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.983768  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.984333  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:45.984867  9073 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:45.969113  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:45.973426  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.982437  8889 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:45.981418  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:45.984751  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:45.987756  8995 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.995266  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.995875  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:45.996912  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:45.961879 12700 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:45.911664 12923 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.003919  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:45.998461  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:46.000583  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.001613  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:46.004987  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.004988  8992 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:46.005743  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.946213 12914 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:45.926291 12913 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.012151  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:45.948977 12219 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:14:46.007979 12803 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.008427  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:45.996343 12870 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.978928 12724 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.996376 12823 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.963203 12207 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.006789 12700 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.018759  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:45.964282 12785 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.021924  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.000002 12884 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:46.009102 12902 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.022663  8995 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:46.025594  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:45.970696 12935 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:46.047556  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.079519  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53970.8us
W20260709 12:14:46.020671  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48345.1us
I20260709 12:14:46.080555  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.080870  9588 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.025077 12737 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:46.056524  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.047956  8996 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:46.074102  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.075690  9000 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:46.076272  9615 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:46.076924  9073 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:46.050689  8991 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:46.086990  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.087219  8994 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.039970 12724 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.072851 12732 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:46.093008  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:46.074769 12870 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:46.102136  8999 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:46.115293  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.083930 12918 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.116142  8992 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:46.115293  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.119064  8925 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:46.088821 12902 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:46.088539 12885 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.121663  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.101141 12959 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.072664 12823 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.091576 12737 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:46.133783 12700 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.133963 12923 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.134840 12843 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:46.111507 12797 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.133805 12737 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.130344  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.128232  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.130861  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.094523 12948 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:46.096120 12957 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.142089  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.145840 12935 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:46.147778 12944 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:14:46.148196 12724 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.117563 12803 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:14:46.103629 12958 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:14:46.151767 12958 consensus_queue.cc:1243] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:46.153430  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.154313  8922 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:46.155143  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.155875 12957 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.117532 12951 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:46.157232 12951 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.157611 12951 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:46.158936 12957 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.160960  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.163412  9066 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:46.163546  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.156265  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.172251  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.158408 12951 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:46.164201 12943 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:14:46.165031  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.197348  9074 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:14:46.205518  9074 pending_rounds.cc:85] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 8
I20260709 12:14:46.205893  9074 pending_rounds.cc:107] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:14:46.206247  9074 raft_consensus.cc:2889] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:46.210525  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.211552  9621 raft_consensus.cc:2410] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:14:46.170663 12919 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:46.215839  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 43708us
I20260709 12:14:46.174867 12790 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.218870  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.219062  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.214890 12947 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.202735 12732 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:46.202524 12913 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:46.209532 12950 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:14:46.207679 12897 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:14:46.220291  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 117749us
I20260709 12:14:46.201858 12699 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.198290 12777 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.218887 12951 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.202221 12859 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:46.221829 12700 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.212972 12661 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:46.208880 12902 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:46.216221 12914 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.235455 12790 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:46.236661 12531 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:14:46.193337 12884 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.253342  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.255324  9616 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:46.260033  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:46.258864  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.242558 12700 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.262125  9074 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:46.248299 12207 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.232295 12947 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.272521 12947 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.251506 12897 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:45.619601  8923 rpcz_store.cc:276] 0709 12:14:43.391438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.804029 (+1412591us) service_pool.cc:224] Handling call
0709 12:14:44.804426 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.808859 (+  4433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.808905 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.809466 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.017208 (+207742us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:45.617974 (+600766us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.618354 (+   380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.618451 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.618509 (+    58us) raft_consensus.cc:1685] finished
0709 12:14:45.618527 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.618729 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3729,"raft.queue_time_us":4034,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":43408,"thread_start_us":559499,"threads_started":2,"wal-append.queue_time_us":622219}
I20260709 12:14:46.276235 12897 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:46.278185  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.280719 12606 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:46.248474 12797 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:14:46.288025 12823 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.289888  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2888) took 2300 ms. Trace:
I20260709 12:14:46.290324  9065 rpcz_store.cc:276] 0709 12:14:43.989739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.216476 (+1226737us) service_pool.cc:224] Handling call
0709 12:14:45.216859 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.480816 (+263957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.289635 (+808819us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b5400368654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:46.289824 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200757120}
I20260709 12:14:46.291535 12902 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:46.294471 12534 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:46.294930 12956 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:14:46.263972  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.265115  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.265633 12751 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.265900  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:46.251048 12870 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:14:46.267131  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.276367  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.300721  8993 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:46.242727 12724 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:14:46.267653 12732 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.242254 12885 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:14:46.252422 12661 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.270023 12700 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.295514 12534 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:46.308037  8993 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.297969  9071 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:46.309374  8993 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:46.299678  9073 raft_consensus.cc:2376] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11. Re-sending same reply.
I20260709 12:14:46.301460  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.310709  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.249219 12859 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.327561  9069 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:46.328096  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.330559  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:46.332393  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:46.300148 12827 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:14:46.311161 12534 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:46.326875 12965 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.344787 12661 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:46.312057 12207 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.357761 12797 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:46.329725 12945 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.337893 12919 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:46.360924  8922 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.331386 12751 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.332203 12893 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.371498  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.389457  8998 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:46.391516  8922 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:46.365833  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:46.366758 12902 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.367683 12965 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.369040 12207 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.417984 12879 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.418515 12879 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:46.418785 12700 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.422821 12700 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.399300 12580 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.370391 12872 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:46.399446 12820 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:46.397619 12931 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:14:46.376269 12945 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.399092 12751 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.438005 12945 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.405097 12893 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.450147 12893 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.451682 12859 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.453872  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:46.435871 12879 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:46.442236 12966 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:14:46.456347  8921 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:46.450680 12821 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:46.457386 12821 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:46.457932  8999 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:46.458451 12821 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.459995 12821 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.460546  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.426440 12580 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.468746  8991 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:46.457335  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1689) took 3258 ms. Trace:
I20260709 12:14:46.470229  8921 rpcz_store.cc:276] 0709 12:14:43.198856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.617745 (+1418889us) service_pool.cc:224] Handling call
0709 12:14:44.658850 (+ 41105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:46.456137 (+1797287us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b540020d120. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb2dc0 00007f3985c3d1c0 00007f3985c3e231 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c
0709 12:14:46.456986 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.457259 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180093824}
I20260709 12:14:46.473560 12692 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:46.474143  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.435753 12872 consensus_queue.cc:1243] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:46.482551 12207 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.484082  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.485793  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:46.486692 12883 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:46.492326  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.493928  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.516683  9618 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:46.495951  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:46.504786  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.504828  8888 connection.cc:256] RPC call timeout handler was delayed by -1.2503161540000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 12:14:45.940622  8917 rpcz_store.cc:276] 0709 12:14:43.621444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.877470 (+2256026us) service_pool.cc:224] Handling call
0709 12:14:45.877727 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.877898 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:45.878182 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.940036 (+ 61854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.940087 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:45.940128 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.940172 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.940245 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":465,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":88,"thread_start_us":61547,"threads_started":1}
I20260709 12:14:46.519860  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:46.529115  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.456357 12879 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.551776  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:46.476240 12580 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.553642  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:46.556604  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:46.564488  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 102388us
I20260709 12:14:46.431691 12534 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.565681  8996 pending_rounds.cc:85] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 3
I20260709 12:14:46.570338  8996 pending_rounds.cc:107] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:14:46.570669  8996 raft_consensus.cc:2889] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:46.518600 12872 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.515825 12883 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:46.566839  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:46.565280 12823 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.566126 12724 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:46.572190 12885 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:46.568815  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:46.586913  9621 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:46.569242 12959 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:46.578047 12534 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:46.576525 12872 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.601138 12870 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:46.612020  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.600770 12897 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:46.597985 12724 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.599835 12914 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:46.599540 12885 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.614998  8991 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:46.618644 12751 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.609997 12918 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.637251  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 70502.5us
I20260709 12:14:46.650072  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:46.656860  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.657971  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.658460  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.635854 12897 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.662496  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.645671 12724 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:46.648813 12885 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.666338  8991 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:46.673262  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.674609  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.675313  8991 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:46.676275  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:46.652580 12732 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.650507 12914 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.655052 12918 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.694175 12918 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.694721 12540 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.620680 12883 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.696485  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.697081 12883 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.698122 12727 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.701323 12727 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:46.706065 12972 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:14:46.707648 12580 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.737484 12580 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:46.710660  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.742489  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.743330  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.743981  9070 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:46.744019  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.745003  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.747038  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:46.747788 12951 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:46.748255 12951 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.748741 12732 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:46.750114  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.750761  9067 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:46.750944 12975 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:14:46.729499 12965 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.735145  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 602) took 3321 ms. Trace:
W20260709 12:14:46.748396 12976 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:46.748446 12751 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.753744  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:46.728674 12971 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:14:46.748775 12951 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:46.758533 12779 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:46.760185  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 624) took 3152 ms. Trace:
I20260709 12:14:46.748278  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.803939  9066 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:46.801153  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.761734 12914 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.724536  8920 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:46.762607  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:46.807291  9071 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:46.743197  8994 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:46.699908  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:46.808223  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.765519  9073 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:14:46.667577 12897 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:46.752231 12979 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:14:46.815106  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 115276us
I20260709 12:14:46.775585  9068 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:46.776676  8924 rpcz_store.cc:276] 0709 12:14:43.413779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.761897 (+2348118us) service_pool.cc:224] Handling call
0709 12:14:45.911378 (+149481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.913705 (+  2327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.913750 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.924311 (+ 10561us) log.cc:844] Serialized 26 byte log entry
0709 12:14:46.049049 (+124738us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:46.049085 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.049290 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:46.098135 (+ 48845us) raft_consensus.cc:1685] finished
0709 12:14:46.098160 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:46.254425 (+156265us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b48002dc0d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:46.734961 (+480536us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400244350. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:46.735079 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"raft.queue_time_us":2526,"raft.run_cpu_time_us":2594,"raft.run_wall_time_us":340918,"spinlock_wait_cycles":354392576,"thread_start_us":70744,"threads_started":1,"wal-append.queue_time_us":146987}
I20260709 12:14:46.762120  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.787949  9000 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:46.792663  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:46.824201  8996 raft_consensus.cc:2376] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9. Re-sending same reply.
W20260709 12:14:46.763901  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.751029 12732 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:46.801977  9619 rpcz_store.cc:276] 0709 12:14:43.607547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.607702 (+   155us) service_pool.cc:224] Handling call
0709 12:14:43.608022 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.086405 (+478383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.086433 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.091499 (+  5066us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.010168 (+918669us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.189391 (+179223us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.908166 (+718775us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b1800416620. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:45.959131 (+ 50965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:46.759859 (+800728us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54004d6a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:46.759914 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:46.759960 (+    46us) raft_consensus.cc:1685] finished
0709 12:14:46.759977 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:46.760125 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52052,"prepare.queue_time_us":4735,"prepare.run_cpu_time_us":6308,"prepare.run_wall_time_us":107243,"raft.queue_time_us":833535,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":44611,"spinlock_wait_cycles":1091267712,"thread_start_us":1073073,"threads_started":3,"wal-append.queue_time_us":802116,"wal-append.run_cpu_time_us":3152,"wal-append.run_wall_time_us":1251770}
W20260709 12:14:46.826009  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.787765 12751 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.848790  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:46.849375  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 87338.2us
I20260709 12:14:46.858994  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.867497  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.870774  9588 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:46.871798  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.871970  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.870042 12534 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.874212 12534 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:46.874610 12534 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:46.874614  9068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 2872) took 4430 ms (client timeout 1518 ms). Trace:
I20260709 12:14:46.876935  9617 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:46.859771 12751 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.888931  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.894639  9615 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:46.895757  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.896417  8994 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
W20260709 12:14:46.877437  9068 rpcz_store.cc:269] 0709 12:14:42.443902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.446423 (+  2521us) service_pool.cc:224] Handling call
0709 12:14:46.874415 (+4427992us) spinlock_profiling.cc:243] Waited 4.23 s on lock 0x7b54002d46d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:46.874508 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9719662336}
I20260709 12:14:46.844736 12700 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.887650  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.871948 12827 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:46.887317  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.899667 12700 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:46.919883  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49147.9us
I20260709 12:14:46.922299  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:46.923768  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.872485 12732 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:14:46.927896 12872 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:46.927672 12172 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:46.900321 12849 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:46.905328 12700 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.934839  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.936133  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.937995  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:46.901954 12827 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:46.944012  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:46.867650 12869 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:14:46.929677 12891 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.954929  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.956396  9624 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:46.959018  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:46.947192 12827 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:46.962612  8999 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:46.942793 12902 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:46.957176 12172 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.955657 12891 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:46.972950  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.970562  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:14:46.978596 12983 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:14:46.980297  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.980909  8997 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:46.981732  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.983052  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:46.977967 12891 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:46.975560 12172 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:47.021912  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.007864 12730 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.007723 12821 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.007506 12785 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:47.037171  8998 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:47.032246 12973 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:14:46.974761 12902 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.032553 12172 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.071064  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.047371 12905 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.023041 12724 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.071992  8994 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:47.080461  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:47.081372  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:47.081605  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.082140  8994 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.078811 12902 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.036067 12730 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.079319 12534 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.084041  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.094465  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.085816  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:47.079417 12700 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.040321 12821 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.043721 12785 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:47.112109  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.114188  8993 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:47.134459 12700 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.161576  8999 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:47.083680 12905 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.180609  8994 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:47.185592  8999 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:14:47.187564  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.195762 12534 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:47.197424 12988 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:14:47.198629 12987 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:14:47.200223 12730 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:47.148571 12893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.018s	sys 0.019s
I20260709 12:14:47.205041  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:47.210533  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 266635us
W20260709 12:14:47.214214  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.198693 12779 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:47.195773 12980 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:14:47.209450 12893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.018s	sys 0.020s
W20260709 12:14:47.220414  8992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.002s	sys 0.032s
W20260709 12:14:47.223028  8992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.002s	sys 0.032s
I20260709 12:14:47.227807  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:47.227921  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:47.232759  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:47.239499  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.239292  8994 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:14:47.244161 12991 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:14:47.244836  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.249090 12730 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:47.249766 12730 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.249835 12827 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.227394 12849 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:47.253451 12172 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.256618 12849 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.261870  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 750) took 1308 ms. Trace:
I20260709 12:14:47.262316  9069 rpcz_store.cc:276] 0709 12:14:45.953860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.000566 (+ 46706us) service_pool.cc:224] Handling call
0709 12:14:46.002840 (+  2274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:46.329680 (+326840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.261672 (+931992us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54002d50d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:47.261816 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746338048}
I20260709 12:14:47.264304  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 600) took 3871 ms. Trace:
I20260709 12:14:47.264704  8918 rpcz_store.cc:276] 0709 12:14:43.392695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.567744 (+2175049us) service_pool.cc:224] Handling call
0709 12:14:45.602218 (+ 34474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:46.362041 (+759823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:46.362071 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:46.362618 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 12:14:46.597770 (+235152us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:46.606661 (+  8891us) log.cc:844] Serialized 14 byte log entry
0709 12:14:46.750384 (+143723us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:47.262806 (+512422us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18000e95c0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:47.262978 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.263991 (+  1013us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400218754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:47.264036 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.264080 (+    44us) raft_consensus.cc:1685] finished
0709 12:14:47.264099 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.264243 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28708,"prepare.queue_time_us":9835,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1885,"raft.queue_time_us":27479,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6044,"spinlock_wait_cycles":1702910848,"thread_start_us":193195,"threads_started":1,"wal-append.queue_time_us":275398}
I20260709 12:14:47.270776  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:47.276021  9072 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:47.279398  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:47.280236  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 628206us
I20260709 12:14:47.305151  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:47.306028  9074 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.280174 12172 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.309000  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.311558  9073 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:47.275015 12870 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:47.312736  9069 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:14:47.328300 12993 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:14:47.328876 12986 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:14:47.330003 12905 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:47.332757  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1696) took 3918 ms. Trace:
I20260709 12:14:47.333168  8919 rpcz_store.cc:276] 0709 12:14:43.414171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.811394 (+3397223us) service_pool.cc:224] Handling call
0709 12:14:46.856057 (+ 44663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:46.856320 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:46.864485 (+  8165us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.320551 (+456066us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.332415 (+ 11864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:47.332464 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:47.332511 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.332570 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.332689 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215360,"prepare.queue_time_us":8861,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":87,"raft.queue_time_us":210584,"spinlock_wait_cycles":11550592,"thread_start_us":251429,"threads_started":1,"wal-append.queue_time_us":368893}
I20260709 12:14:47.285420 12724 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.337364 12823 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:47.337926 12823 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.263465 12827 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.341866 12823 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.344141 12870 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.345793  9072 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:47.303680 12785 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.347862 12821 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.358597  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:47.394351  9074 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:47.422451 12897 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
I20260709 12:14:47.425724 12897 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.428292 12730 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.429940 12897 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:47.431628  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.433203  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:47.370872 12751 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.435777  8993 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:47.441454  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 183868us
W20260709 12:14:47.474665 12885 consensus_meta.cc:287] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
I20260709 12:14:47.481853  8889 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:47.489573 12724 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:47.492569  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 163018us
I20260709 12:14:47.493750  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:47.494897  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:47.498697  8925 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:47.478237 12959 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.495903 12823 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:47.497328 12893 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.515581  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 269172us
I20260709 12:14:47.524132  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.488826 12885 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.528208  8919 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 12:14:47.520097 12928 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.267s	user 0.004s	sys 0.003s
I20260709 12:14:47.533180  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:47.531157 13006 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:47.531133 12821 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.533295 12779 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.538285 12885 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.520496 12893 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.539703  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.579756  9616 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:47.580432  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.582098  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.531795 12901 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:14:47.531596 12751 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:47.536154 12951 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.002s
W20260709 12:14:47.586539  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89896.1us
I20260709 12:14:47.547919 12870 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.510610 12823 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.191461  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:47.513584 13007 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.564234  9615 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:47.566092  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.566521  8918 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.569114 12779 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.566493 13006 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:47.509333 12959 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.578308 13009 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:47.586206 12730 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:47.584118  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 89297.9us
I20260709 12:14:47.585286  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.624400  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:47.613844 12891 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 12:14:47.630291  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.632073  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.602263 12823 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.601119 12785 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:47.613515 12931 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:47.600771 12821 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.640096  8919 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:47.638752  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.642153  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.642808  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.645383  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:47.602113 12914 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:47.587275 12951 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:47.681133  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 87530.8us
I20260709 12:14:47.652295  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:47.645570  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58031.9us
I20260709 12:14:47.685190  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.650513  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.686290  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:47.685349  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:47.687743  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.692026  8925 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.648334  8995 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:14:47.648710  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.695053  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:47.693923  9065 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:47.697403  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.686861  9074 raft_consensus.cc:2376] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11. Re-sending same reply.
I20260709 12:14:47.699383  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.700335  8916 raft_consensus.cc:2368] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:47.698894  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.625974 13009 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:47.702984  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.705459  8995 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:47.708675  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.709192  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.710419  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.712132  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.719976  8916 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:47.647629 12901 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:47.713152  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.648211 12730 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:47.718032  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.718245  8992 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:47.718634  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.618378 13007 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.646520 12931 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:47.715407  8966 leader_election.cc:400] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:47.755987  8966 leader_election.cc:403] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:47.710399 13017 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:47.715898 13002 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:47.721516  8925 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:47.643378 12959 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.649505 12661 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:47.723937  9066 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:47.724224  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.731686  9074 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:47.650863 12779 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.731462  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.756973  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:47.720943  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:47.645954 12891 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.706095 13006 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.708472 12914 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:47.722806  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.759042  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:47.722749  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.076246  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.018122  9616 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:48.084836  9616 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:48.086545  8925 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:14:48.097813  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:48.104466  9065 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:48.114046  9616 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:47.872783 13010 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:14:47.792446 12962 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:48.120888  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.017287 12902 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.120908  9621 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:48.106081 12897 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:48.108829 12959 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:47.761052 12751 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:14:48.124600 12914 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:47.790153 12823 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.081390 12661 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:48.113757 13006 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:48.126540 12779 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:48.127409  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.128438  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.143821  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.130568  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:48.129503  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.145468  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:48.127439  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1467) took 1268 ms. Trace:
I20260709 12:14:48.146627  8993 rpcz_store.cc:276] 0709 12:14:46.858620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.124301 (+265681us) service_pool.cc:224] Handling call
0709 12:14:47.125278 (+   977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.436277 (+310999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.127173 (+690896us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54000f55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:48.127376 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713554688}
I20260709 12:14:48.133461  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1700) took 4580 ms. Trace:
I20260709 12:14:48.148108  8920 rpcz_store.cc:276] 0709 12:14:43.553123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.876766 (+2323643us) service_pool.cc:224] Handling call
0709 12:14:45.877076 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:46.806910 (+929834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.133202 (+1326292us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54001e55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:48.133396 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947908480}
I20260709 12:14:48.134716  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.029181 12869 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:48.136981  9068 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:47.789152 12951 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:47.783295 13020 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:48.144904  8998 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:48.167337  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1490) took 1128 ms. Trace:
I20260709 12:14:48.167809  8998 rpcz_store.cc:276] 0709 12:14:47.038604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.130305 (+1091701us) service_pool.cc:224] Handling call
0709 12:14:48.167270 (+ 36965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.106832 13007 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.153697  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:48.156718  9037 connection.cc:256] RPC call timeout handler was delayed by -1.2603907620000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 12:14:48.157135  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:48.173033  9037 connection.cc:256] RPC call timeout handler was delayed by -1.2477907620000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:14:48.171334  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:48.173756  9037 connection.cc:256] RPC call timeout handler was delayed by -1.2306907619999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:14:48.174238  9037 connection.cc:256] RPC call timeout handler was delayed by -1.1847907619999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:14:48.174665  9037 connection.cc:256] RPC call timeout handler was delayed by -1.1568907620001028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 12:14:48.174877  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.099115  9615 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:48.172933  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.177839  8921 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:14:48.178378  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.183077  9071 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:14:48.187469  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.188674  9074 raft_consensus.cc:2410] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:14:47.782903 12931 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.783985 13017 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.190856  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.200275  9068 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:48.158835 12914 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:48.175067  9037 connection.cc:256] RPC call timeout handler was delayed by -1.0497907619999296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 12:14:48.203043  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:48.177048 12779 consensus_queue.cc:1243] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:48.140930 12902 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.141727 12959 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:47.789453 13009 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.141824 12897 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.209179 12999 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:48.176368 12869 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.181725 13020 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.240428 12999 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.246258 12959 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.256328 13017 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.256503 13020 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.296427  8916 raft_consensus.cc:2410] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:14:48.297953  8917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.001s	sys 0.013s
I20260709 12:14:48.298347  8923 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
W20260709 12:14:48.159029  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 513677us
W20260709 12:14:48.303756  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.033s
W20260709 12:14:48.304355  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.003s	sys 0.033s
W20260709 12:14:48.304891  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 582090us
W20260709 12:14:48.306102  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 103014us
I20260709 12:14:48.307420  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 775) took 1253 ms. Trace:
W20260709 12:14:48.298698  8917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.001s	sys 0.013s
I20260709 12:14:48.308084  8999 rpcz_store.cc:276] 0709 12:14:47.049617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.635978 (+586361us) service_pool.cc:224] Handling call
0709 12:14:47.649026 (+ 13048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:47.649397 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.649424 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:47.649847 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:14:47.843013 (+193166us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:47.843075 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.843175 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:48.302452 (+459277us) raft_consensus.cc:1685] finished
0709 12:14:48.302584 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.303010 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2089,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7741,"thread_start_us":190806,"threads_started":1,"wal-append.queue_time_us":568701}
W20260709 12:14:48.312098  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 281676us
I20260709 12:14:48.312526 12661 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.315061 12661 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.315847  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 206418us
I20260709 12:14:48.318454  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:48.310819  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:48.321184  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:48.325260 12700 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:48.329120 12727 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:48.332935 12730 raft_consensus.cc:2764] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:48.335431 12730 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:48.330379 12727 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.337224  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:48.340696  9615 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:48.338430  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:48.342031 12727 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.342759 12727 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.343859 12727 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.308288  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:48.350597  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 881) took 1116 ms. Trace:
I20260709 12:14:48.352243  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 907) took 1851 ms. Trace:
I20260709 12:14:48.352536  9623 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.352727  9624 rpcz_store.cc:276] 0709 12:14:46.500801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.500952 (+   151us) service_pool.cc:224] Handling call
0709 12:14:46.501245 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:46.956899 (+455654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.351662 (+1394763us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540067fa54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:48.352025 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040958336}
I20260709 12:14:48.351109  9621 rpcz_store.cc:276] 0709 12:14:47.233503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.233632 (+   129us) service_pool.cc:224] Handling call
0709 12:14:47.233875 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.138448 (+904573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.349971 (+211523us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54004e8754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:48.350323 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033844608}
I20260709 12:14:48.369697 12785 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:48.380827 12700 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:48.373572  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:48.373898 12724 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.382786 12724 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:48.385138  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.391827  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:48.374487 12727 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.234229 12931 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.431672 13006 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:48.432535 13006 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:48.433153 13006 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.439986 13007 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:48.441346 12823 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:48.444852  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71621.1us
I20260709 12:14:48.446034  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:48.447836 13024 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.448925 13024 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.449271 13024 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:48.449921 13024 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.449187  9616 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:48.457763  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 66285.9us
W20260709 12:14:48.472359 12870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.017s	sys 0.030s
W20260709 12:14:48.472975 12870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.017s	sys 0.030s
I20260709 12:14:48.472750  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.473985  8916 raft_consensus.cc:2410] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:48.474320 12914 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:48.475189 12914 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.477619  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.478062 12914 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.482084  8919 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:48.482781  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.483974  8917 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:48.483814  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.485359  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.486946  8924 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.488334 12891 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.488386 12724 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.494177 12902 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.495430 12999 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:48.495862 12821 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:48.495923  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.496779 12821 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.499948  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:48.503679  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.504514  9066 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:48.505064  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.506938  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1481) took 1489 ms. Trace:
W20260709 12:14:48.521626  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 211126us
I20260709 12:14:48.525007  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:48.486873 12897 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.534835  8924 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:14:48.538717  8924 pending_rounds.cc:85] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 10
I20260709 12:14:48.547699  8918 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:48.546104  8924 pending_rounds.cc:107] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:14:48.567756  8924 raft_consensus.cc:2889] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.532465 12700 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:48.580353  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:48.581442  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.509503  8997 rpcz_store.cc:276] 0709 12:14:47.017300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.334627 (+317327us) service_pool.cc:224] Handling call
0709 12:14:47.334957 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:47.335394 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.335425 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:47.335977 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:14:47.504532 (+168555us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:47.513851 (+  9319us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.505310 (+991459us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b1800365c80. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf 00007f3985c55038
0709 12:14:48.505650 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.506118 (+   468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.506248 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:48.506431 (+   183us) raft_consensus.cc:1685] finished
0709 12:14:48.506451 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.506673 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939627,"prepare.queue_time_us":1012832,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":336,"raft.queue_time_us":4700,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8758,"spinlock_wait_cycles":7813376,"thread_start_us":168085,"threads_started":1,"wal-append.queue_time_us":232105}
W20260709 12:14:48.594260  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 180741us
W20260709 12:14:48.597831  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.579903 12821 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:48.601068  8919 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:48.593763 13038 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:48.603634  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:48.608469  9621 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:48.608533  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.609403  9074 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:48.612161 13038 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:48.613446 13038 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:48.606539  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81764.1us
I20260709 12:14:48.599881 12902 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.642361  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.659415  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:48.662312  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:48.666440  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:48.673266  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.674361  9069 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:48.680856  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:48.680974 13006 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.682265  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.683967  8919 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:48.665954 12902 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.687518 12700 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.686831 13006 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.687558 13049 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:48.692297 13049 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:48.683101  9074 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:14:48.717119  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55377.8us
I20260709 12:14:48.733776  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:48.734241 12869 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:48.735545  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 66272.5us
I20260709 12:14:48.743899  8924 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
W20260709 12:14:48.753069  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.754390  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:48.760515  8918 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:48.769366  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.723425 12821 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:48.784694  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46992.3us
I20260709 12:14:48.836128  9616 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:14:48.836534  9616 pending_rounds.cc:85] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 9
I20260709 12:14:48.839763  9616 pending_rounds.cc:107] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:14:48.840032  9616 raft_consensus.cc:2889] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:48.837188 12661 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.521s	user 0.004s	sys 0.012s
I20260709 12:14:48.840785 12766 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:48.842447  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:48.837764  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:48.835316 12821 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:48.785162 12914 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:14:48.900759 12902 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:48.901067 13037 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.901926  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:48.903482  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 1.09234e+06us
W20260709 12:14:48.922535  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.917086 13047 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:48.926993 13045 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:14:49.018638  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 366836us
W20260709 12:14:49.028143  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 190034us
I20260709 12:14:48.997720 12869 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.010397 12902 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:49.020226 12914 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:49.042671 13043 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:49.043716  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.031147 13049 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:49.047762  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 148423us
I20260709 12:14:49.051986  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:49.054952 13068 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:14:49.060062 13066 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:14:49.060205 12869 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.058918 12893 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:49.041075 12914 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:49.050889 13006 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:49.068485  9068 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:49.066728  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:49.077157  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.067939  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.081673  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.082028 13006 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.089861  8918 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.092799 13043 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.085672 12786 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:49.088402 12883 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:49.078549 12902 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:49.104275  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.105194  8920 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:14:49.106946  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.099964 13065 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:14:49.098016 12786 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:14:49.111610  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 73587.7us
I20260709 12:14:49.108213 12766 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.128365 12869 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:49.129141  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85125.8us
I20260709 12:14:49.129611  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:49.111009  8923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2321) took 1387 ms (client timeout 1562 ms). Trace:
I20260709 12:14:49.134476  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.137470  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:49.137614 12902 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.137903 12914 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:49.136632  8923 rpcz_store.cc:269] 0709 12:14:47.713879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.723948 (+ 10069us) service_pool.cc:224] Handling call
0709 12:14:49.078485 (+1354537us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400244354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:49.100776 (+ 22291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510507264}
I20260709 12:14:49.138898  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:49.141862 13009 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:49.142357 13009 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.142426 12914 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.144006 12786 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.145236 12786 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:49.149369  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 87010.7us
I20260709 12:14:49.150305 12965 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.152283 13006 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:49.152645  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.139461 12821 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:49.153965  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:49.154646  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.142755 13009 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.157310  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.139928  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:49.161051  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.162705  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.142637  8925 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:49.195886 13072 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.151124  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.209721  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:49.199653  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126053us
I20260709 12:14:49.222800  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.224516  8920 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 7: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:49.161823 13006 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.219599  9073 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:49.231145  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67808.1us
I20260709 12:14:49.231983  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:49.228976  9590 leader_election.cc:336] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.938s (SENT)
I20260709 12:14:49.237499  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.151106 12965 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.228997 12766 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:49.239450  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.230175 13006 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:49.272787 13006 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.269285 12766 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.280555  8919 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:49.289407 13072 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:49.297976 13071 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 12:14:49.312672  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 171573us
I20260709 12:14:49.312799 13016 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:49.288650 12766 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.279371 12899 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.282063 12700 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:49.271723 12821 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:14:49.326047 13024 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.876s	user 0.015s	sys 0.000s
I20260709 12:14:49.317564 12902 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:49.344180  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.345474 13073 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:14:49.347643  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 196682us
I20260709 12:14:49.349747  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.351491 13043 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:49.352954  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 152432us
I20260709 12:14:49.353978  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.355278  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:49.359416  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:49.360324  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 196147us
I20260709 12:14:49.355307 13016 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.324339 13072 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:49.363045  9590 leader_election.cc:336] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 2.024s (SENT)
I20260709 12:14:49.328140 12869 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.366649  8918 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:49.370252  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:49.377888  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.331456 13024 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.381949  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:49.389928  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59055.9us
I20260709 12:14:49.386557  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.374691 12883 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:49.374328 12902 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:49.393718  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.395119  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.388180 13043 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:49.399037  9622 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:49.375656 12869 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.404129  8922 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:49.392263 12786 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.373839 13074 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:49.407924 13072 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.408921 13075 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.411731  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:49.413311 12869 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:49.399619 13016 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:49.414623  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.415787  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:49.416791  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:49.390093 12700 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.419732  9616 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:49.455314 12872 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.455614  8999 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:49.455979 12872 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.458534 12872 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:49.461437 13047 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:49.462131 13047 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:49.467337  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.471590  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 108604us
W20260709 12:14:49.507130 13014 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.697s	user 0.007s	sys 0.007s
I20260709 12:14:49.475598 12902 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.507527 12965 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:49.553993  8916 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:49.554667  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 612) took 1077 ms. Trace:
I20260709 12:14:49.555034  8997 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:49.566721  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.570904  9068 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:49.571599  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:49.572352  8991 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:49.573248 13006 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:49.578135 13009 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.580566 13009 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:49.580890 13024 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:49.583750  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.584210  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 311384us
I20260709 12:14:49.557632  8916 rpcz_store.cc:276] 0709 12:14:48.480419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.483222 (+  2803us) service_pool.cc:224] Handling call
0709 12:14:49.355111 (+871889us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b5800000098. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16f8c 00007f3982b16ef6 000000000036eb39 00007f398ab8a1e0 00007f398ac530c4 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:49.554595 (+199484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19907584}
I20260709 12:14:49.586802  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:49.587073  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.593675 12700 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:49.594038 13026 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.593706  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.593797 13082 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.583115 12766 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.606336 12766 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:49.608867 13082 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:49.600400  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 281354us
I20260709 12:14:49.585242 13037 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:49.596046 13064 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.528s	user 0.003s	sys 0.003s
W20260709 12:14:49.612097  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 197025us
I20260709 12:14:49.594839  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.615559  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:49.617560  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 203076us
W20260709 12:14:49.619081  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 220443us
I20260709 12:14:49.621747  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:49.624445  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.626854  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.628240 12701 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:49.628818 12701 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.629356 12701 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:49.632110  8921 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:49.636466  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.637332  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.635015 12730 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:49.632191  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1479) took 2623 ms. Trace:
I20260709 12:14:49.616530 13082 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:49.616991 13037 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:49.622512 13024 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.653815  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:49.627708 13006 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:49.657593  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 644) took 1319 ms. Trace:
I20260709 12:14:49.625517 13026 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.661593  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:49.662348  8919 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:49.663483 13026 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:49.640676 12730 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:49.647056 13037 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.667990  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.618263 13047 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.640905  8994 rpcz_store.cc:276] 0709 12:14:47.008787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.276927 (+268140us) service_pool.cc:224] Handling call
0709 12:14:47.346753 (+ 69826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:47.349968 (+  3215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.350015 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:47.350559 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:14:47.602777 (+252218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:47.602824 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.602901 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.458422 (+1855521us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:49.631757 (+173335us) raft_consensus.cc:1685] finished
0709 12:14:49.631777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.632006 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2429,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":13231872,"thread_start_us":251692,"threads_started":1,"wal-append.queue_time_us":332215}
W20260709 12:14:49.695753  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 101050us
I20260709 12:14:49.658053  9617 rpcz_store.cc:276] 0709 12:14:48.337932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.339363 (+  1431us) service_pool.cc:224] Handling call
0709 12:14:48.339912 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.471699 (+131787us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:48.596171 (+124472us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.649320 (+ 53149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.650086 (+   766us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:48.650151 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.657216 (+1007065us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400787154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:49.657260 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.657381 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":137504,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":5054,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2321,"spinlock_wait_cycles":293978496,"thread_start_us":164001,"threads_started":2,"wal-append.queue_time_us":162349}
I20260709 12:14:49.688855 12872 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:49.712332 12730 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.715340  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:49.719350 12901 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:49.720255 13086 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:14:49.721120 13086 consensus_queue.cc:1243] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:49.721643 13086 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:49.721985 13086 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:49.708381 12872 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.746636  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47806.2us
I20260709 12:14:49.695195 12785 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:49.729437 12730 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.763818  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.764240  9065 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:49.764611  9070 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:14:49.765452  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.766484  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:49.752605 12872 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.768715  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:49.769476  9070 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:49.771044  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:49.773227  9070 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:14:49.774838  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.775477  9070 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:49.748085 13082 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.776247 13082 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:49.776618 13082 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.775411  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:49.779659 12902 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:49.780565 13047 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:49.780949  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.781934 13016 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:49.782313 13016 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:49.782228 13024 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:49.782827 13016 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.783424 13026 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:49.784600  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.722848 13086 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.785382 13026 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:49.785738 13086 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:49.791390  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:49.761768  8923 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:49.803161  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 160463us
I20260709 12:14:49.807407  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:49.830442  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.831122  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.825778  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:49.843555  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70856.8us
I20260709 12:14:49.843741  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:49.846338  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.849987  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.828353 13038 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:14:49.851383  9617 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:49.851755  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.843015 13026 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:49.855075 12661 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.853937  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.838884 12902 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:49.861363  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.863145  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.854346 12730 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:14:49.868960  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:49.871433 12785 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.856413 13026 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.882105  9621 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:49.896970  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:49.882771  8964 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.614s (SENT)
I20260709 12:14:49.899044  8889 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:49.903142  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:49.903872  9617 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
W20260709 12:14:49.907893  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.895013 13026 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:49.914384  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:49.921552  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88856us
I20260709 12:14:49.918977 12730 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:49.909299 13006 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:49.926353  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:49.927695  8922 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:49.876574 13095 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:14:49.929572  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:49.930433  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.935097  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52389.7us
I20260709 12:14:49.919683 13043 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.938871 12766 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:49.939347 12766 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:49.940323 12766 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:49.940634 13029 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:14:49.941588 12766 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.943998  9622 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 12:14:49.955842 13094 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:14:49.943110 12931 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.930241 13006 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.966090  8888 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.163s (SENT)
I20260709 12:14:49.933580  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:49.911742 12902 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.010946  9619 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:49.944456 12821 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:50.008836 13006 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.025316 12872 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:50.029277 13016 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.031225  8917 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:50.031678  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 94108us
W20260709 12:14:50.032195  8964 leader_election.cc:336] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.622s (SENT)
I20260709 12:14:50.033885 13085 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:50.037604 13082 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.049381  8822 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:14:50.052560  8822 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 9, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 9 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:50.021064 12821 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:50.060739 12821 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:50.063010 12821 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:50.079744  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.086251 12730 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:14:50.093542  8964 leader_election.cc:336] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.795s (SENT)
I20260709 12:14:50.094050  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:50.094324  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.094079 13006 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.058697 13037 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:50.095409 13043 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.112102 13006 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.114108  8924 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:50.115814 12785 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:50.116808 12785 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:50.117125 12785 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:50.131352 13082 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.132141  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:50.132892 13016 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.137538  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:50.138182  9074 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.140873  9067 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:50.109472 12902 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.147876  9065 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.148401  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:50.149749  8822 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:50.155627  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 324562us
I20260709 12:14:50.163663  9074 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:50.171765  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 137242us
I20260709 12:14:50.158958  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:50.172346  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 328084us
I20260709 12:14:50.177680  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:50.118250 12785 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.178546  9074 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.146013 12872 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:50.175374 12869 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:50.185431  8889 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:50.196816  9065 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 12:14:50.198032  9065 pending_rounds.cc:85] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 11
I20260709 12:14:50.198268  9065 pending_rounds.cc:107] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:14:50.198506  9065 raft_consensus.cc:2889] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:50.191120  8822 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 4 to 7, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 7 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.152272 12786 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:14:50.202637  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.179957 13016 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:14:50.208461 12580 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:14:50.216989  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:50.219658 12786 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:50.220402  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.220760  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:50.221149  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.223795  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.197052 13024 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:50.210083  8822 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.224259 13082 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:50.234350 13082 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.236774 13082 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.201740 13006 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:50.248551  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.249498  8918 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:50.207576 12785 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.225688 12786 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:50.266484 13024 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:50.295094 13006 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.246712 13038 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:14:50.541250  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:50.518196  9074 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
W20260709 12:14:50.518860 13026 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.005s
W20260709 12:14:50.519695  8820 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 332) took 11832 ms (client timeout 15000 ms). Trace:
W20260709 12:14:50.523007 13116 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.259s	user 0.008s	sys 0.000s
I20260709 12:14:50.271816 12766 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:14:50.524930  8964 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.569s (SENT)
I20260709 12:14:50.530115 13095 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:14:50.531025 12701 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.014s
W20260709 12:14:50.531226  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 332278us
W20260709 12:14:50.532725  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.519701  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:50.536176  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.544164  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:50.544333  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:50.547214  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:50.544102  8966 connection.cc:256] RPC call timeout handler was delayed by -1.6033932670000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:14:50.548918  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:50.558434  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:50.559300  9622 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.559376  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.558117 12902 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:50.562412 12902 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.567374 13006 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.568053  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.569002  9622 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:50.569985 13086 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.556367 12893 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.571424  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46582.5us
I20260709 12:14:50.571723 12893 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.573916 12893 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:50.560194 12701 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.575474  8917 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:50.578217  9068 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:50.581538  8998 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:50.583562  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.561194 12786 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.594303  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.550308 12766 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.592156  9590 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:50.597855  8992 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:50.543555  8820 rpcz_store.cc:269] 0709 12:14:38.687338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.691458 (+  4120us) service_pool.cc:224] Handling call
0709 12:14:50.345816 (+11654358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:43.422641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:43.423204 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:43.423263 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:14:43.423284 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:43.425387 (+  2103us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:43.425444 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:43.425471 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:14:44.148983 (+723512us) tablet.cc:701] Row locks acquired
0709 12:14:44.153352 (+  4369us) write_op.cc:260] PREPARE: finished
0709 12:14:44.169522 (+ 16170us) write_op.cc:270] Start()
0709 12:14:44.184361 (+ 14839us) write_op.cc:276] Timestamp: P: 1783599284169453 usec, L: 0
0709 12:14:44.197302 (+ 12941us) op_driver.cc:348] REPLICATION: starting
0709 12:14:44.312867 (+115565us) log.cc:844] Serialized 8556 byte log entry
0709 12:14:45.758572 (+1445705us) op_driver.cc:464] REPLICATION: finished
0709 12:14:45.871609 (+113037us) write_op.cc:301] APPLY: starting
0709 12:14:45.871694 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:45.904236 (+ 32542us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:45.914928 (+ 10692us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:46.073532 (+158604us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:46.140282 (+ 66750us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=44
0709 12:14:46.159815 (+ 19533us) write_op.cc:312] APPLY: finished
0709 12:14:46.237298 (+ 77483us) log.cc:844] Serialized 152 byte log entry
0709 12:14:46.251497 (+ 14199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.260299 (+  8802us) write_op.cc:454] Released schema lock
0709 12:14:46.295699 (+ 35400us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:46.327156 (+ 31457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.332488 (+  5332us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":798560,"reported_tablets":47,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":112743,"apply.run_cpu_time_us":8527,"apply.run_wall_time_us":435875,"num_ops":22,"prepare.queue_time_us":321789,"prepare.run_cpu_time_us":53093,"prepare.run_wall_time_us":1384380,"raft.queue_time_us":189348,"raft.run_cpu_time_us":10395,"raft.run_wall_time_us":51340,"replication_time_us":1552600,"thread_start_us":881797,"threads_started":4,"wal-append.queue_time_us":704340,"wal-append.run_cpu_time_us":26714,"wal-append.run_wall_time_us":2246029}]]}
I20260709 12:14:50.561252 13043 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.609479  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.611366  8991 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:50.610046  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.612241  8999 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:50.579712 12902 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.584693 13037 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:50.548486 13026 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:50.598109  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:50.618570  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.620195  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60168.2us
W20260709 12:14:50.624782  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 105175us
I20260709 12:14:50.596534 12869 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.629134  8994 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:50.630155 13117 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:14:50.631735  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.633385  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:50.634456  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 2.077s (SENT) [suppressed 45 similar messages]
I20260709 12:14:50.602939 12766 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:50.647861  8992 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
W20260709 12:14:50.667388  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 126213us
I20260709 12:14:50.710480  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.710726  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:50.703387  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.704458  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.711459  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:50.702047  9000 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:50.713303  8991 raft_consensus.cc:2410] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:14:50.713605  8999 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:14:50.715762  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 81318.3us
I20260709 12:14:50.691274 12580 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:50.699991 13006 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:50.732853  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 99570.1us
I20260709 12:14:50.716123  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:50.740085  8919 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:50.740594  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.693951 13095 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:50.703665 13046 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.737366  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:50.738584  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.742837  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.703569 12902 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.744403  8991 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:50.727057 12786 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.747397  8992 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.716001 13029 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:50.757191  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.743753  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.758968  8999 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.759181  8917 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:50.734730 12701 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:50.760738  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:50.760877  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.736783 12580 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:50.702906 13024 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.762657  9074 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:50.768558  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.703953 13043 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.767611  8919 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:50.767588  9621 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:50.770049  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.743359 13095 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.739969 12885 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:50.773970  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:50.750677 13046 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:50.732820 13082 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:14:50.777812  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:50.778698  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:50.765002 13106 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:50.760766 13029 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:50.781683  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.783349  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.788190  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:50.795737  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:50.777168 13006 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.795185  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:50.806977  8919 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:14:50.779654 13046 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.790915  9000 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:50.776055 13095 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:50.793727  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 231909us
I20260709 12:14:50.797537  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.821381  8999 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:50.758453 12902 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.790319 13009 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:14:50.794103 13029 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.815639 13006 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:50.817015  8996 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:50.817324 12885 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:50.812479 13043 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.821627  8991 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:50.825186  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 71002.4us
I20260709 12:14:50.828229  8992 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:50.829648  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.831478  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.879539  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.880455  9000 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:50.881465  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128350us
I20260709 12:14:50.885293  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.788934 12701 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:14:50.806264 13106 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:50.888851  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.900607  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.901525  9000 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:50.906296 13125 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:50.912010  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:50.914314  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.915336 12893 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:50.915557 13126 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:50.915737 12893 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.916173 12893 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:50.910900  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.876652 13006 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:50.892026 13082 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.924930  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.881569 12580 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:50.938911 13038 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:50.939523 13038 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:50.940551 13038 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:50.941478  8964 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.517s (SENT)
I20260709 12:14:50.942703  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.948498  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:50.949096  8992 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.959880  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:50.952333  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 155252us
W20260709 12:14:50.960496  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54990us
I20260709 12:14:50.923715 13006 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.963829  8999 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:50.952070  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:50.964787  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 169718us
I20260709 12:14:50.967695  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.968472  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:50.969939  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:50.967478  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:50.985221  8922 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:50.988979  8992 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
W20260709 12:14:50.990484  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.998623  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.951468 13121 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:50.963824 13026 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:51.005273  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:51.008392  9622 raft_consensus.cc:2410] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:14:51.014089  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50854.2us
I20260709 12:14:51.015278  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:50.998175 12931 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.025717  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:51.005223 13112 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 12:14:51.031256 12580 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.032335  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:51.034371 13119 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.343s	user 0.002s	sys 0.000s
I20260709 12:14:51.036623 13132 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:14:51.039559 12885 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:50.975499 12869 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:14:51.027415 13121 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.044713 13106 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.005703 13024 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:51.046578  9000 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:14:51.091163  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:51.095496 13024 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:51.048616  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.094350 13026 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.968111 13016 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:14:51.096676 13024 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.097394 13016 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:51.097787 13016 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:51.038646 12766 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.100813 12766 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.101163  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:51.095886  9069 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:51.102422  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:51.104305 13121 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.104597  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:51.104863 13121 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.016441 13126 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:51.088074 12902 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.090167 13095 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:51.092815  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60591.6us
I20260709 12:14:51.129714  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.003260 13129 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.131060  8998 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:51.025194  8994 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:51.074751  8991 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:51.107299  9065 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:51.092748  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:51.103018  8999 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:51.125300  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:51.098686 13016 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.133410  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:51.132220  8921 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:51.135860  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:51.091892 13125 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:51.140985  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 142028us
I20260709 12:14:51.142391  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:51.143381  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:51.135169  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128482us
I20260709 12:14:51.146549  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:51.148468  8994 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:51.145845  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:51.149832  8999 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:51.144852  8991 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:51.065407 12931 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:51.152123  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 136964us
I20260709 12:14:51.185174  9621 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:51.134137 13049 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:51.131186 13006 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.128706 13121 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:51.194541  8991 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:14:51.196950  8999 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:51.196724  9069 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:14:51.184284 13016 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:51.188606 13129 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:51.192344 13038 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:51.205895  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59455us
I20260709 12:14:51.206722  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.192991 13049 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:51.210028  9037 connection.cc:256] RPC call timeout handler was delayed by -1.1110521789998984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 12:14:51.210474  9037 connection.cc:256] RPC call timeout handler was delayed by -1.0291521789999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 12:14:51.211520  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.213035  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.213517  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.215582  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:51.205561 13038 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:51.300983  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.312671  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.216069 13129 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:51.325263  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.326237  9069 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:51.330148 13138 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:14:51.329979 13129 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:51.331337  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:51.332429 12700 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:51.333016 12700 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:51.333406 13141 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:14:51.217319 13026 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.336464  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.218549 13112 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:51.218636 13037 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:51.292703 13132 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:51.350183  8811 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.387s	user 0.001s	sys 0.006s
W20260709 12:14:51.351552  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.352356 13112 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.352514 13026 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:51.352691 13121 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:51.352967 13026 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:51.352929 13112 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.325316 13038 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.336915 13128 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.353533 13026 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:51.359887  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.359863  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.362269 13112 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:51.353020 13136 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:14:51.373147  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.373951  9070 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:51.396376  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.397292  9070 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:51.370086 13128 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.408125 13128 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.424873 13086 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:51.425720 13086 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:51.427728  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 201297us
I20260709 12:14:51.428318  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.428540  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.429812  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:51.432518  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:14:51.438254  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 216631us
I20260709 12:14:51.385439 13095 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:51.365806 13037 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.458124  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.458678  8923 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:51.464154  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:51.477324  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:51.479151  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 474985us
I20260709 12:14:51.453467 12872 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:51.449890 12580 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:51.447335 13043 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:51.509305 12893 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 12:14:51.509940  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:51.509821 12893 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.510747  8922 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:51.511780  8919 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:51.512530 13115 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:51.512946 13115 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:51.513417 13049 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.513741 13115 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.514438 13049 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.514735 13115 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.498013 12872 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:51.457180 13112 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:14:51.516454 12872 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:51.498558  9587 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.056s (SENT)
I20260709 12:14:51.446527 12786 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:51.459664 13128 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:51.501143  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.483058  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.551683  9069 raft_consensus.cc:2368] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
I20260709 12:14:51.508921 13043 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.520200  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:51.569686  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.551388  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.507457  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:51.559096  9000 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
W20260709 12:14:51.500095  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.572119  8921 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:51.576265  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.577466  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.470660 12931 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.578198  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
W20260709 12:14:51.587688  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.750645  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.752120  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:51.752373  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:51.752784  9622 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 6.
I20260709 12:14:51.753638  9616 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:51.519982 13156 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:51.557314 13086 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:51.577958 12580 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:51.767478 13029 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.875s	user 0.000s	sys 0.010s
I20260709 12:14:51.820986  8999 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:51.820797  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:51.822317  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:51.834429  8995 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:51.578049 12786 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:51.770538 12821 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.825707  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:51.849090  8994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.026s
I20260709 12:14:51.779088 13151 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.441s
I20260709 12:14:52.130743  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 796) took 1196 ms. Trace:
W20260709 12:14:52.003072  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.143304  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.279354  8991 rpcz_store.cc:276] 0709 12:14:50.934709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.198945 (+264236us) service_pool.cc:224] Handling call
0709 12:14:51.204498 (+  5553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.204707 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:51.353277 (+148570us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.130180 (+776903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.130272 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:52.130373 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.130473 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.130661 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133346,"prepare.queue_time_us":149491,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":32,"thread_start_us":465953,"threads_started":1}
I20260709 12:14:52.100680  8917 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:52.109827  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.282087  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.850631 13029 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:52.073212  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.280474  8999 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:52.131932  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.282827 13120 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.826694 13142 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:52.129319  8921 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.002s
I20260709 12:14:52.370146  8921 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:51.918612  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:52.133116  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.371147  8919 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:14:52.104327  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.241168  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.066825  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.385861  9000 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:52.321139  8994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.009s	sys 0.026s
I20260709 12:14:52.251216  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:52.231386  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.224416  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:51.931181  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.196292  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.317226  9623 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:52.108867  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.389359  9069 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:51.816157 12931 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:52.226162 12872 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
W20260709 12:14:52.179139 13038 consensus_meta.cc:287] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.002s
W20260709 12:14:52.240048 13016 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.034s	user 0.010s	sys 0.001s
W20260709 12:14:52.233544 13026 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.000s
I20260709 12:14:52.448592  8924 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:52.180009 13037 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:52.452188  8888 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.025s	sys 0.073s
W20260709 12:14:52.452651  8888 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.025s	sys 0.073s
W20260709 12:14:52.452914  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 887009us
W20260709 12:14:52.146318 13148 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.773s	user 0.001s	sys 0.000s
I20260709 12:14:52.456318  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:52.159658 13122 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.286s	user 0.010s	sys 0.014s
I20260709 12:14:52.130131 12893 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:52.399188  9070 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:14:51.839176 13025 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:52.439726 13128 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.009s	sys 0.021s
I20260709 12:14:52.176138 13043 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:52.041293 13136 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:14:52.452142  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.454866  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:52.093961 13149 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:52.457115  9069 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:52.459000  8997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.013s	sys 0.021s
W20260709 12:14:52.481235  8997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.013s	sys 0.021s
I20260709 12:14:52.451382  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.461156  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:52.469460  9000 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:52.316424 13112 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.437216 12785 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.472970  8998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.000s	sys 0.012s
I20260709 12:14:52.485802  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.475320  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:52.471490  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 645808us
I20260709 12:14:52.486853  9070 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:52.487707  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.488541  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:52.236955 13049 consensus_meta.cc:287] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.006s
W20260709 12:14:52.237108 13046 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.356s	user 0.006s	sys 0.006s
I20260709 12:14:51.872306 13156 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.485738  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2768) took 1910 ms. Trace:
W20260709 12:14:52.485078  8998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.000s	sys 0.012s
W20260709 12:14:52.475884  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.012s
I20260709 12:14:52.391647 12821 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.489929  9070 raft_consensus.cc:2410] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:52.476586 13128 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.009s	sys 0.021s
W20260709 12:14:52.491045  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.010s	sys 0.005s
W20260709 12:14:52.533643  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.010s	sys 0.005s
I20260709 12:14:52.441313 12931 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.095834 13123 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.433302 13120 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.440909 12872 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.457711 13026 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.448679 13038 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:52.532244  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.002s	sys 0.018s
I20260709 12:14:52.171388 12580 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.481063 13037 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:52.489517 13025 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.533573 13128 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:52.528949 13115 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.004s
I20260709 12:14:52.498282 13112 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:52.547371  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 97286us
I20260709 12:14:52.554347  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:52.528997  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.538419  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:52.553647  9617 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:14:52.612605  9617 pending_rounds.cc:85] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 7
I20260709 12:14:52.612923  9617 pending_rounds.cc:107] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:52.613166  9617 raft_consensus.cc:2889] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:52.596910  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.045s	sys 0.079s
W20260709 12:14:52.614547  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.047s	sys 0.085s
W20260709 12:14:52.614838  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 761542us
I20260709 12:14:52.616169  9072 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:14:52.617457  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 63256.6us
I20260709 12:14:52.619443 13016 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:14:52.619555 13158 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:14:52.619894 13016 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:52.616053 13154 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:52.620827  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 930) took 1103 ms. Trace:
I20260709 12:14:52.623214  8995 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:52.554297  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2793) took 1814 ms. Trace:
I20260709 12:14:52.625104  8997 rpcz_store.cc:276] 0709 12:14:50.575487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.575708 (+   221us) service_pool.cc:224] Handling call
0709 12:14:50.581418 (+  5710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.581740 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:50.782925 (+201185us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.003741 (+220816us) log.cc:844] Serialized 14 byte log entry
0709 12:14:51.379483 (+375742us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800395da0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:14:51.772940 (+393457us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.481634 (+708694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.481702 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:52.481762 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.481849 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.485681 (+  3832us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":386678,"prepare.queue_time_us":428036,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":1131405,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":57059,"spinlock_wait_cycles":6624640,"thread_start_us":1461750,"threads_started":4,"wal-append.queue_time_us":309889}
I20260709 12:14:52.621191  9621 rpcz_store.cc:276] 0709 12:14:51.517923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.518170 (+   247us) service_pool.cc:224] Handling call
0709 12:14:51.518518 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.518898 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.518927 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.519471 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.099943 (+580472us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:52.099997 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.100076 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.620634 (+520558us) raft_consensus.cc:1685] finished
0709 12:14:52.620655 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.620775 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12427,"raft.queue_time_us":387,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":31367,"thread_start_us":483882,"threads_started":1,"wal-append.queue_time_us":1097008}
W20260709 12:14:52.639765  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 1.14113e+06us
W20260709 12:14:52.642676  9587 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.060s (SENT)
W20260709 12:14:52.648329  8993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.007s	sys 0.003s
W20260709 12:14:52.648769  8993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.269s	user 0.008s	sys 0.004s
I20260709 12:14:52.649211 13029 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.649434  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2772) took 2067 ms. Trace:
I20260709 12:14:52.651073 13025 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.651652 13025 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:52.636943 13082 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:52.652143 13025 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.652695 13082 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.627744 13123 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.654321 13025 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:52.654739 13082 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.655962 13123 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.649259 12700 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.652143 13178 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.658787 12931 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.630698 13037 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.659710 13178 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.659825  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2971) took 1733 ms. Trace:
I20260709 12:14:52.649852  8993 rpcz_store.cc:276] 0709 12:14:50.582104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.615592 (+ 33488us) service_pool.cc:224] Handling call
0709 12:14:50.732701 (+117109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.762696 (+ 29995us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:50.962625 (+199929us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.649052 (+1686427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.649109 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:52.649207 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.649277 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.649381 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":355286,"prepare.queue_time_us":195590,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":399910,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":1434355,"threads_started":3,"wal-append.queue_time_us":196362,"wal-append.run_cpu_time_us":2077,"wal-append.run_wall_time_us":1183723}
I20260709 12:14:52.620301 13016 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:52.628543  8998 rpcz_store.cc:276] 0709 12:14:50.740102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.179993 (+439891us) service_pool.cc:224] Handling call
0709 12:14:51.192809 (+ 12816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.196627 (+  3818us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:51.338073 (+141446us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.553932 (+1215859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.554001 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:52.554067 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.554128 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.554243 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15540,"prepare.queue_time_us":153385,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":1158023,"threads_started":1}
I20260709 12:14:52.716619  8919 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:52.545059 12786 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.500636 12785 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.662496  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 932) took 1143 ms. Trace:
I20260709 12:14:52.661921  9074 rpcz_store.cc:276] 0709 12:14:50.926087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.927700 (+  1613us) service_pool.cc:224] Handling call
0709 12:14:50.927973 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.108368 (+180395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.108411 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.108465 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:51.108515 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.659549 (+1551034us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:52.659590 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.659735 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414339328}
I20260709 12:14:52.563980 13126 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.541594 12730 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.620253 13112 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.729064  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 2966) took 2490 ms. Trace:
W20260709 12:14:52.746440  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 207046us
I20260709 12:14:52.654862 13025 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:14:52.730250  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 114746us
W20260709 12:14:52.729094  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 86563.1us
I20260709 12:14:52.539403 13046 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.726135 13115 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.726960 12931 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.740688 13154 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:14:52.740197  9619 rpcz_store.cc:276] 0709 12:14:51.518783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.565468 (+ 46685us) service_pool.cc:224] Handling call
0709 12:14:51.565825 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.765857 (+200032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.765910 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:52.146220 (+380310us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.266638 (+120418us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:14:52.437493 (+170855us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.442525 (+  5032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.442638 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.662298 (+219660us) raft_consensus.cc:1685] finished
0709 12:14:52.662318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.662444 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187399,"prepare.queue_time_us":165368,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":205778,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":14538,"thread_start_us":106820,"threads_started":1,"wal-append.queue_time_us":324995}
I20260709 12:14:52.755846  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2792) took 2042 ms. Trace:
I20260709 12:14:52.630851 13132 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:14:52.746663  9071 rpcz_store.cc:276] 0709 12:14:50.232695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.253354 (+ 20659us) service_pool.cc:224] Handling call
0709 12:14:50.253668 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:50.264916 (+ 11248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:50.264944 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:50.295446 (+ 30502us) log.cc:844] Serialized 26 byte log entry
0709 12:14:50.566127 (+270681us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b180034e160. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:50.711586 (+145459us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:50.711627 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.711696 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.477682 (+765986us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:14:52.722512 (+1244830us) raft_consensus.cc:1685] finished
0709 12:14:52.722554 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.722760 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16352,"raft.queue_time_us":424,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4164,"spinlock_wait_cycles":237765120,"thread_start_us":145236,"threads_started":1,"wal-append.queue_time_us":294052}
I20260709 12:14:52.757658  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:52.751518 12700 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.782662  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 165794us
I20260709 12:14:52.781000  9073 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:52.662599 13161 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:14:52.661883 13178 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:52.798072  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.757367  8994 rpcz_store.cc:276] 0709 12:14:50.713432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.153277 (+439845us) service_pool.cc:224] Handling call
0709 12:14:51.191810 (+ 38533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.198489 (+  6679us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:51.216326 (+ 17837us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.755265 (+1538939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.755313 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:52.755364 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.755662 (+   298us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.755785 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155247,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":271368,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1358449,"threads_started":2,"wal-append.queue_time_us":1263259}
I20260709 12:14:52.785913 13128 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.790853 12872 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.792387 13026 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.756243 12931 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.757369 13115 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.756543 12730 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:14:52.814838  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.821225 13183 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:52.821957 13046 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.759845 13172 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.822737 13115 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.823086 13172 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.823830 13182 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.814999  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.824365 13182 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.826449  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.752022  8811 maintenance_manager.cc:643] P a8a9637095964e1e964bf3e778be9bbd: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.145s	user 0.210s	sys 0.099s Metrics: {"bytes_written":30167,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":144205,"dirs.run_cpu_time_us":431,"dirs.run_wall_time_us":14381,"drs_written":1,"lbm_read_time_us":398,"lbm_reads_lt_1ms":4,"lbm_write_time_us":171721,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"raft.queue_time_us":1124507,"reinsert_count":0,"rows_written":63,"thread_start_us":605355,"threads_started":3,"update_count":22,"wal-append.queue_time_us":194221}
W20260709 12:14:52.826882  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.817965  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.828476  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.829232  8925 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:52.829351  8812 maintenance_manager.cc:419] P a8a9637095964e1e964bf3e778be9bbd: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9614 bytes on disk
I20260709 12:14:52.819797  9066 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:52.830294  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.831329 13120 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.832933 13016 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:52.836139 13170 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:52.837378  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1504) took 1013 ms. Trace:
I20260709 12:14:52.750067 13126 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.841063  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.838696  8991 rpcz_store.cc:276] 0709 12:14:51.824097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.282335 (+458238us) service_pool.cc:224] Handling call
0709 12:14:52.282663 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.282907 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:52.367839 (+ 84932us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.837017 (+469178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:52.837076 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:52.837128 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.837197 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.837318 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23875,"prepare.queue_time_us":85154,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4401,"raft.queue_time_us":137414,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7861,"thread_start_us":389435,"threads_started":2,"wal-append.queue_time_us":324952}
I20260709 12:14:52.799602 13186 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:52.814424 13123 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:52.850651  9587 leader_election.cc:336] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.098s (SENT)
I20260709 12:14:52.786840 12700 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.848110 13161 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.849758 13186 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.860698  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:52.865828  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.858935  8811 maintenance_manager.cc:643] P a8a9637095964e1e964bf3e778be9bbd: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.013s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":1217,"lbm_reads_lt_1ms":4}
W20260709 12:14:52.868820  9587 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.273s (SENT)
I20260709 12:14:52.864419  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.868729  8966 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:52.873960  9587 leader_election.cc:336] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.313s (SENT)
I20260709 12:14:52.876405 13182 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.876535 12785 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:52.877041 13180 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:52.875586  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:52.859530 12821 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:52.880919  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:52.882712  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.867905 13186 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:52.891814 12700 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.855407 13123 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.900554  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.903165 13123 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:52.885414 13181 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:14:52.885797 13171 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:14:52.886472 13188 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:52.886679  8925 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:52.903613 13180 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:52.888468 13156 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.889184 13172 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.890028 12931 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.931150  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.931780  8991 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:14:52.932937 13006 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.890388 13178 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.891798 13126 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.892315 13184 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.894133 13016 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.895370 13161 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.895884 12821 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.937374 12821 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:52.937851  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63941.3us
I20260709 12:14:52.938911  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.939606 12821 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:52.899412 13160 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:52.940287 13106 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:52.940642 13160 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.940726 13106 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:52.941092 13160 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.941231 13106 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.941517  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:52.915779 13123 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.942240 12893 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:14:52.942685 13123 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:52.904939  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.887584  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:52.910496  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:52.944227  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56739.6us
I20260709 12:14:52.944665  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.945101 13123 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.945727  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.946751  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.946913 13132 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.919333  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.947575  8993 raft_consensus.cc:2376] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9. Re-sending same reply.
I20260709 12:14:52.948009 13120 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:52.948434  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.948971  8993 raft_consensus.cc:2376] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9. Re-sending same reply.
I20260709 12:14:52.949724  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.950762  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.919986  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.920277  8997 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:52.952004  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.952127  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.947583 13132 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:14:52.953073  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.953594  8996 raft_consensus.cc:2376] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12. Re-sending same reply.
I20260709 12:14:52.920832 12730 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.954738 12730 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.954957 13160 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.956307 13130 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:52.956702 13130 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:52.956957 12730 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:52.919376  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:52.922001  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.911718 13188 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:52.923966 13171 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:52.958196  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.958348 13171 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:52.958875  8996 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:52.959810  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:52.959373 13171 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.960788 13171 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:52.961285  8995 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:52.925005 13185 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.912091 13180 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:52.924474 13176 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:52.927683  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:52.968813  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:52.969251  8991 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:14:52.928169  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:52.930855 12700 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:52.900520 13177 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:14:52.952718  8997 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.963522 13185 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.975911  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:52.964951  8996 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 12:14:52.972349  9619 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:52.973701  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.884397 13047 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.977401  9621 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:52.978148  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:52.957566 13130 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:52.978950  9617 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:52.977660  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1505) took 1153 ms. Trace:
I20260709 12:14:52.980053  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.980719  9616 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:52.982327  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.968000 13151 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:52.958187 13188 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:52.969596 13024 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:52.985407  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66446.1us
I20260709 12:14:52.969611 13180 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.972144 13126 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:52.974349 13176 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:52.987428  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:52.979544  8999 rpcz_store.cc:276] 0709 12:14:51.824388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.317537 (+493149us) service_pool.cc:224] Handling call
0709 12:14:52.432451 (+114914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:52.749984 (+317533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:52.750043 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:52.783045 (+ 33002us) log.cc:844] Serialized 26 byte log entry
0709 12:14:52.855149 (+ 72104us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:52.870572 (+ 15423us) log.cc:844] Serialized 14 byte log entry
0709 12:14:52.875087 (+  4515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:52.875145 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.958493 (+ 83348us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b180040f6c0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:14:52.971372 (+ 12879us) raft_consensus.cc:1685] finished
0709 12:14:52.976784 (+  5412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:52.977580 (+   796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6353,"prepare.queue_time_us":14553,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":218739,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":2809088,"thread_start_us":331446,"threads_started":2,"wal-append.queue_time_us":87688}
I20260709 12:14:52.988189  9620 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:53.036664  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:14:53.022408  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.070396  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 83038.8us
W20260709 12:14:53.035656  8964 connection.cc:256] RPC call timeout handler was delayed by -1.7384926189999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:14:52.987982  9618 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:53.000420  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.989552  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.037607  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.994853  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.079869  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:53.082904  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.084005  9620 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:53.084681  8997 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:52.987473 13160 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:52.976086 13173 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:52.983204 13049 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:53.095867  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.096518  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:53.097615  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.101251  9617 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:53.103353  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.105010  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:53.105850 12786 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:53.100219 12821 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.106060  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.033016 13185 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.011109 13024 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.107748  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:53.107312  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.074077 12885 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:53.108894  9616 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:53.108938 12885 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.109827  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.110638  9616 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:53.092655 12730 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:14:53.111438  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.106076  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:53.112474  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.112632 13129 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:53.113055 13129 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.113400 13129 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:53.113466  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.982393 13047 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:53.114732  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1789) took 1662 ms (client timeout 2196 ms). Trace:
I20260709 12:14:53.115942 13191 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.116607 13049 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:53.116868 13176 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:53.117054  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:53.117319  9590 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:53.117635  9621 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:14:53.117791 13049 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.119401 12893 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:52.992177 13085 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.121426 12893 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:53.121584 13037 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:53.121969 12893 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:53.122807  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 803) took 2365 ms. Trace:
I20260709 12:14:53.123162 13143 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.092418 13126 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.100538 13173 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.115141  9615 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:53.113550  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.994113 13193 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 12:14:53.093816 13132 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:53.103346 13156 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:52.994167 13006 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.127079  9618 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.123624  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:52.989272 13038 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.125412  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:53.115147  8924 rpcz_store.cc:269] 0709 12:14:51.452800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.452948 (+   148us) service_pool.cc:224] Handling call
0709 12:14:53.114571 (+1661623us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400312c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:53.114665 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262316800}
I20260709 12:14:53.123557 13143 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:53.149433  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44594.2us
W20260709 12:14:53.165459  9624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 935) took 1643 ms (client timeout 2002 ms). Trace:
I20260709 12:14:53.172312  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.166565  9617 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:14:53.123229  9073 rpcz_store.cc:276] 0709 12:14:50.757697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.758907 (+  1210us) service_pool.cc:224] Handling call
0709 12:14:50.771964 (+ 13057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.785891 (+2013927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.122586 (+336695us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400368154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:53.122746 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4573998848}
I20260709 12:14:52.991993 13151 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.124615 13046 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:53.172098  9624 rpcz_store.cc:269] 0709 12:14:51.519761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.566253 (+ 46492us) service_pool.cc:224] Handling call
0709 12:14:53.123474 (+1557221us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:14:53.162995 (+ 39521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5482368}
I20260709 12:14:53.150555 13016 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.179162  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:53.183439  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:53.179924  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.184228  9074 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 6.
I20260709 12:14:53.150295 12786 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:53.133958 13193 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:53.121454 13085 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:53.189814  9074 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:14:53.129743 13047 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.129114 13024 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:53.192242  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 222145us
I20260709 12:14:53.125797 13126 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:53.193401  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:53.128216 13173 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:53.136361 13156 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:53.199265  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.132656 13161 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:14:53.191254 13193 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:53.122853 12893 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.213979  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.215309  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.216176 13009 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.216324 12872 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:53.216730 13009 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.131455 13186 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.219211 13009 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.132398 13106 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.136258 13188 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.223573 13130 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.187189 13115 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:53.224260 13115 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:53.225135 13115 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.228914  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1793) took 1409 ms. Trace:
I20260709 12:14:53.229307  8923 rpcz_store.cc:276] 0709 12:14:51.819328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.821493 (+  2165us) service_pool.cc:224] Handling call
0709 12:14:53.228713 (+1407220us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54000db454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:53.228852 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1892155648}
I20260709 12:14:53.202874  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.203380  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.203796  9066 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:53.204348  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.192073 13085 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.232200  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:53.232453 13128 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:53.233024  9072 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:53.233191 13128 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:53.233646 13128 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.236224  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:53.205046  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:53.205681  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.206396  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:53.204521  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.182103 13046 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:53.196925  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:53.207033  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.187356 12821 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.239629  9067 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:53.240073  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.186501 13016 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.219728  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:53.242537  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45704.1us
I20260709 12:14:53.243072  9073 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:14:53.149216 13006 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.209684  9074 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:53.212535 13161 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:14:53.232337 13196 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:53.206522  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.253353  9618 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
W20260709 12:14:53.244427  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 51105.6us
I20260709 12:14:53.220547  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.247606  8993 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:14:53.265663  8993 pending_rounds.cc:85] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 5
I20260709 12:14:53.249905  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.266067  8993 pending_rounds.cc:107] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:14:53.266585  8993 raft_consensus.cc:2889] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:53.266624  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:53.260169  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.274883  8925 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:53.208019 12885 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.265792  9065 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:53.289753  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:53.293601  8922 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.294495  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:53.295547  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:14:53.299568  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.290867  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.302685  8923 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:53.301397  8919 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:53.252820 13107 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.268199 12821 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:53.309350  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:53.315747  9624 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:53.316148  8997 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:53.248453 13016 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:53.318271  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 244981us
I20260709 12:14:53.313557  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.320780  9074 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:14:53.319056  8964 connection.cc:256] RPC call timeout handler was delayed by -1.6664926190001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 12:14:53.322431  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 98965.8us
W20260709 12:14:53.323048  8964 connection.cc:256] RPC call timeout handler was delayed by -1.6385926190000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 12:14:53.325992  8964 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.806s (SENT)
I20260709 12:14:53.238783 13046 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.326674  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.327919  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:53.328310  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.329447  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.268759 13120 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:53.332054  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:53.287657 13169 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:53.328738  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.348553  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:53.303717 12701 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.303056 13185 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:53.352481  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 140147us
I20260709 12:14:53.306983 13165 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:53.235570 13143 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.362243 13191 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:53.372881 13046 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.317687 13132 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:53.374215  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:53.372337  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:53.379761  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.252993 12700 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:14:53.312358 12885 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:53.369735  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:53.389427  9621 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:14:53.374750  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50536.6us
I20260709 12:14:53.390935  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.392724  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.366322 13161 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.312713 13025 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:53.362476 12785 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:53.219885 13193 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.510007  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:53.421087  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95139.8us
I20260709 12:14:53.424290  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:53.511039  8964 connection.cc:256] RPC call timeout handler was delayed by -1.6015802249999069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 12:14:53.511205  8993 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
W20260709 12:14:53.511422  8964 connection.cc:256] RPC call timeout handler was delayed by -1.599780224999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:14:53.425824  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:53.448601  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.424314  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.515421  9073 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:14:53.483661  8916 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:53.484177  8919 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:53.362417 13125 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:14:53.485445  9615 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:53.487366  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 94753.8us
I20260709 12:14:53.522431  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.355731 13120 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.375965 13106 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:53.496840  9067 raft_consensus.cc:2368] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
W20260709 12:14:53.525219  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 200090us
I20260709 12:14:53.504460  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.527649  8991 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:53.395697 13185 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:53.521565  8964 connection.cc:256] RPC call timeout handler was delayed by -1.4549926189999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 12:14:53.528651  8964 connection.cc:256] RPC call timeout handler was delayed by -1.4251802249998491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:14:53.529042  8964 connection.cc:256] RPC call timeout handler was delayed by -1.1983802249999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:14:53.529448  8964 connection.cc:256] RPC call timeout handler was delayed by -1.1462926189999507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2536s for a response
W20260709 12:14:53.529944  8964 connection.cc:256] RPC call timeout handler was delayed by -1.0321530100000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 12:14:53.381170 12701 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.370519 13156 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.375658 12786 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.483875 13186 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.588165 13193 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.588508 13043 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:53.496829 13132 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:53.598562  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:53.625258  8993 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:53.626327  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.627035  8993 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:53.378901 13169 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:53.654911  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 159055us
I20260709 12:14:53.536463 13121 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.520742 13025 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.587216 13143 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.532822 13185 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.660125  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:53.537582 13151 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:53.673213  9621 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:53.656634  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.484043 13191 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.678443  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:53.678794  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.525182 13171 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:53.595310 13161 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.597730 13188 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:53.597383 13043 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:53.532646 13145 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 12:14:53.632553 12931 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.653663 13095 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.760231 13140 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:53.668627 13107 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:53.756495  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.536161 12785 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.751302  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.841043  8993 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:53.633785 13186 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:53.776784 13199 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 12:14:53.772498 13194 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:53.777446 13198 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 12:14:53.777936 13155 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.050s	user 0.003s	sys 0.005s
W20260709 12:14:53.778527 13203 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 12:14:53.779444 13202 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:14:53.681690 13006 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:53.780649 13197 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 12:14:53.508890 12821 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.773195 13210 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:14:53.789737  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.793469 13173 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.795877  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.797233  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:53.798025  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:53.757678  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 235350us
W20260709 12:14:53.770738  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 89084.4us
W20260709 12:14:53.773110 13195 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.485s	user 0.001s	sys 0.000s
I20260709 12:14:53.663620 13112 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.148s
W20260709 12:14:53.818017 13180 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.002s
I20260709 12:14:53.923136  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.929975  9069 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:53.836233  9621 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:53.657248 13132 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.828027 12931 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.827390 13095 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:53.801592 13171 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.830338 13165 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:53.880645  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.829711 13208 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.885587  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.961587  8993 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:53.816712 13161 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.895884  9071 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:53.899878  9067 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:53.901983 13125 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.870817 13186 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:53.909742 13025 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:53.911751 13016 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.005s
W20260709 12:14:53.888108 13128 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 12:14:53.915796 13107 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:53.916468 13191 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:53.923950  8922 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:14:53.980953  8922 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:53.957261 12931 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.841063 13140 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:53.926533 13085 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.002s
I20260709 12:14:53.944227  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:53.959735  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 461585us
W20260709 12:14:54.008188  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 64075.6us
W20260709 12:14:53.968530  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88032.5us
I20260709 12:14:54.009652  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:53.970139  8924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.001s	sys 0.008s
W20260709 12:14:53.970489 13115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.004s
W20260709 12:14:53.971652  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 306441us
I20260709 12:14:53.939229 13121 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.011909 13115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.005s	sys 0.004s
I20260709 12:14:54.012509 13006 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:54.013166  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:54.013975  8925 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.014070  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.014398 13006 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:53.886234 13129 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.000s
I20260709 12:14:54.014981 13222 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.935925 13024 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:14:54.015188  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:53.958896 13120 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.011472  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:54.020697  9621 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:53.990458  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 369065us
W20260709 12:14:54.011541  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.001s	sys 0.009s
W20260709 12:14:54.022328  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.020501  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:54.014791 13006 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.974820 13125 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:54.047262 12785 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:53.979007 13016 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:54.048182 13125 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.049563 13125 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.050203 13016 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:54.015415  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023d28c087e64377a9e2790180949da6"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:54.051316  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.051620  9067 raft_consensus.cc:606] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.052002  9067 raft_consensus.cc:614] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:54.052155  8919 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:54.055521  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2816) took 1081 ms. Trace:
I20260709 12:14:54.030529  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:53.936201 13180 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.032284  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:53.976599 13188 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.033063  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2805) took 1099 ms. Trace:
I20260709 12:14:54.034274 13115 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.024653 13129 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.035854  9615 raft_consensus.cc:1240] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:54.030182 13169 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.006698 12701 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:54.039798 13206 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:14:54.083832  8918 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:54.042865 13165 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.044652 13161 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:54.085206 13129 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.086536 13161 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.046125 13186 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:54.057600  8924 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:54.057328  8994 rpcz_store.cc:276] 0709 12:14:52.933335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.990324 (+ 56989us) service_pool.cc:224] Handling call
0709 12:14:52.990665 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:52.992507 (+  1842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:52.992536 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:52.993198 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.189860 (+196662us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:53.189899 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.189956 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.032773 (+842817us) raft_consensus.cc:1685] finished
0709 12:14:54.032796 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.032984 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1243,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":196275,"threads_started":1,"wal-append.queue_time_us":339877}
I20260709 12:14:54.059705  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.055935  8992 rpcz_store.cc:276] 0709 12:14:52.974024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.029040 (+ 55016us) service_pool.cc:224] Handling call
0709 12:14:53.029336 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:53.029772 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.029799 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:53.030421 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.189550 (+159129us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:53.189586 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.189645 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.055298 (+865653us) raft_consensus.cc:1685] finished
0709 12:14:54.055321 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.055455 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1417,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":158748,"threads_started":1,"wal-append.queue_time_us":286236}
I20260709 12:14:54.063086  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.065940  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.041965 13095 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.066149  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:54.066852  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.033389 12580 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:14:54.069010  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.072252 13160 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.075553 13121 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.041911  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:54.087226 13171 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:54.087998  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.104775  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:54.109095  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.025091 13191 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.117717  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.118573  8993 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
W20260709 12:14:54.118697  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 76860.5us
W20260709 12:14:54.119254  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 318600us
I20260709 12:14:54.054714 13006 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.119509  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:54.118117  8923 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:54.117512  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.120888  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.122579  8998 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:53.991514 13128 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.123204  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.132028  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:54.125860  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.132702  9067 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:54.132972  8916 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:14:54.110168 13130 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.004s
I20260709 12:14:54.092453 13216 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:54.144804  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:54.122776 13046 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.004s
I20260709 12:14:54.144039  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.164058  8995 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 6.
I20260709 12:14:54.164989  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:54.166093  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.117129 13129 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.143940  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.146703  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.177793  8993 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 13 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:14:54.154438  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:54.158746  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:54.179487  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.113538 13025 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:14:54.182158  9073 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:54.168864  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:54.144706  9619 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:54.166669  8995 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:54.124553 13112 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:54.190438 13112 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:54.191494 13112 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.193624 13180 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.209610  8999 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:54.136605 13095 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.114192 13186 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:14:54.024902 13085 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:54.161578  9066 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:54.182910  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.162274 13016 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:54.185343 13128 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:54.189862 13204 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 12:14:54.124725 13209 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.216159  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.137739 12580 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.136889 13212 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.180080  8917 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:54.222925  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:54.176493 13129 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.246796  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:54.248525  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:54.231077  8995 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:14:54.240728  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 103144us
I20260709 12:14:54.245025  9071 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.251827  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.251897  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:54.254410  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 134469us
I20260709 12:14:54.251039  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:54.255223  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:54.244966 13143 consensus_meta.cc:287] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.003s
I20260709 12:14:54.222545 13046 consensus_queue.cc:1059] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:14:54.268518  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:54.331794  9617 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:54.270382  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:54.318439  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:54.233289 13016 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:54.319535  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 68600.3us
I20260709 12:14:54.261098 13037 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.330260  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 75145.3us
I20260709 12:14:54.254702 13129 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.222317 13218 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:14:54.350144  8922 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:54.350313 13218 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:54.350826 13218 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:54.338164  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:54.351784 13143 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:54.351624 13218 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:54.323815  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60750.3us
I20260709 12:14:54.352785 13218 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.342469  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:54.264451 12580 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:54.355325 13140 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:54.355108 12580 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.230733 13208 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:14:54.340618 13130 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.340812 13016 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.358527 13208 consensus_queue.cc:1243] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:54.366053  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:54.367756  9618 raft_consensus.cc:2410] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:14:54.339193 12701 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:54.349457 13046 raft_consensus.cc:3055] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:54.254936 13212 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:54.396608  9588 leader_election.cc:400] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
I20260709 12:14:54.397310  9588 leader_election.cc:403] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:54.398802  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.398607  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53019.1us
I20260709 12:14:54.400373  9588 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.358534 13130 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:54.394287 12701 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.395344 13046 raft_consensus.cc:740] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:54.410346  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:54.426924  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 415739us
I20260709 12:14:54.427654  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.427819  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.406082 13145 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
I20260709 12:14:54.420853 13130 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.428576 13234 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.424568 12701 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.434285 13225 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.430501 13160 raft_consensus.cc:2764] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:54.456485  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.436394  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:54.450541  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:54.435842 13222 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.467036  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.476459  8964 leader_election.cc:400] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
I20260709 12:14:54.476792  8964 leader_election.cc:403] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:54.478571  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.480355  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44051.1us
W20260709 12:14:54.477810 13026 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.014s	sys 0.008s
I20260709 12:14:54.488062  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:54.496618  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:14:54.499615 13229 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:14:54.501003 13241 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:54.501927 13171 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:54.502872  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 813) took 1208 ms. Trace:
I20260709 12:14:54.503315 13085 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:54.503283  8996 rpcz_store.cc:276] 0709 12:14:53.294142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.306123 (+ 11981us) service_pool.cc:224] Handling call
0709 12:14:53.328000 (+ 21877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.374983 (+ 46983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.375010 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.383043 (+  8033us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.963907 (+580864us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:14:53.963959 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.964047 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.502676 (+538629us) raft_consensus.cc:1685] finished
0709 12:14:54.502693 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.502819 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1511,"raft.queue_time_us":8050,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":23572,"thread_start_us":467042,"threads_started":1,"wal-append.queue_time_us":826462}
W20260709 12:14:54.506546 13240 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:54.479509 13043 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:54.511595 13242 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:54.512436  9617 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:14:54.452216 13132 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:54.486943 13231 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.560876 13160 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:54.561707 13160 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:14:54.491350 13026 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.014s	sys 0.008s
I20260709 12:14:54.563452  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:54.564416  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:54.565284  9068 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:14:54.487972 13218 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:54.566195 13218 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:54.566630 13218 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.569599  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 951) took 1256 ms. Trace:
I20260709 12:14:54.569962  9619 rpcz_store.cc:276] 0709 12:14:53.313195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.313313 (+   118us) service_pool.cc:224] Handling call
0709 12:14:54.569451 (+1256138us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400686ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:54.569543 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896091392}
I20260709 12:14:54.571116  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:54.571679  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:54.572738  8993 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:54.482939 13239 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.525305  9615 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:54.525746 13243 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:54.449390 13046 consensus_queue.cc:260] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.535063 13006 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.541392  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2338) took 1282 ms. Trace:
I20260709 12:14:54.543346  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 663) took 1236 ms. Trace:
I20260709 12:14:54.545027 13025 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:54.545780 13169 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:54.603173  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:54.556615  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:54.604804  8999 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.557605 13161 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.576911  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:54.581465  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.579530  9615 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:54.486711 13180 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
I20260709 12:14:54.596690  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:54.615765 12580 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:54.598160  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.616194 12580 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.616591 12580 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:54.612864 13185 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.002s
I20260709 12:14:54.619689 13185 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.620215  9615 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.621277  9615 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.621883 13185 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.623009 13046 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:54.623469  9066 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:54.579618 13171 consensus_queue.cc:1243] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:54.601155  8925 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.593349  8917 rpcz_store.cc:276] 0709 12:14:53.259057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.259145 (+    88us) service_pool.cc:224] Handling call
0709 12:14:53.259480 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.244200 (+984720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.541034 (+296834us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54000ca3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:54.541274 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116721024}
I20260709 12:14:54.548224 12701 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.636986 12701 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:54.608333  9068 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:54.611351  9074 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:54.629726  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.594203  8920 rpcz_store.cc:276] 0709 12:14:53.306901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.307012 (+   111us) service_pool.cc:224] Handling call
0709 12:14:54.543117 (+1236105us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400018e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:54.543283 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103856896}
I20260709 12:14:54.631459  9065 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:54.634085 13016 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.658749  8997 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:54.670312  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 182317us
I20260709 12:14:54.601604 13043 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.671561  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:54.688004  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46320.7us
W20260709 12:14:54.632339 12931 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
I20260709 12:14:54.604563 13169 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:14:54.704696  8998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 2796) took 1747 ms (client timeout 2183 ms). Trace:
I20260709 12:14:54.601183 13025 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:54.709483  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:54.626969 13129 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.775252  8922 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:54.971365  8998 rpcz_store.cc:269] 0709 12:14:52.910920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.921763 (+ 10843us) service_pool.cc:224] Handling call
0709 12:14:54.658350 (+1736587us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002373d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:54.658492 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668504320}
I20260709 12:14:54.922524  9065 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.785647 13227 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260709 12:14:54.975387 13169 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:54.976552 13169 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.979352  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.970180  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 298727us
W20260709 12:14:54.925073  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.920387  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 333242us
I20260709 12:14:54.816176  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:54.633695 13185 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:54.992695  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 176629us
I20260709 12:14:54.982154  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:54.637414 13161 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:54.982005  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:54.997162  9621 raft_consensus.cc:2368] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
W20260709 12:14:54.703817 13198 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:54.997927 12730 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.007211  9037 leader_election.cc:400] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:14:55.007579  9037 leader_election.cc:403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.007349 12730 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.008322 13047 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.009752 12730 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.010545 13145 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:55.011125 13145 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.013458 13145 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:55.015895 13025 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.017194 13025 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:55.017405 13130 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.569s	user 0.004s	sys 0.004s
I20260709 12:14:55.017903 13130 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:55.018798  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.020020 13006 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.772701 12931 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.022878 13129 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.023083 12931 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.026412 13161 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.008401 13016 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:54.701719 12872 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.327s
I20260709 12:14:54.714080 13225 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.846732 13239 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.029592 13161 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.029295 13239 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.030956  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.029448 13218 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:55.035635  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 330120us
W20260709 12:14:54.899354 13219 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:14:54.705978 13180 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.039371  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:55.062749 13180 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.063277 13180 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.063748 13180 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.050328  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:55.064656  9068 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.052137  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:55.065297  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.063971  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:55.058262  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.851747 12701 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.671448 13222 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 12:14:55.077629  9069 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:14:54.797051 13212 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:55.084575  9617 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.030611 13161 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:54.710536 13216 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.325s
W20260709 12:14:55.072728 13173 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:14:54.810269 13125 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.275s
I20260709 12:14:54.813685 13249 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.269s
I20260709 12:14:55.079591  8999 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:55.099220  9068 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
W20260709 12:14:55.088449  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 458788us
W20260709 12:14:55.103156  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 121242us
I20260709 12:14:55.104044  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.001992 13185 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.087785 13161 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.082898 12701 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:55.133670  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.135105 13239 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.119470 13161 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:55.144531 13037 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 12:14:55.145131 13037 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.150890  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:55.151861  9067 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:55.152303  9067 raft_consensus.cc:614] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.197234  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:55.202497  9069 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:55.197904  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:55.205286  9072 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:55.238323  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 144769us
I20260709 12:14:55.193262 13260 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:55.199285 13130 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.240865 13047 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:14:55.248624  9072 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:55.255637  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.256444  9617 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:55.175879 13239 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.181054 13185 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.180547 13218 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:55.273554  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 196995us
W20260709 12:14:55.276896  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 174316us
I20260709 12:14:55.280865  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:55.258334 12580 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.001s
I20260709 12:14:55.277820 13037 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.285269 13037 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:55.286290  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 91092.4us
W20260709 12:14:55.287622  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48363.2us
I20260709 12:14:55.285724 13239 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:55.287905  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 94634.2us
I20260709 12:14:55.312870  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.154539 13258 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 12:14:55.284511 13185 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:55.315160  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 211190us
W20260709 12:14:55.311156 13043 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.001s
I20260709 12:14:55.319516  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.327733  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.328377  9617 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:55.339432  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:55.341076  9073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 821) took 1553 ms (client timeout 2008 ms). Trace:
W20260709 12:14:55.343866  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66200.2us
I20260709 12:14:55.279320 13272 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:14:55.349435  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:55.344936  9073 rpcz_store.cc:269] 0709 12:14:53.787585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.795569 (+  7984us) service_pool.cc:224] Handling call
0709 12:14:55.340889 (+1545320us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54001b6554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:55.340999 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660510592}
W20260709 12:14:55.351531  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 62579.4us
I20260709 12:14:55.352645 12885 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:55.315507 13218 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:14:55.351048  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.358081  8994 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:55.360435  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.318377 13185 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.360134  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.368429  8994 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:55.326596 13130 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:14:55.369370  8994 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.369896  9617 raft_consensus.cc:1217] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:14:55.370373  9617 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:55.370486  8994 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.371273 13037 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.367913 13234 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:55.375707 13185 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.368073 13235 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.377112 12701 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.377579  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.380952  8917 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:55.377130 13267 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.379940  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.382248 13009 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:55.383136 13234 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:55.384192 13234 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.286613 12580 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.388422 13171 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:55.388902  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.389196 13171 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:55.390007 13275 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:55.358518  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:55.388592 12580 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.388497  8999 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.391345  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:55.391577  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.398556  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 79124us
I20260709 12:14:55.399356  8964 leader_election.cc:400] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:14:55.399633  8964 leader_election.cc:403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.349690 13278 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.404119 13264 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:55.402980 13180 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.407761  8998 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.408020 13274 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:55.408396  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:55.408556 13274 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.409842 13180 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.348562 13239 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:14:55.410092 13161 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.409036  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:55.412137  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:55.412500  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.412778  9071 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:55.413343 13107 raft_consensus.cc:2764] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:55.410873 13239 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.414644 13239 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:55.415539 13239 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.417434 13278 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.417490  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:14:55.418511  8919 raft_consensus.cc:606] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:55.418918  8919 raft_consensus.cc:614] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:55.419111  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60683.1us
I20260709 12:14:55.420415  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.415551  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:55.421452  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.419124 13283 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.422565 13283 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.422931 13283 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.424253 13161 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.424585  9622 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.426009 13264 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.426366 13272 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:55.426595 13264 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:55.426819 13272 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:55.427863  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.430356  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.431825  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.432404  8991 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.427260 13272 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:55.434096  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.433871 13264 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.437183  8994 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:55.437318  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.437690  8994 pending_rounds.cc:85] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 6
I20260709 12:14:55.437964  9621 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.438818 13218 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.439198  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.439790  9619 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.440601  8992 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:14:55.410849 13274 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.443050  8920 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.443848  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.444136  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.447878  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.449244  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.450855 13171 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.451442 13161 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.451856 13161 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.452210 13161 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.455828  8923 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:55.458985  9619 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:55.444581  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.445015  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.445569  8918 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.437098 13258 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.445960  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.429705  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.462486  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.460374  9618 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.446213  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:55.463861  9071 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.464956  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.465572  9000 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
W20260709 12:14:55.471601  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.472131  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.472419  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.479049  9621 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:55.437978  8994 pending_rounds.cc:107] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:14:55.481874  8994 raft_consensus.cc:2889] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:55.460939  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.462785  8919 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.482795  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.446316  9615 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:55.483104  9619 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:55.488332  8991 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:14:55.470716 13161 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.489769  9618 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:55.489921  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.488880  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:14:55.490988  9074 raft_consensus.cc:606] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:55.491344  9074 raft_consensus.cc:614] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.494176  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.494875  8916 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.495153  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.496071  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.497287  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.464511 13180 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.502310  8924 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:14:55.494338 13188 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:14:55.510658  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.506289  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:55.511941  8991 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.508965 13234 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:14:55.526742  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.528528  8916 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
W20260709 12:14:55.531633  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.542979  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:55.544476 13282 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.508011 13239 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:55.560469  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 57394.2us
I20260709 12:14:55.565122  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.566396 13282 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.588820 13289 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.589623 13289 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.590054 13289 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:55.545044 13171 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.541297 13049 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:14:55.610149  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.611519  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.611851 13213 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:14:55.612871 13180 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.613588 13180 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:55.614084 13180 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:55.614487 13213 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.614874 13213 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:55.610538 13283 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.614976 13180 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:55.628712  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 82473us
I20260709 12:14:55.629688  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 660) took 2323 ms. Trace:
I20260709 12:14:55.623862  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:14:55.677942  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54210.7us
I20260709 12:14:55.665966  8920 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.679034  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.684080  9071 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:55.676173  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:55.693851  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:55.695438  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.696787 12700 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:55.697875  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 179732us
I20260709 12:14:55.699919  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.700280  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.700662  9000 raft_consensus.cc:2368] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:14:55.700796  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.701428  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.701833  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.701432  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.702701  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.702811  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.703650  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.703824 12700 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.703930  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.702256  8994 raft_consensus.cc:2410] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:14:55.704715  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.706208  9000 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:55.707087  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.708148  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.709470  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.705062  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.710997  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.712263  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.712319  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.676885  8921 rpcz_store.cc:276] 0709 12:14:53.306024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.306544 (+   520us) service_pool.cc:224] Handling call
0709 12:14:53.333586 (+ 27042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.596429 (+262843us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:14:53.624027 (+ 27598us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.932754 (+308727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.932828 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:14:53.932899 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.038734 (+1105835us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b180036e740. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419
0709 12:14:55.629419 (+590685us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400019354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:55.629471 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.629603 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1191,"prepare.queue_time_us":33132,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":3059,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7272,"spinlock_wait_cycles":609806848,"thread_start_us":305083,"threads_started":1,"wal-append.queue_time_us":511434,"wal-append.run_cpu_time_us":1240,"wal-append.run_wall_time_us":1041620}
I20260709 12:14:55.713937  9000 raft_consensus.cc:2368] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10.
I20260709 12:14:55.714856  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.715415  9000 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.716297 13106 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.716862 13106 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.719406  8991 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:55.720989  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.723304 13132 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:55.723886 13165 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.725090  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:55.725503 13293 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.606248 13249 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:55.647491 13272 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.705579  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:55.705266  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.728957  8919 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:14:55.730516  8991 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.656194 13224 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.635131 13161 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.653087 13026 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.683921 13239 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.735857  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:55.732266  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.690573 13282 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.762123  9000 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:55.764751  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.766717  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.767453  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:55.775947  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:55.777002  8992 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:55.732229 12885 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:55.733629 13132 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:55.781698  8999 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:14:55.726033 13293 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.736121 13049 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.740540 13239 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.780012 13085 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.779623 13046 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:55.784349 13300 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.763926 13171 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:55.782218 13006 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:55.786211 13290 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:55.786826 13274 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.740980 13026 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:55.736627 13224 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:55.735612 13165 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:55.795954  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 817) took 2499 ms. Trace:
I20260709 12:14:55.810531  8997 rpcz_store.cc:276] 0709 12:14:53.296539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.501597 (+205058us) service_pool.cc:224] Handling call
0709 12:14:54.658580 (+1156983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.659210 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.794995 (+1135785us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002373d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:55.795201 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582851328}
I20260709 12:14:55.763887 12700 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:55.812093 12700 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:55.813097 12700 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.779808 12730 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.764592 13258 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.764094 13282 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.737898 13191 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:14:55.803725 13239 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.636962 13289 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.808873 13274 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:55.815618 13282 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.738652 13249 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.795953 12885 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.816856 13006 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.809211 13085 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.836426  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.837354  8919 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:55.779881 13213 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.829475 13274 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.841714  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.816766 13171 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.815582 13258 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.848313 13171 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.842506 13038 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:55.851344 13224 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.874251 13224 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.876987 12885 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.850935 13165 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.834470 13026 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.884747 13038 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.888417 13006 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.889297  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.890076  8921 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:55.889300  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:55.891310  8919 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:55.891873 13293 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.887048 13038 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.892416 13283 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:55.898748  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.897640 13272 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:55.891094 13249 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:55.898933  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 123096us
I20260709 12:14:55.832569 13132 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.918346  8919 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: [8.6-9.7]
W20260709 12:14:55.922690 13256 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.795s	user 0.003s	sys 0.000s
W20260709 12:14:55.926661 13185 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.003s
I20260709 12:14:55.932487 13085 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.942483 13214 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.944738 13214 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.945464 13305 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:55.946010 13300 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.946406 13300 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:55.946866 13214 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:55.947217 13300 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:55.950946  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.951257  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.952248  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:55.952589 13258 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:55.952862  9621 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:14:55.954924  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:55.955250  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:55.955778 13258 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:55.956144 13258 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:55.956530 13258 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.959765  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:55.965356 13285 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 12:14:55.967145 13258 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.970600  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:55.971318  8920 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:55.948505 13300 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.958729 13239 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.980470  9067 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:55.983857  9618 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:55.927073 13185 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:55.974359 13214 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.012763 13234 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:56.017052 13260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.003s	sys 0.009s
W20260709 12:14:56.031502 13260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.004s	sys 0.010s
I20260709 12:14:56.018090 13214 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.041082  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2837) took 1476 ms. Trace:
I20260709 12:14:56.021452 13258 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.042665  8995 rpcz_store.cc:276] 0709 12:14:54.564845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.575133 (+ 10288us) service_pool.cc:224] Handling call
0709 12:14:54.577469 (+  2336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.577657 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:54.825362 (+247705us) log.cc:844] Serialized 14 byte log entry
0709 12:14:55.956922 (+1131560us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800163e40. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf 00007f3985c55038
0709 12:14:55.957116 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.040410 (+ 83294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:56.040731 (+   321us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:56.040790 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.040896 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.041025 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1127779,"prepare.queue_time_us":1329808,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":6714,"raft.queue_time_us":204717,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":8604928,"thread_start_us":294636,"threads_started":2}
I20260709 12:14:56.054807  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 825) took 1493 ms. Trace:
I20260709 12:14:56.056739  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 675) took 1461 ms. Trace:
W20260709 12:14:56.058197  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.055401  9066 rpcz_store.cc:276] 0709 12:14:54.561396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.563138 (+  1742us) service_pool.cc:224] Handling call
0709 12:14:56.054594 (+1491456us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:56.054733 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136297728}
I20260709 12:14:56.057251  8922 rpcz_store.cc:276] 0709 12:14:54.595533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.598523 (+  2990us) service_pool.cc:224] Handling call
0709 12:14:54.629038 (+ 30515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.971318 (+342280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.056425 (+1085107us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400244354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:56.056664 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335669632}
I20260709 12:14:56.040161 13260 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:14:56.081540  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.031021 13282 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.031229 13234 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.080849 13258 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:56.079720 13280 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:14:56.087288 13318 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:14:56.102694  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 127851us
I20260709 12:14:56.105078 13318 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:56.105495 13318 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.100961 13258 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.107483 13260 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.110419  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.106494 13318 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.114974 13314 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:56.115665 13314 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.122889 13214 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:56.125639 13311 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:14:56.133790  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.134442  8922 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:56.136790  8917 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:56.139391 13106 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:14:56.140776  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.141969  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.142311  8994 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:56.142757  8995 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:14:56.142738  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.143497  8991 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:14:56.146620  8997 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:56.133100 13239 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.149047  8995 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.151571  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.152180  8997 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:56.130367 13218 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:14:56.155031  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:56.145694 13314 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.150209  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.156893  8995 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:56.136546 13258 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.167688 13274 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.168453  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3010) took 1994 ms. Trace:
I20260709 12:14:56.169872 13274 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.172520 13213 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.186612  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:56.187644  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:56.189595  9065 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:56.190896  9073 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:56.191797  9072 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:56.159286 13043 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:56.203878  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48916.9us
I20260709 12:14:56.160449 13282 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.168821  9070 rpcz_store.cc:276] 0709 12:14:54.174245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.178330 (+  4085us) service_pool.cc:224] Handling call
0709 12:14:54.178637 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.480678 (+1302041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.480716 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.481180 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:14:55.630486 (+149306us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:55.630543 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.806944 (+176401us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b48002601d8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ab64aa1 00007f398ab5bb37 00007f398ab5b9ca 00007f398ac5326f 00007f398ac52f37 00007f398ac6755c 00007f398ac67508 00007f398ac67488 00007f398ac67443 00007f398ac666ec 00007f3989b90a96
0709 12:14:56.168137 (+361193us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540030e654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:14:56.168191 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.168236 (+    45us) raft_consensus.cc:1685] finished
0709 12:14:56.168248 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.168396 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35683,"raft.queue_time_us":35915,"raft.run_cpu_time_us":2568,"raft.run_wall_time_us":319529,"spinlock_wait_cycles":2919742080,"thread_start_us":112957,"threads_started":1,"wal-append.queue_time_us":121843}
W20260709 12:14:56.194736  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.158041  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 370111us
I20260709 12:14:56.202757  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:56.135922 13185 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.209246  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.210256  9070 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:56.209730 13106 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:56.211483 13026 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.211583 13106 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.147410 12931 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:14:56.212203 13106 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:56.204331 13043 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:56.209584 13321 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:14:56.215740  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.219522 13319 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:56.215969 13239 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:56.220762 13239 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:56.220894 13278 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.220984 13319 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:56.221575 13319 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.221947 13305 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.221664 13239 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.222479 13305 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.224573 13305 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.225036 13305 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.225487 13305 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.205490 13258 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:14:56.212374 12931 consensus_queue.cc:1243] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:56.215443  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:56.229538 13185 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:56.229851  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:56.231254 13049 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.231602 13125 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.232278 13125 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.232781 13125 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:56.234119 13313 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
W20260709 12:14:56.236197 13263 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.922s	user 0.002s	sys 0.000s
I20260709 12:14:56.231696 13049 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.245800  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:56.250371  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.256224  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:56.257321  9615 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:56.229902 13185 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:56.262221  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:56.262809  9615 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:56.263553  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.264146  8917 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:56.266949  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:56.270094  9073 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:56.270780  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.271852  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.249529 13049 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.274096  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.275167  8997 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:56.279544  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.280347  8997 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:56.264261 13282 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:56.287703  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.222829 13319 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.231112 13043 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.292762 13319 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:56.294850  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:56.299978  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.260880 13112 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:56.315454  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:56.268399 13321 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:14:56.322355 13106 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.326833  8994 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:56.308367 13185 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.322940 13321 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.330628  8997 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:56.290390 13282 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:56.340693 13282 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.343592  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:14:56.344112 13286 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.729s	user 0.002s	sys 0.000s
I20260709 12:14:56.344287  8993 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:56.351547 13233 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:56.352697 13233 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:56.332237 13321 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.353093 13233 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.354027 13233 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.356014 13305 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:56.356478 13318 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.357172 13233 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.359961  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:56.360221  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 56766.5us
I20260709 12:14:56.353996 13321 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.366462 13260 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:56.379187  9621 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:56.369107  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:56.331718 13106 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:56.350570 13185 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.388589  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:56.389588  9618 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:56.394229  8889 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:56.395677  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.396464  8992 raft_consensus.cc:2393] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 7: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:56.397177 12885 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:56.395058  9037 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.581s (SENT) [suppressed 27 similar messages]
I20260709 12:14:56.370723 13260 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.400295  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:56.401890  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:56.402801  9621 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:56.404484  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:56.405241  9619 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.381613 13267 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:14:56.408705 13169 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:56.382810 13227 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:14:56.413393  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.413435  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:56.414116  8920 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:14:56.414073 13293 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:56.415596  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.416522  8922 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:14:56.416837  8996 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:56.417351  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.418030  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:56.418900  9622 raft_consensus.cc:2410] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:56.422542 13293 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.423060 13293 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.423779 13038 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:56.425812 13038 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:56.426199 13038 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:56.425173 13016 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:56.427361 13260 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.427034 13038 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.428601 13038 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:56.429339 13293 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.430248  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:56.360813 13125 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.431682 13267 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.384358 13156 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.432773 13156 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.433115 13125 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.433367  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:56.435266  8997 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:56.437561  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:56.438177  9618 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:14:56.441922  9065 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:56.444339  8993 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:14:56.434288 13049 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.445715  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.448814  9071 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:56.441270  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.445676  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:56.451488  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.454816  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:56.455418  8997 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.460794  9619 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:56.433131 13156 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.461455  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:56.470247  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.468672  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:56.474809  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:56.483752  8997 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:56.487398  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:56.487637  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 92586.9us
I20260709 12:14:56.466753 13267 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:56.462993 13208 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:56.499476  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.500427  9071 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:56.501677  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.501819  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.502554  9066 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:56.503763  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.504927  9069 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:14:56.512828  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.513657  9069 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:56.513866  9074 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
W20260709 12:14:56.515558  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.517166 13319 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:56.517716 13319 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.494902 13225 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:56.520144 13319 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:56.522235  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.522253 13049 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:56.524086  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:56.525033 13282 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.512004 13120 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:56.528527  8999 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.493111 13125 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:56.469846 13264 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:14:56.531867  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.538821  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.539458  9067 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:56.492120 13267 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:56.540374 13267 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.541415 13225 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:56.542383 13225 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.540372  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.545814  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.536662  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:56.548305  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.548408  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.511179 12885 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:56.508812 13300 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:56.563897  8922 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:14:56.564473 13267 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.565330  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.565943  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:56.566591  8922 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:56.565330  8999 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:56.567332  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:56.571353  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.571353 13120 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.572613 13321 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.573630  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:56.574205  8994 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.577687  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:56.581866 13239 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:56.582441 13239 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.510756 13208 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.592695  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:56.584335  8922 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:56.516099 13270 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:14:56.586246  9621 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:56.554009 13125 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.584165 12885 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.600687  9615 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:56.591610 13282 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.586355  8994 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:56.610145 13319 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:56.610414 13009 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:14:56.605495 12885 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:56.588660 13300 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.582948 13260 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.596046 13267 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.605624 13213 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:56.646207  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.640628  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:56.677772  9074 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:56.606143 13107 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:14:56.605077 13227 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:14:56.627159 13319 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:56.613127 13314 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:14:56.657868 13208 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:56.737876  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 150218us
I20260709 12:14:56.734942  9074 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:56.726652 13239 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.686815 13125 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:56.765110  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 161639us
I20260709 12:14:56.768414  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:56.772907  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:56.777809  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.782474  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:56.784307  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.772275 13234 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:56.748447 13156 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:56.742318 13319 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:56.802817  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56433.7us
W20260709 12:14:56.792616 13329 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:56.789547 13282 raft_consensus.cc:2764] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:14:56.809262  9037 leader_election.cc:400] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:14:56.809630  9037 leader_election.cc:403] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:56.795857 13260 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.823112 13085 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:14:56.837230 13335 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:14:56.837569 13336 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:14:56.840654 13330 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:14:56.842514 13339 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:14:56.844517  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.845796  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.847081  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.857096  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.857549  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:56.815495 13300 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.863787  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:56.865029  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:14:56.893286 13337 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:14:56.895264 13346 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:14:56.897197 13156 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:56.897714 12885 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:56.900193 13085 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:14:56.910086 12885 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.021411 12885 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.022578 12885 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.025255 12885 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.058781  9066 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:57.060428  9066 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:14:57.060793  9066 pending_rounds.cc:85] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:57.061012  9066 pending_rounds.cc:107] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:14:57.061237  9066 raft_consensus.cc:2889] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:57.086251 12885 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.086962 12885 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.089639 12885 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.105651  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 913) took 1155 ms. Trace:
I20260709 12:14:57.106273  9622 rpcz_store.cc:276] 0709 12:14:55.950293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.955000 (+  4707us) service_pool.cc:224] Handling call
0709 12:14:57.105355 (+1150355us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54004e8754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:57.105568 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064431488}
W20260709 12:14:57.197566  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.198369 13354 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.198930 13354 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.201264 13354 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.202605 13352 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.202952 13352 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.204694 13352 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:57.276794  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.310846  9068 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:14:57.315263 13290 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:57.315907 13290 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.318228 13290 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:57.335525 13316 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.303s	user 0.006s	sys 0.005s
I20260709 12:14:57.343482 13290 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.344049 13290 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.346486 13290 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.352586  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:57.499321 13236 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.499958 13236 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.502425 13236 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.503162 13352 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.503809 13352 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.506506 13352 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:57.645457  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.018s	sys 0.029s
W20260709 12:14:57.645895  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.018s	sys 0.029s
W20260709 12:14:57.646425  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 837383us
I20260709 12:14:57.648020  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.650331  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.651566  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:57.660497  8964 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.698s (SENT)
I20260709 12:14:57.661206  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.687285 13306 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:57.688129 13306 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.652885  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:57.702466  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49649.4us
I20260709 12:14:57.703310  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.704157 13236 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.704764 13236 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.707556 13359 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.708304 13359 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.708920 13359 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:57.709499 13359 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.710716  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.711333 13306 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.711946  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.713385  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.717738 13359 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:14:57.729673 13359 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:57.730031 13359 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.730399 13359 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.706952 13236 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.731354 13236 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.732213 13236 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.719174  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:57.736161 13236 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:57.713820  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49952.2us
I20260709 12:14:57.736910  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:57.717334  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.738996  9037 leader_election.cc:400] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10.
I20260709 12:14:57.739895  9037 leader_election.cc:403] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.747309 13359 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.751700 13185 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.751979 13354 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.752499 13185 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.752825 13354 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.753166 13185 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.762815 13185 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10.
I20260709 12:14:57.766042  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.767318  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:57.767781  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:57.768383  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.768723 13185 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.769148 13185 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.769562 13185 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:57.770890  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.776870 13201 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.777746 13201 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.779086  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3056) took 1340 ms. Trace:
I20260709 12:14:57.779708  9073 rpcz_store.cc:276] 0709 12:14:56.438212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.438339 (+   127us) service_pool.cc:224] Handling call
0709 12:14:56.438663 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.438890 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:56.684212 (+245322us) log.cc:844] Serialized 14 byte log entry
0709 12:14:57.778596 (+1094384us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b1800414a60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287
0709 12:14:57.778703 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:57.778757 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:57.778810 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.778891 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.779028 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165856,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":33,"raft.queue_time_us":47413,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4593,"spinlock_wait_cycles":22548352,"thread_start_us":371132,"threads_started":3,"wal-append.queue_time_us":109658}
I20260709 12:14:57.781803 13360 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.783066 13359 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:57.768440  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:57.785894  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.786708 13351 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.787649 13351 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:57.788820 13359 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.789288 13359 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.787056  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:57.791998 13354 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:57.792555 13354 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:57.792935  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.793473 13354 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.794605  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:14:57.795563 13352 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.796169 13359 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:57.786496 13201 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.801591  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.802276  9622 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
W20260709 12:14:57.805576 13322 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.666s	user 0.009s	sys 0.000s
I20260709 12:14:57.806780 13364 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.808691 13364 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.812309 13364 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.807829 13278 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:57.815389 13278 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.817780 13278 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.818259 13278 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:57.807614 13185 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.812647 13282 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.818715  9074 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2453) took 1271 ms (client timeout 1520 ms). Trace:
I20260709 12:14:57.819161 13282 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.820513 13351 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.821074 13351 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.821489 13282 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.822187 13282 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:57.822620 13282 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.814632  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.823432 13352 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.823992 13352 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:57.819185  9074 rpcz_store.cc:269] 0709 12:14:56.547051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.548184 (+  1133us) service_pool.cc:224] Handling call
0709 12:14:57.818547 (+1270363us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003ee9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:57.818655 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295800064}
I20260709 12:14:57.825603 13359 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.826148 13352 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.827802 13351 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:57.826930 13352 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.828805 13282 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.830178 13282 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.830732 13282 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.828821 13352 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.826195 13359 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.831393 13239 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.836313  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.846767  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:57.843808  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.847457  9000 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:14:57.847937  9072 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:14:57.840190  9071 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:57.846469 13085 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.851989  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.853710  9620 raft_consensus.cc:2410] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:57.845409 13362 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.856082  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:57.856709  8992 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.857087  8991 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:57.853473  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:57.845532  9073 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:14:57.859609  9073 pending_rounds.cc:85] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 6
I20260709 12:14:57.860121  9073 pending_rounds.cc:107] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:14:57.860495  9073 raft_consensus.cc:2889] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:57.856644  8964 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.842515  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.863677  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:57.864394  9070 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:57.864053 13085 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.866525 13085 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.847038 13351 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.867648 13351 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.869907 13351 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.870741  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3062) took 1306 ms. Trace:
I20260709 12:14:57.871568 13185 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:57.871714 13359 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.818709 13278 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.872738 13364 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.874495 13278 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.846848 13239 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.874890 13282 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.875296 13239 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.881407  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.881561 13362 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.882714  9071 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:14:57.882974  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.884366  9000 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:57.886492  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:57.886775  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44396.8us
I20260709 12:14:57.887184  8919 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:57.887650  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:57.889315  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.871160  9065 rpcz_store.cc:276] 0709 12:14:56.564503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.873130 (+308627us) service_pool.cc:224] Handling call
0709 12:14:56.873420 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.873767 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:56.873792 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:56.873836 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:57.870448 (+996612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.870564 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.870684 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1144,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1787}
I20260709 12:14:57.862869  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.870082 13352 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.890960  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:57.892246  8992 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:57.891584 13363 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.905370 13140 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.905705 13352 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:57.905586 13363 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.906363 13352 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:57.893954  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:57.888562  9070 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:57.894447  8993 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:57.910167  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:57.895746  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:57.901126  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44605.6us
I20260709 12:14:57.912510  8919 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:57.893893  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:57.897415  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:57.913012  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.913535  8917 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:57.888520 13282 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.901054  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:57.915661  8998 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:57.914654  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:57.890632 13344 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.917227  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:57.893075 13185 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:14:57.925262  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:57.907428 13352 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.908291 13278 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:57.903877 13366 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:57.957772  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78913.4us
I20260709 12:14:57.946549 13364 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:57.928169 13185 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.949134 13201 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.940060 13362 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:57.919548 13222 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.926928 13310 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:57.963687  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:57.947852 13354 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:57.948069 12931 raft_consensus.cc:2764] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:57.968963  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.948325 12885 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:57.924366 13282 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.940445 13262 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:14:57.975792  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:57.987437  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.997414  9622 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:57.977718  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.939714 13239 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.993580  9069 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:57.964558 13364 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:58.006798  9073 raft_consensus.cc:2376] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10. Re-sending same reply.
I20260709 12:14:57.995177  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:57.986320 13359 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:57.924005 13140 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.000177  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:57.944885 13344 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:57.992965 13222 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.015062 13140 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.016808 13344 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.017086 13222 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.005199  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.008509  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.018006  9618 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:14:58.017488 13344 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.997222 13310 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.021224 13310 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.021914 13363 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:57.994060 13362 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:57.994859  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 76879.5us
W20260709 12:14:57.993602  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76491.6us
I20260709 12:14:58.008733  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:57.966656 13185 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:58.021041  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.014089 13260 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.025651  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.026958  8922 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:58.028189  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:58.029194  9071 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.010394 13364 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.960072 13366 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.030663  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.031420  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.035436  8996 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.035552  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.036265  8992 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:57.977567 13201 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.041678 13366 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.028723 12931 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.043157 12931 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.043396 13374 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:58.043792 12931 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.044508 13374 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:58.044898 13374 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:58.046016  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:58.045789 13374 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:57.997112 13354 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.050114 13354 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.054401 13359 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.042517 13366 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:14:58.055032  9074 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:58.073503  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.028002 13278 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:58.031369 13236 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:58.075824  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.056582  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.069978 13282 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.076721  9618 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:58.047039 13374 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.077339  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.061722  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.078626  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.072752 13373 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.079523 13373 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.081993 13373 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.082556 13373 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.082901 13373 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.071884 13239 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.106720  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.073503 13372 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:14:58.109920  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.076988 13043 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.110994 13372 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.111604 13372 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.112331  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.109222  9000 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:58.076035 13278 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.113670  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.084234  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.117105  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.117671  8999 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.118570  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.119140  8996 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.118445  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.122413 13201 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.122831  8991 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:58.125061  9615 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.029829 13140 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.130061  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.085134  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.129249  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.125579  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.130980  9615 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
W20260709 12:14:58.131681  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 46627.8us
I20260709 12:14:58.055146 13359 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:58.133685  9071 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:14:58.108866 13373 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.134991  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.148806  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.144749  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.152212 13239 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.134156 13140 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.039459 13362 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:58.142179  8999 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:58.108827 13366 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:58.167779 13366 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.168215 13185 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.170076 13366 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.176255  9620 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:58.176906 13185 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.178188 13173 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.178689 13173 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.180399 13309 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.180707  8996 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:58.180893 13309 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.181481 13173 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.182202 13378 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:58.184322  8992 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:58.056910 13344 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:58.150940  9622 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:14:58.155694  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:58.158777 13140 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.076037 13236 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.153486  8998 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
W20260709 12:14:58.163609  9095 debug-util.cc:398] Leaking SignalData structure 0x7b080030a120 after lost signal to thread 7716
W20260709 12:14:58.192941  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef580 after lost signal to thread 7719
I20260709 12:14:58.164194 13372 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.133467 13354 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:58.136032  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 51897.5us
I20260709 12:14:58.187676  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.199757  9620 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:58.200417  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.205545  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:58.206895 13225 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.206914  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:58.133076 13201 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.183023 13309 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.162420 13222 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.215521 13310 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:58.215549 13362 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.216076 13222 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.218822 13236 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.219204 13222 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.220292  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:58.222750  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:58.223644 13026 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:58.224192 13026 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:58.224814 13292 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.225404 13292 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:58.225088 13026 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.225772 13309 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:58.227505  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.225780 13362 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.226359 13292 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.212844  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:58.208851 13354 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.161949 13290 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:58.229884  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.236479  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.236748  8924 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:58.196199 13169 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.238418  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.212483  9620 raft_consensus.cc:2410] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:14:58.233073  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.233392  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.235260  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:58.287511  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 171974us
W20260709 12:14:58.300454  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56879us
W20260709 12:14:58.302101  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.303726  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.211016 13372 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:58.304232  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:58.306206  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 71053us
I20260709 12:14:58.307607  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.310643 13374 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:58.311960  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.330351  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:58.330909  9095 debug-util.cc:398] Leaking SignalData structure 0x7b080030a3a0 after lost signal to thread 8857
I20260709 12:14:58.330731  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.235859 13354 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:58.331929  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.332265  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.334837  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.349264  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.350423  8995 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:14:58.239411 13362 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.198124 13344 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.308617 13169 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:58.231626 13201 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.311457 13374 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:58.311836 13366 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:58.370214  8992 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:58.328744 13376 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.376997  8991 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:58.305945 13372 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:58.371172  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67619.4us
I20260709 12:14:58.349025 13278 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.244249 13290 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.382206  8996 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.384415 13278 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.376111 13236 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.381330 13140 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.390035  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.394652  8999 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:58.361725 12931 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.388571 13380 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.395572 13236 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.397877 13381 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.417294 13380 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.405646 13344 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:14:58.407557 13379 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:58.419426  8997 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:58.394984 13388 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:58.410625 13374 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.407368 13366 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.383674 13376 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.436110 13376 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.397097 13140 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:58.445518  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 112336us
I20260709 12:14:58.446609  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.450881 12931 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.427215 13388 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.456132  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:58.456714  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.457451  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.458017  8992 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:58.458921  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.456691  8995 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:58.459789  8992 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:58.444825 13201 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.462184  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.462779  8995 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:58.416177 13372 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.425045 13381 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.467530  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.468739 13381 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:14:58.469590  9068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2454) took 1922 ms (client timeout 1634 ms). Trace:
W20260709 12:14:58.470000  9068 rpcz_store.cc:269] 0709 12:14:56.549934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.816509 (+266575us) service_pool.cc:224] Handling call
0709 12:14:58.469416 (+1652907us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54000ac654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:58.469523 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018564480}
I20260709 12:14:58.470630 13381 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.424661 13169 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.443461 13366 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.453559 13388 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:58.461788 12931 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.484483  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:58.490178 12931 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.494772 12931 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.471130 13381 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.497534 13381 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.489763  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.499552  9072 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:58.499454 13359 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.486279  9065 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:58.487344  9068 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:14:58.504319  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.504777  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.501211 13372 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.501361 13391 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:58.471230 13354 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.484760 13373 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.505388  9622 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.505578  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.507128  9620 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.501907 12931 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.482862 13366 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.466250 13140 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.507778 13391 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.480094 13278 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.509742 13354 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.526674 13391 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.530755  9622 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:14:58.618158 13140 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.464114  8992 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:14:58.619280  9620 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:58.580277  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.505095  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.606719  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.621058  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:14:58.622221  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:58.622740  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 117547us
I20260709 12:14:58.624158  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.625277  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:14:58.626262  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.607929  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.606814  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.627846 13085 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:58.607697  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.628139  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.526095 12931 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.628455 13085 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.631230  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.632556 12931 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.627861  9071 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 6.
I20260709 12:14:58.630913 13140 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.643225  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.644248  9071 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:58.629024  9074 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:58.645133 13140 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.646191  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.626451  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.647871  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.614105  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.649201  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:58.650326  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.650475  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.651289  9615 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:58.645161  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.642628  8992 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:58.652515  9071 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:58.653069  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.653667  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.654734  9071 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:58.642068 13085 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.655689  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.632056  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:58.656476  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.657743  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.657964  9622 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.657271  9618 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:58.658676  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.659403  9620 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:58.626353  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:58.661324  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.628291  9072 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:14:58.663343 12931 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:14:58.637959  8994 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.672781 13236 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.674239 12931 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:58.674747 13201 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:58.543042 13373 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.541930 13380 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.675031 12931 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:58.675107 13236 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.696200 13236 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.696707 13236 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.697744 12931 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.669996  9068 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:58.536512 13359 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.675940 13233 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.685694 13388 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.688454 13354 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.541195 13364 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.692662 13360 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:58.698935  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4d80 after lost signal to thread 8877
W20260709 12:14:58.533615 13386 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 12:14:58.720276  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.721367  9072 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:14:58.722721 13364 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.677801 13140 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:58.675792  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:14:58.709151  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51691.4us
I20260709 12:14:58.713376  8994 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:58.709060  9068 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:58.717453  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:58.718604 13360 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:58.717730 13233 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.723743  8998 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:58.723548  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.725481  9615 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:14:58.726235 13388 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.727396  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:58.728874  9622 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:14:58.718497 13354 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:14:58.742251  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 859) took 2220 ms (client timeout 1968 ms). Trace:
I20260709 12:14:58.703656 13391 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.763329  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:58.764114  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88605.2us
I20260709 12:14:58.764489  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.765952  8999 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:58.762038  8997 rpcz_store.cc:269] 0709 12:14:56.521794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.521957 (+   163us) service_pool.cc:224] Handling call
0709 12:14:58.741677 (+2219720us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:14:58.741935 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4361596672}
I20260709 12:14:58.768673 13360 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.759584 13233 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.770468  9071 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:14:58.754251 13140 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.787173  8996 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.793052 13165 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.791385 13173 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.807778 13173 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.793639 13392 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.811420  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.792060 13373 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:58.800787  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:14:58.801395  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96252.5us
I20260709 12:14:58.801812  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.785027 13140 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.802588 13402 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.803290 13360 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.803525 13085 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.772053 13354 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.804738 13211 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:58.807039  9620 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:14:58.811151  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.863354  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.817777  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:58.823956  9095 debug-util.cc:398] Leaking SignalData structure 0x7b080031b340 after lost signal to thread 8949
I20260709 12:14:58.829068  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.830018  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.830345  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.831370  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.832314  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.851189  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:58.833760  8923 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:58.856027  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:58.834560  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.836589  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.841928 13165 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.844409  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:58.845698  9615 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:58.846642 13391 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.856884  8996 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:58.856796  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.858291  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.857666  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.863844  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:58.878683  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.857249  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:58.853070 13085 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:58.883538  8918 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:58.861410  8964 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.520s (SENT)
I20260709 12:14:58.891827 13352 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.891975 13278 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.892764 13352 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:58.892688 13278 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.894398  8992 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.894569  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:58.895689  9068 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.896631  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:14:58.896849  9068 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.898480  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:14:58.899369  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 81778.2us
W20260709 12:14:58.900362  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0160 after lost signal to thread 9024
I20260709 12:14:58.901551  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:58.902088  9095 debug-util.cc:398] Leaking SignalData structure 0x7b0800037f00 after lost signal to thread 9098
W20260709 12:14:58.902417  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2a20 after lost signal to thread 9099
I20260709 12:14:58.902761 13378 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:14:58.903188 13378 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.903446 13373 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:58.903733 12701 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.904362 12701 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:58.905030  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.905640 12701 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.906391  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:58.906566  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:58.908102  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.910220 13165 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:58.912035 13391 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:58.861640 13211 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:58.913636 13211 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:58.910249  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 982) took 2346 ms. Trace:
I20260709 12:14:58.915741  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.915464  9619 rpcz_store.cc:276] 0709 12:14:56.564063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.574626 (+ 10563us) service_pool.cc:224] Handling call
0709 12:14:56.574908 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:56.602503 (+ 27595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:56.602533 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:56.603001 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.500788 (+1897787us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18000b1e80. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:14:58.759322 (+258534us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:58.762850 (+  3528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.762991 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.909726 (+146735us) raft_consensus.cc:1685] finished
0709 12:14:58.909748 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.910029 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29967,"raft.queue_time_us":31365,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19391,"spinlock_wait_cycles":3591424,"thread_start_us":250563,"threads_started":1,"wal-append.queue_time_us":2287030}
I20260709 12:14:58.917384  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.917701  8921 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:58.917963  8993 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:58.918267  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.915418  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:58.856586 13290 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:58.920092 13364 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:58.920361  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59195.7us
I20260709 12:14:58.920543 13364 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:14:58.921046 13364 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:58.921429 13208 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.922967 13043 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.903611 13378 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:14:58.924047  8991 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:58.925282  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.912442  8924 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:58.928098  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.929297  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.930483  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.918836  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.926911  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.939975  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.915009 13211 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:58.950855  8917 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:14:58.949877  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.957943  8992 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
W20260709 12:14:58.964911  9095 debug-util.cc:398] Leaking SignalData structure 0x7b080032d6c0 after lost signal to thread 9649
I20260709 12:14:58.967360  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.968957  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.969081  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.971518 13305 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:58.972023 13305 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:58.972425 13305 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:58.966070  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:14:58.973706  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70710.6us
I20260709 12:14:58.970813  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:14:58.931141 13354 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.894377 13352 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:58.990563  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:14:58.990507  8993 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:14:58.991889 13359 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:58.994666  8921 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.995455 13351 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:58.998006  8823 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 6 to 7, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 7 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:58.988124  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:14:58.999578  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.001823  9040 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:58.990625 13173 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.003821  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:58.981025  8997 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:58.988677 13392 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:14:59.019665  8996 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:14:59.020661  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49948.1us
I20260709 12:14:58.950476 13233 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.023955  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:59.012137 13351 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.003027 13364 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:14:59.044068  8963 connection.cc:256] RPC call timeout handler was delayed by -1.508831943000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 12:14:59.053263  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73232.5us
I20260709 12:14:59.054004  9072 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:14:59.057443  8963 connection.cc:256] RPC call timeout handler was delayed by -1.3753290820000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 12:14:59.061203  8963 connection.cc:256] RPC call timeout handler was delayed by -1.0828714020001371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 12:14:59.062664 13258 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:59.057415 13351 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:59.062582  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.072603  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:59.075901  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 94816.6us
I20260709 12:14:59.079946 13392 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:59.081332  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.081930 13354 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.085541  9620 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:59.037349 13236 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.102391  9068 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:14:59.055835  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.104662  9071 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:59.100172  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.117619  9068 pending_rounds.cc:85] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 9
I20260709 12:14:59.127708  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.097285 13290 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.052440 13140 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.102587 13258 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.145156 13258 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.146204 13140 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.147022  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.137097  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.141134 13364 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.143846 13290 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.151610 13043 raft_consensus.cc:2764] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:14:59.152129  9069 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:14:59.156432  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.114866 13165 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.158594 13233 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.159864  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.163439  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.164248 13402 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:59.164644  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 123953us
I20260709 12:14:59.192700  9070 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:59.195291  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.195588 13222 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.196506 13222 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.166257 13236 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.119385 12701 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:59.194082  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.198782  9070 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:14:59.199348 13165 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.202766 13165 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:59.193123 13402 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:14:59.203722 13402 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.208855  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.210789  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.168484  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.118079  9068 pending_rounds.cc:107] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:14:59.191953  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.195483  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.199890  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.170258  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:14:59.212967  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 85495.6us
I20260709 12:14:59.186789  8918 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:14:59.184561 13278 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:59.213850  9068 raft_consensus.cc:2889] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:59.186316  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 196859us
I20260709 12:14:59.216581  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.216708  8920 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:59.222393  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.227303  8916 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:59.199072 13290 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.227550 13236 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:59.227751  8919 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:59.228256 13236 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:59.229633  9070 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:59.229301 13236 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.209517 12931 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:59.227361  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.233769  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.231065 13392 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:59.235982  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.236783 13208 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:59.237217 13208 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.237605 13208 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.236411  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.240286  8963 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:59.199059 13222 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:59.249178 12701 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:59.251936 13234 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:59.253301  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:59.254688  8924 raft_consensus.cc:2410] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:59.255055  9072 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:59.233340 12931 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:14:59.259809 13234 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:59.261459 13043 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.264041 13234 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.268970  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.271345 12701 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:59.272549  9066 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:14:59.273334 13173 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:59.278975  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.283102  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.285148 13211 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:59.286170 13388 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:59.286345 13211 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:14:59.286644 13388 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.286901 13211 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.287225 13388 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.288147 13211 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.288779 13173 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.289281 13173 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.289737 13211 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:59.276957 13305 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.292045 13026 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:59.293493 13305 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.293936  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:59.295449  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 74139us
I20260709 12:14:59.296134  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.296342  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.298130  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.298760  9072 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.299103 13169 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:59.299665 13169 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.300011 13169 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:59.301352 13388 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.303606  9065 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:14:59.306778  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:59.307068  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.307739  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.308135  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:59.310009  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:59.309685 12931 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.310635  9621 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.311272 12931 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:59.313671  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 145378us
I20260709 12:14:59.316237  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.317710  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.316833 13169 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.293856 13233 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:59.318990 13352 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:59.319883 13352 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:14:59.320022  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.321159  9621 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:14:59.328465  9072 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:14:59.331857  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.302610 13258 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.293507 13026 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:59.329845 13043 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:59.339430  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.286696 13208 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.346721  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:59.340454 13026 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.347496  9000 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:59.344848 13388 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.348271 13026 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.351656  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:14:59.359403 13408 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:14:59.344985 13378 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.368916 13258 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:59.372153  9618 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:59.372859 13402 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.374557  9000 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:14:59.374716 13305 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.373346 13208 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.375490 13305 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.378186  8991 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:59.378731  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:59.380456  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.383088  9067 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:59.383872  9068 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:59.385368  9070 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:59.392431 13364 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:14:59.396159  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 97008.1us
I20260709 12:14:59.397182  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:59.397583  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.398687  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:14:59.383111  8997 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:59.366812  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:59.401877  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60774.4us
I20260709 12:14:59.403467 13278 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:59.403741  8822 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 304) took 41259 ms (client timeout 15000 ms). Trace:
I20260709 12:14:59.404062 13278 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:59.374969  9000 pending_rounds.cc:85] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 10
I20260709 12:14:59.405170  9000 pending_rounds.cc:107] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:14:59.405489  9000 raft_consensus.cc:2889] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:59.405251 13278 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.406443  8823 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:59.416945  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 97746.2us
I20260709 12:14:59.417876  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:14:59.419785  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:59.416411  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.416657 13351 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.363620 13360 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.428377 13374 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.429028 13374 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:14:59.429229 13413 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:14:59.429574 13374 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.429774 13351 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.430742  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.432045 13402 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.423931 13258 raft_consensus.cc:2764] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:14:59.428411 13360 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.435988 13360 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.436050  9000 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:59.438650  9070 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:59.439500  9067 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:59.409330 13222 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:14:59.440589  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.443019  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.443408  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.444182  9071 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:14:59.444679  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.446254  9040 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.447206 13352 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.447940  9065 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:59.447809 13352 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.448205 13364 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.450220 13352 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:14:59.450788 13352 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:59.451488 13378 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.451682 13351 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.453527  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:59.454571  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:59.455497 13364 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:59.404162  8822 rpcz_store.cc:269] 0709 12:14:18.143970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.144222 (+   252us) service_pool.cc:224] Handling call
0709 12:14:59.403493 (+41259271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:51.195878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:51.353557 (+157679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:51.353637 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:14:51.353663 (+    26us) tablet.cc:662] Decoding operations
0709 12:14:51.354479 (+   816us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:51.354587 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:51.354629 (+    42us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:14:51.412654 (+ 58025us) tablet.cc:701] Row locks acquired
0709 12:14:51.412710 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:14:51.412954 (+   244us) write_op.cc:270] Start()
0709 12:14:51.413191 (+   237us) write_op.cc:276] Timestamp: P: 1783599291412823 usec, L: 0
0709 12:14:51.413223 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:14:51.424527 (+ 11304us) log.cc:844] Serialized 2054 byte log entry
0709 12:14:52.759026 (+1334499us) op_driver.cc:464] REPLICATION: finished
0709 12:14:52.930840 (+171814us) write_op.cc:301] APPLY: starting
0709 12:14:52.931085 (+   245us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:53.676910 (+745825us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:53.800909 (+123999us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:54.262189 (+461280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:54.403535 (+141346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:14:54.407501 (+  3966us) write_op.cc:312] APPLY: finished
0709 12:14:54.407940 (+   439us) log.cc:844] Serialized 57 byte log entry
0709 12:14:54.460834 (+ 52894us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:54.460948 (+   114us) write_op.cc:454] Released schema lock
0709 12:14:54.461028 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:54.465951 (+  4923us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:54.465992 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":758348,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":137272,"apply.run_cpu_time_us":37881,"apply.run_wall_time_us":1535060,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18837,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":162901,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":8,"num_ops":5,"prepare.queue_time_us":370091,"prepare.run_cpu_time_us":5293,"prepare.run_wall_time_us":237195,"replication_time_us":1316254,"thread_start_us":276906,"threads_started":3,"wal-append.queue_time_us":137640,"wal-append.run_cpu_time_us":1318,"wal-append.run_wall_time_us":1015378}]]}
I20260709 12:14:59.457245 13364 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:59.457760 13364 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.458216 13364 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.460461  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.461427  9620 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:59.463258  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.463616  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:14:59.464334  9619 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:14:59.464934  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:14:59.465756  9620 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:14:59.466334  9072 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:59.467308 13026 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:59.469305  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.469537  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.471036  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.471165  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:59.483760  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.484752  9074 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.378240 13305 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:14:59.406144 13169 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.390635 13173 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.493485  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.499122  9068 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:14:59.493702  9588 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.492787  8823 catalog_manager.cc:5697] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 3 to 8, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.496382 13426 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:59.507375 13173 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.511958  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.512812  9072 raft_consensus.cc:2410] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:14:59.513742  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.514282  9072 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:59.515623  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:14:59.516220  9071 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:14:59.517498  9071 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:59.517277  8823 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 1 to 4, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 4 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.518430 13227 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:59.520545 13292 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:59.521499 13292 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:14:59.522091  9069 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:59.523104  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.523692 13270 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:59.524088 13270 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.524935 13270 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.526124 13270 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.526974 13305 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:59.521529  9066 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:14:59.531826 13165 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:59.532289 13165 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.533182 13165 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.534488 13165 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.500857 13290 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:59.540319  9072 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:14:59.500734 13222 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:14:59.552111 13222 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:59.559564  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:14:59.560890  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:14:59.560668 13364 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.561892 13270 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.562395 13270 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.562819 13270 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.563305 13165 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.563813 13165 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:59.564270 13165 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.565100  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:14:59.502471 13402 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:59.518600  9071 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:59.575495  9621 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:14:59.577771  9065 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:59.568362  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.583869  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:59.502281 13351 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.554872  8823 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:14:59.594009  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.586810  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:14:59.616894  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 48606.4us
I20260709 12:14:59.617707  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:14:59.578222 13374 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.617789  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:14:59.619221  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 176330us
I20260709 12:14:59.586243 13402 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:59.625849  9074 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:14:59.579838 13222 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:14:59.628707  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.614202 12931 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:59.632319 13352 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:14:59.707454  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.617048 13173 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:14:59.695439 13306 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 12:14:59.690320  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 72626.6us
I20260709 12:14:59.615633 13290 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:59.620250 13364 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.638058 13426 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:59.620069 13227 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:14:59.749233  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 116265us
I20260709 12:14:59.749172 13222 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:14:59.686715 13414 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:14:59.752841  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 124246us
I20260709 12:14:59.765544  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:14:59.770427  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 299356us
I20260709 12:14:59.772198  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.755702 13234 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:59.776564 13364 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:59.777297 13364 consensus_queue.cc:1243] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:59.778512 13426 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:14:59.779474 13274 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:59.780232  9074 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.751947 13305 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:59.780324 13262 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.784471 13234 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:14:59.750998 13270 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.786150  8823 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.787886 13165 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.781080 13173 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:14:59.788910  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.790145  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.782929 13352 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.791608 13274 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:59.795107 13374 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:14:59.795886 13043 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:59.859731 13234 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.805824 13262 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:59.798339  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52715.6us
I20260709 12:14:59.761682 13258 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.862743 13262 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.863888  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.865806  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:14:59.808314  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 310046us
W20260709 12:14:59.824967  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 241200us
I20260709 12:14:59.867372 13173 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.769599 13222 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.852221 13274 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:14:59.870096 13222 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.874751  9074 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:59.755762 13278 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:14:59.881285 13043 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:59.883813 13222 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:59.884519  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 94472.8us
I20260709 12:14:59.884217  8823 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:59.885146 13425 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:59.885844 13425 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:59.886420  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:14:59.885998  8823 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:14:59.887346 13258 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:14:59.886864 13425 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.887786 13258 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.888233 13258 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:14:59.768695 13402 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:14:59.874948  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 105684us
W20260709 12:14:59.908794  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.908999 13423 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:59.883905 13043 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:14:59.891400 13360 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:14:59.894378 13374 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.870460 13274 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.871379 13026 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:59.909727 13423 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:14:59.940510 12580 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:14:59.924445  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:14:59.926105 13227 consensus_queue.cc:1243] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:59.926630 13043 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.907085 13233 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:14:59.957542  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.931336 13360 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:14:59.962133  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.962205  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.942610 13140 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.971091  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 101869us
I20260709 12:14:59.996979  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:14:59.997135  8996 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:59.963097  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 57106.9us
I20260709 12:14:59.925454 13431 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:59.963618 13427 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.954012 13026 consensus_queue.cc:1243] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:00.007974  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:00.013180  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 90108.3us
I20260709 12:15:00.015874  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:00.016764  9621 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:14:59.996929 13374 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.995447 12931 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:00.025851  8992 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:00.022847  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.037628  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:00.038272  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:00.077266  8991 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:00.005602 13439 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:00.028375 13426 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:00.079782  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57019.5us
W20260709 12:15:00.092456  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95091us
I20260709 12:15:00.091408  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:14:59.961156 13227 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
W20260709 12:15:00.103919  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 68233.7us
I20260709 12:15:00.038034 13169 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:00.105317  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:00.111222  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.088197 13165 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.117130  8991 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:00.082180 13435 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.091830 13447 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:00.009582 13140 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.037376 13374 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.106137 13169 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:00.023046 13427 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.129383 13437 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:00.101444 13278 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:00.161868  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 128478us
I20260709 12:15:00.124130 13431 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:00.179690 13169 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.181130 13169 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.161415 13352 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.161636 13270 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.183488 13436 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:15:00.185339  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:00.091753 12931 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.187209 13432 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:00.187850 13432 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.190191 13432 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.191412 13440 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.191910 13440 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.192312 13440 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.196807 13140 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.125002 13262 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.197404 13140 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:00.197898 13442 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:00.198357 13442 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:00.198753 13442 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.186199 13278 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.200297 13360 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.200737 13427 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.201627  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:00.202055 13278 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.035393 13423 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.202436 13374 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:00.207767  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 102600us
I20260709 12:15:00.210489  8992 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:00.199049 13262 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.219038  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:00.217201  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:00.229971  9620 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:00.220000  9621 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:00.232914  9615 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:00.223557  8996 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:00.123391 13433 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:15:00.215577 13140 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:15:00.250156  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64688.4us
W20260709 12:15:00.252451  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 490449us
I20260709 12:15:00.232776 13432 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:00.301220  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 205209us
I20260709 12:15:00.307337  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.309563  9074 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:00.313133  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:00.314136  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.313764  9065 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:00.203015 13437 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.247675 13360 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:15:00.299453 13436 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:00.321758  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.338670  9074 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:00.346215  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:00.305858 13262 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:15:00.347271  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:00.348146  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 419240us
I20260709 12:15:00.347178  9621 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:00.323345 13433 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:00.384317  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 77088.2us
I20260709 12:15:00.387375  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:00.388995 13447 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:00.390743 13441 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:00.392099  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.391360 13441 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:00.326323 13436 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:00.411366  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.411778  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.412460  9072 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:00.392190 13222 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 12:15:00.416570  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.405403  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:00.420519  9072 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:00.421463  9065 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:00.349123 13258 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.381174 13443 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.429804  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:00.477982  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 48262.7us
I20260709 12:15:00.395778 13440 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.407778 13450 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:00.391610 13262 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 12:15:00.471851 13458 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:15:00.463620  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:00.464773  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:00.470073 13043 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.004s
W20260709 12:15:00.480427  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60143.9us
I20260709 12:15:00.398237 13292 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:15:00.486117  9069 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.519439  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.520290  8918 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:00.523742  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.481356 13425 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.482402 13450 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.528085  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.464327 13208 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:15:00.530261  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.530850  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.532071  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.535020 13274 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.536393 13258 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.492563 13043 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.536906 13442 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:00.522998  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 85698.7us
I20260709 12:15:00.544867  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:00.532938 13450 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.524334 13437 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.529098 13425 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.559593 13425 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.561609 13262 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:00.562058 13262 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:00.545078  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 383523us
I20260709 12:15:00.568343  8920 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:00.544615 13169 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:00.580122  8918 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:00.580470  8918 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:00.578013  8924 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:00.584313  8919 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:00.587697  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:00.522958 13443 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.480074 13441 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.594507  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.597566  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.603271  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.603621  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.564400 13352 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:00.605499  8917 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.605696  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.606537 13423 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:00.608528 13423 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:00.610975  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.611472  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.611809 13423 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:00.611968 13439 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.612192  8923 pending_rounds.cc:85] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 4
I20260709 12:15:00.562871 13262 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.612190  8921 raft_consensus.cc:2368] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:00.613382 13262 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:00.615248 13442 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.589570  8918 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.620697 13443 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.612615  8923 pending_rounds.cc:107] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:15:00.621382  8923 raft_consensus.cc:2889] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:00.621721  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd11e77b4be14e658672599b30d51e76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:00.604417  8925 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:00.612607 13439 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:00.623862  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.625376 13043 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.629330  8917 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:00.576453 13464 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:00.589376 13211 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.589676 13426 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.638988  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.637341  9066 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:15:00.647629  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 59996.5us
I20260709 12:15:00.649173 12931 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:00.637068 13464 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.652199 13225 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:00.652660 13225 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:00.653689 13464 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.653452 13225 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.654608 13440 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.655766 13436 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:00.662266  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 257012us
I20260709 12:15:00.605513 13352 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:00.664597  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.667418  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.677765 13443 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.678426 13443 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.680567 13443 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:00.691098  9067 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:00.687342  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:00.654515 13225 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:00.722846  9000 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:00.693053  9069 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:00.722592  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:00.735553  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 72558.4us
I20260709 12:15:00.735683  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:00.736214  8992 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:00.722395  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:00.738258  9071 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:00.740659  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.664670 13352 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:00.741436  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.743119  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.721983  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.743940  8966 leader_election.cc:400] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:00.744320  8966 leader_election.cc:403] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:15:00.745339  9065 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:00.638859 13211 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.751995  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.752760  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:00.744210  9067 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:00.687922 13043 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.793519  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.795320  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.691387 12580 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.665306 13378 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:15:00.822536  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:00.823589  9619 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.740118 13431 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.798317  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:00.805960  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 90024.8us
W20260709 12:15:00.811059  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64749.7us
I20260709 12:15:00.664000 13425 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:00.811177  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49257.6us
I20260709 12:15:00.814668  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:00.741353 13474 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:15:00.831485  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:00.843387  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 126957us
I20260709 12:15:00.833818  9071 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:00.751540 13423 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:00.850179  8992 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:00.850008  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.847532  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:00.857613  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:00.860162  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.864246  8992 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:00.865092  9065 raft_consensus.cc:2368] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:00.866959  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.868358  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.818224 13258 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.870884  8993 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:15:00.852229 13426 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.878449  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:00.859092 13432 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:00.750190 13450 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.864509 13364 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:00.881824  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:00.867259 13443 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.886365  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:00.831553 13043 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.872090 13436 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:00.842438 12580 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.893999  8992 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:00.861241 13391 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:15:00.876657 13423 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.899431  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.900300  9621 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:00.905956  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.906477  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:00.886067 13364 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:00.886046 13433 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:00.906667  8920 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:00.910179 13463 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:00.910689 13428 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:15:00.905640 13436 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.916095  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.936803  8920 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:00.936959  8925 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:00.876879 13440 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:15:00.919272 13466 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.453s	user 0.003s	sys 0.000s
I20260709 12:15:00.920763 13364 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.921128  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:00.921849 13475 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:00.931135  9619 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:00.894753 13432 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:00.945339  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.946382  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.947000  8925 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:00.935001  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.947840  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.901654 13443 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:00.871157 13431 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:00.888228 13426 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:00.944882 13451 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.695s	user 0.004s	sys 0.001s
I20260709 12:15:00.932926 13472 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:00.955070  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.908092 13423 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.960074  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.943568 13463 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:00.961555  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:00.963209  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 53774.8us
I20260709 12:15:00.964483  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:00.982242  8920 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:00.982918  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 897) took 1494 ms. Trace:
I20260709 12:15:00.983505  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:00.984485  8920 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:00.984983  8925 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:00.986977 13211 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.988129 13455 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:00.983484  9070 rpcz_store.cc:276] 0709 12:14:59.468328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.469433 (+  1105us) service_pool.cc:224] Handling call
0709 12:14:59.469763 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:59.470169 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:59.470199 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:59.470732 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:14:59.702749 (+232017us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:59.782296 (+ 79547us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.876272 (+ 93976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.876476 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:00.669157 (+792681us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800413620. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:00.953037 (+283880us) raft_consensus.cc:1685] finished
0709 12:15:00.962696 (+  9659us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:00.962882 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16507,"prepare.queue_time_us":73317,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":110696,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":27423,"spinlock_wait_cycles":2623744,"thread_start_us":307883,"threads_started":2,"wal-append.queue_time_us":438218}
I20260709 12:15:00.990883  8920 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.000733  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.952890 13475 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.007779 13475 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.008417 13360 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:15:01.008977 13482 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:15:00.846668 13439 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:00.944067 13436 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:01.012794  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.026759  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.029058  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:01.089789  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 144750us
W20260709 12:15:01.026227 13451 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:15:01.099866  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.099958  8920 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:01.102495  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:00.951980 13432 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.103931  8925 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:01.104262  9071 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:01.104848  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.110062  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.110807  8920 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:01.114194  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2491) took 1093 ms. Trace:
I20260709 12:15:01.114610  9068 rpcz_store.cc:276] 0709 12:15:00.021298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.021448 (+   150us) service_pool.cc:224] Handling call
0709 12:15:00.034845 (+ 13397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:00.080163 (+ 45318us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:00.080195 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:00.128533 (+ 48338us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b2c00078738. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:00.144587 (+ 16054us) log.cc:844] Serialized 26 byte log entry
0709 12:15:00.267803 (+123216us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:00.267858 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.267943 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:00.869043 (+601100us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:01.113968 (+244925us) raft_consensus.cc:1685] finished
0709 12:15:01.113998 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:01.114132 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33245,"raft.queue_time_us":44778,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":93,"spinlock_wait_cycles":38054656,"thread_start_us":39456,"threads_started":1,"wal-append.queue_time_us":189741}
I20260709 12:15:01.119849  8925 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:01.092140 13440 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.101195 13425 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:00.961912 13472 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.090216 13494 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:15:01.133927  8920 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:01.137465  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.197321  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.208882  9618 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:01.198552  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:01.228786  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 264369us
I20260709 12:15:01.282167  8925 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:01.283000  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.283186  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.239248  8918 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:01.245774  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.286386 13227 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.286918 13227 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.289171 13227 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.267778  9622 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [8.8-11.10]
I20260709 12:15:01.267791  9621 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:15:01.272495  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.273038  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.273334  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.274724  8991 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:01.271340  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 314200us
I20260709 12:15:01.207792 13426 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.296034  9623 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:01.296108  8997 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:15:01.270167 13274 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.296551  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.297446  9616 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:01.297199 13274 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.297772  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.298578  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:01.298792  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:01.299528 13262 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.008s
I20260709 12:15:01.180928 13423 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.158329 13043 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.146441 12580 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.231917 13374 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:01.237787  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.301219 13374 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:01.301676  8917 raft_consensus.cc:2376] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16. Re-sending same reply.
I20260709 12:15:01.302518  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.302234 13374 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.303120  8917 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:01.273551  9617 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:01.303550 13374 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:01.284531  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.264273 13258 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:01.299301  9624 raft_consensus.cc:2368] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:01.305454  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.305918  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.306717  9000 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:01.240445 13432 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.295363  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.312830  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.148100 13450 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.153271 13483 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.317022  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.317899  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.320446  8925 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.320638  9000 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:01.318051  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.171523 13436 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.317250  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.153672 13492 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.321064  8918 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:01.138916 13440 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.321992  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.225555 13431 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.241645 13472 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.329051  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.332191  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.317725 13423 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.319481 13043 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.335747 13459 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:15:01.336205  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.144460 13463 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.142129 13443 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.342177  8998 raft_consensus.cc:2410] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:15:01.319281 13497 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.333778 13436 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.336581  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.351603  8992 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:01.353073  9587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.008s	sys 0.008s
W20260709 12:15:01.353533  9587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.008s
W20260709 12:15:01.353875  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 630197us
W20260709 12:15:01.329586 13290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:15:01.336259 13507 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:01.342010 13500 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.361169  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:01.364035  8925 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:01.381196  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:01.370424 13462 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.885s	user 0.003s	sys 0.000s
I20260709 12:15:01.386910  8888 leader_election.cc:400] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:01.387993  8888 leader_election.cc:403] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:01.389449 13351 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:01.390401 13440 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.380095 13211 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:15:01.391494 13211 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:01.391582 13503 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.397519  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.374378 13497 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.374579 13507 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:01.442364  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:01.443909  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 131151us
I20260709 12:15:01.445472  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.391587 13227 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:01.325490 13483 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.376077 13290 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:15:01.453174  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.386931 13262 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:15:01.441847 13211 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:01.380182 13026 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:15:01.457191  8964 leader_election.cc:400] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:01.444155 13443 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:01.470331  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.470887 13514 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:01.471678 13456 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:01.416596 13475 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:15:01.467651 13352 consensus_meta.cc:287] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 12:15:01.499799  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.468669 13306 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:01.467931 13425 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.392169 13503 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.379263 13500 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.496717 13514 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.512897 13511 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:01.513646 13507 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.514806 13514 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.516978 13500 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.520642  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.518349 13425 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.523558  8995 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:01.523986 13510 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:15:01.524791  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.525456 13425 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.529466 13483 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:01.497648 13456 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:01.532080  9590 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.1:41023 timed out after 1.734s (SENT) [suppressed 23 similar messages]
I20260709 12:15:01.532013 13456 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.533386 13456 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:01.534781 13026 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.535300 13026 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.502274 13352 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.536883 13233 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.537431 13026 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.527134 13448 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:01.537962 13352 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:01.538270 13448 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.538451 13503 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:01.539207 13448 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.537446 13233 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.541504 13448 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.542572 13436 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.503019 13306 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.521454  8993 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:15:01.561478  9617 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:01.562862  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.543045 13233 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:01.567912 13306 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.569888 13306 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.486104 13443 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.573505 13443 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:01.544719 13364 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.004s
I20260709 12:15:01.580080  9000 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:01.582121  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.610179  9621 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:01.611627  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.613637  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.615567  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.618324  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.620601  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.621325  8995 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:01.622654  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:01.623816  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 91772us
I20260709 12:15:01.627646  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.628474  9071 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:01.629462  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.631177  9068 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:15:01.631834  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.637779  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:01.638906  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.640004  8993 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:01.644913  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.614068 13443 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.643039  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.647929  9065 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:01.631018 13436 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:01.659922 13522 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:01.661158  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.658735  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:01.594897 13364 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.665555  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.666231  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.667058  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.657322 13507 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.629271 12580 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:15:01.700403  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:01.700946  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:01.706776  9066 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:01.705734 13043 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.709834  8998 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:01.715451  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 84236.2us
I20260709 12:15:01.716141  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:01.663738 13211 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:15:01.716426  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.717958  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:01.704944 13456 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:01.701532 13436 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:01.719379  9617 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:01.714161 13435 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.709396 13514 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.727341  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.729177  9621 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:01.729990  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.721987 13456 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.736907 13514 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:01.742540  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.721184 13211 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:01.746752 13456 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:01.728765 13435 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.752311  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.752429 13492 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.756503 13435 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:01.756618 13520 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:15:01.756822 13492 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.757290  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.728461 12580 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:15:01.755512 13140 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:01.760426 13503 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.760505  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 699) took 1045 ms. Trace:
I20260709 12:15:01.760433 13233 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.716850 13043 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.761031  9615 rpcz_store.cc:276] 0709 12:15:00.714730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.714892 (+   162us) service_pool.cc:224] Handling call
0709 12:15:00.744530 (+ 29638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:01.118723 (+374193us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:01.321484 (+202761us) log.cc:844] Serialized 14 byte log entry
0709 12:15:01.492414 (+170930us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:01.503401 (+ 10987us) log.cc:844] Serialized 26 byte log entry
0709 12:15:01.506381 (+  2980us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:01.506430 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.506503 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:01.760285 (+253782us) raft_consensus.cc:1685] finished
0709 12:15:01.760305 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:01.760442 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269473,"prepare.run_cpu_time_us":10189,"prepare.run_wall_time_us":31715,"raft.queue_time_us":122970,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":11397,"thread_start_us":433141,"threads_started":3,"wal-append.queue_time_us":248208}
I20260709 12:15:01.763646 13492 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.766767 13435 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.781260 13364 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.722327 13500 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:15:01.764389 13352 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:01.788853 13535 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.763763 13043 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.724885 13425 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:15:01.799849  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69979.2us
I20260709 12:15:01.783320 13211 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.782831 13373 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:15:01.790544 13026 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:15:01.812047  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.813267  8923 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:01.814339  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.818548  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:01.815100  8923 raft_consensus.cc:2376] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10. Re-sending same reply.
I20260709 12:15:01.796406 13352 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:01.835382  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:01.834326  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.836681  9066 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:01.839049 13026 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.839389  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.841048  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.842145  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.842146  8923 raft_consensus.cc:2410] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:15:01.844002  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.844394 13026 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:01.845355  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.845993  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:01.846534  9619 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.848042  8923 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:01.849476 13026 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:01.849861  8923 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:15:01.850257 13514 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.850762 13211 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:01.851195 13211 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.852085 13211 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:01.850795  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:01.853950  9067 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:01.855593 13500 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.827705 13436 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.856164 13500 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.857573 13510 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.857702 13211 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:01.858286 13500 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.858111 13510 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.850292  8923 pending_rounds.cc:85] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 10
I20260709 12:15:01.859543  8923 pending_rounds.cc:107] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:01.859781  8923 raft_consensus.cc:2889] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:01.859838  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.849764 13464 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:01.864691  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.865397 13510 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.861816 13456 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.828550 13481 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:15:01.873145  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:01.914530  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 54785.5us
I20260709 12:15:01.823781 12931 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.875630  8923 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:01.911774  9619 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:01.860643 13535 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:01.876423 13425 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:01.879904  9071 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:01.882467 13227 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:01.894821  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:01.912499  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47898.5us
I20260709 12:15:01.912736  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.917713  8924 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:15:01.917877  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.924851  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.926752  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.933765  9621 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:01.934773  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.935132  9621 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:01.929867  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.937363 13425 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:01.937471  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:01.937881 13425 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:01.937737  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.939214  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:01.938992 13425 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:01.939730 13506 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.785s	user 0.000s	sys 0.003s
I20260709 12:15:01.940407 13425 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.941455  9617 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:01.942981  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 905) took 1640 ms. Trace:
I20260709 12:15:01.944193 13456 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.943423  9073 rpcz_store.cc:276] 0709 12:15:00.302925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.303058 (+   133us) service_pool.cc:224] Handling call
0709 12:15:00.311596 (+  8538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:00.485300 (+173704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:00.485346 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:00.533333 (+ 47987us) log.cc:844] Serialized 26 byte log entry
0709 12:15:00.683255 (+149922us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:00.683297 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.942580 (+1259283us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003ee9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:01.942635 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:01.942683 (+    48us) raft_consensus.cc:1685] finished
0709 12:15:01.942696 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:01.942923 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12,"raft.queue_time_us":119,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":27206,"spinlock_wait_cycles":388617472,"thread_start_us":107016,"threads_started":1,"wal-append.queue_time_us":301173}
I20260709 12:15:01.918394 13537 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.945564  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.946221 13535 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.946245  8920 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:01.949899  9071 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:15:01.965476  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.929910 13447 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.935994 12931 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:01.913786 13464 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.965535  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.967512  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.929553 13227 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:01.974651  8923 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:01.978502  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:01.968487 13541 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:15:01.984786  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.986284  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:01.988097  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:01.966709 13270 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.971812 13305 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.970909 13508 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:01.969591 12931 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:01.996428  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:01.991560 13222 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:02.013530 13233 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:02.019486 13448 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.020053 13448 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.022266 13448 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.018713 13445 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:02.023947 13445 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:02.025578  9070 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:02.026225  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:02.027123 13445 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:02.027503 13445 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.027877 13445 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:01.771437  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:02.032469 13498 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:02.032912 13498 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:02.033124  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2386) took 1441 ms. Trace:
I20260709 12:15:02.033790 13498 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.038678 13435 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:02.041393 13530 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:15:02.018126 13491 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:01.995357 13517 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.587s	user 0.004s	sys 0.002s
I20260709 12:15:02.051436  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.035027 13498 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.033529  8916 rpcz_store.cc:276] 0709 12:15:00.591278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.591403 (+   125us) service_pool.cc:224] Handling call
0709 12:15:00.594477 (+  3074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:00.594815 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:00.594840 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:01.779847 (+1185007us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:01.780403 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:15:01.965903 (+185500us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:01.965941 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.966010 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.032782 (+ 66772us) raft_consensus.cc:1685] finished
0709 12:15:02.032803 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.033039 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1372,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4463,"spinlock_wait_cycles":23076608,"thread_start_us":185064,"threads_started":1,"wal-append.queue_time_us":233204}
I20260709 12:15:02.055377  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:02.058795  8963 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:02.070842  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:02.095196  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:01.991834 13043 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:01.995920 13173 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 12:15:02.104056  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 48764.9us
W20260709 12:15:02.105245  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.107282 13043 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.110167 13043 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.110898 13043 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.111677 13043 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.114249 13043 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.014559 13373 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:15:02.014724 13402 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:15:02.055164 13439 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.104611 13433 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.094295 13510 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:02.094552 13492 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:02.126322  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.104285 13456 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.149576 13456 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.142145 13433 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.151737 13456 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.152690  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.153368  8916 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.104154 12931 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.154580  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.052498 13464 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.101481 13364 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:15:01.995807 13535 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.053119 13491 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.045306 13508 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:02.114959 13043 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:02.154734  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:02.140811 13435 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.050599 13305 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.118839 13443 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:15:02.169272  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:02.168690  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:02.174280  9065 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:02.128203 13439 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.152657 13433 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.182935  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.183666  8916 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.185215  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:02.192960 13500 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.193711 13500 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.196640 13500 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:02.196621  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 101521us
I20260709 12:15:02.201052  8916 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:02.208786  8916 pending_rounds.cc:85] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 9
I20260709 12:15:02.209082  8916 pending_rounds.cc:107] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:02.209314  8916 raft_consensus.cc:2889] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:02.191219  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:02.175089 13456 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:02.176754 13443 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:02.211472  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2390) took 1618 ms. Trace:
I20260709 12:15:02.213902  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.222812  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.225428  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:02.226578  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.227002  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:02.227727  8993 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:02.198328 13433 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:02.197839 13444 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:02.233616 13543 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:15:02.182786 13435 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.234432 13305 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:02.235090 13508 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.236140 13508 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:02.236270 13435 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.237505 13439 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.239073 13043 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.239651 13043 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.240373  8916 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:02.180828 13533 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:02.221630  8924 rpcz_store.cc:276] 0709 12:15:00.592660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.603978 (+ 11318us) service_pool.cc:224] Handling call
0709 12:15:00.613796 (+  9818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:01.936293 (+1322497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.211225 (+274932us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400159d54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:02.211417 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2998003456}
I20260709 12:15:02.227226  9070 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:02.245896  8993 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.247383  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:02.248288  8993 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:02.251474  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.253844  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.254760  8992 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.255757  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1884) took 1711 ms. Trace:
I20260709 12:15:02.254858  8916 raft_consensus.cc:2410] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:02.260007  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.256170  8919 rpcz_store.cc:276] 0709 12:15:00.544031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.544157 (+   126us) service_pool.cc:224] Handling call
0709 12:15:00.551882 (+  7725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:00.584859 (+ 32977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.255525 (+1670666us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54004150d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:02.255699 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74055040}
I20260709 12:15:02.171105 12931 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.241782 13043 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.260787  9070 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:02.264021  9000 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:15:02.266824  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.267104  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:02.269860  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.270574  8993 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:02.270721  9070 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:02.272944  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.263154  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:02.275475  8999 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.182952 13481 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:15:02.278184  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.216044 13456 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.276682  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.222581 13436 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:02.279585  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.259987 13500 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:15:02.282110  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:02.257655 13533 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.297765  8992 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:02.303642 13433 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:02.181571 13352 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.304685 13433 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:02.304754 13352 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.305178 13433 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:02.306085 13433 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.306977 12931 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.295888 13305 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:02.307753 13305 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:02.307919  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.308671 13305 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.309204 13445 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.310567  9615 pending_rounds.cc:85] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 7
I20260709 12:15:02.310900  9615 pending_rounds.cc:107] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:15:02.311154  9615 raft_consensus.cc:2889] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:02.284991  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:02.260319 13439 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:15:02.236311 13491 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.309417  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.260064 13435 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:15:02.313481  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.311854  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.314134  8919 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:02.277370  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.316419  9621 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.288802  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.331071  8999 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:02.316392  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:02.336402  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:02.316025 13433 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.293818 13436 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.338055  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.338546 13436 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.339175  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.340057 13425 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.340473 13425 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.340878 13425 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.343444 13491 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:02.343909 13491 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.344290 13491 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:02.344683  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:02.345376  8992 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.347085  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:02.348070 13546 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:15:02.334619 13445 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.349617  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:02.349951  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.350467 13443 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.350868 13443 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.351280 13443 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.351197  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.354450  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.358068  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:02.351068  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:02.292707 13456 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.366788 13222 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:02.367380 13222 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.370739 13425 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.316794 13533 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.378123  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:02.378607 13425 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.379885 13436 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.380529  9067 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:02.384928  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2388) took 1793 ms. Trace:
I20260709 12:15:02.382081  9071 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:02.385311  8922 rpcz_store.cc:276] 0709 12:15:00.592015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.592165 (+   150us) service_pool.cc:224] Handling call
0709 12:15:00.603322 (+ 11157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:00.667366 (+ 64044us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:01.789474 (+1122108us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b1800022720. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf
0709 12:15:01.789645 (+   171us) log.cc:844] Serialized 14 byte log entry
0709 12:15:01.988377 (+198732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:01.988451 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:01.989043 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.384113 (+395070us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b1800022720. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419
0709 12:15:02.384740 (+   627us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b5400311854. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:02.384778 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.384878 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141285,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":1449,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3625,"spinlock_wait_cycles":154346880,"thread_start_us":375312,"threads_started":2,"wal-append.queue_time_us":203903}
I20260709 12:15:02.383536  9073 raft_consensus.cc:2368] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:15:02.387948  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.335634 13483 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:02.399827  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.428524  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.430563  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:02.396868 13498 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.435220 13498 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.439687 13498 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.441570  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:02.443934  8995 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:02.447358 13290 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:02.447958 13290 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:02.401198 13483 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.449307  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2406) took 1171 ms. Trace:
I20260709 12:15:02.362335 12931 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:15:02.411288 13552 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.457435  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:02.462587  8991 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:02.451165  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:02.464473  8920 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.405001 13233 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:15:02.454874  8918 rpcz_store.cc:276] 0709 12:15:01.277547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.854983 (+577436us) service_pool.cc:224] Handling call
0709 12:15:01.860222 (+  5239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:01.860700 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:02.052216 (+191516us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.199220 (+147004us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.199541 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.448918 (+249377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:02.448979 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:02.449035 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.449120 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.449247 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28154,"prepare.queue_time_us":33398,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":48751,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":29954,"spinlock_wait_cycles":72291712,"thread_start_us":552453,"threads_started":3,"wal-append.queue_time_us":168753}
I20260709 12:15:02.398451 13551 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:15:02.433728 13553 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:02.456251 13483 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.465695 13552 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.488523  8920 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:02.500406  8921 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:02.503933  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:02.508698 13475 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:02.509166 13475 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:02.510020 13475 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.511821 12931 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.512346 12931 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.513274 13227 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.514544 12931 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:02.514765 13227 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.483098 13436 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.476858 13290 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.519819  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:02.482548 13552 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.536932  8991 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.542120  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.543094  8921 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:02.487679 13443 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.503576 13305 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.544237 13475 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.562422  9623 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:02.556211 13373 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.575632  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:02.586365  9623 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:02.586735  9618 raft_consensus.cc:1217] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-11.10]   Dedup: 10.9->[11.10-11.10]
I20260709 12:15:02.587373  9618 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [8.8-11.10]
I20260709 12:15:02.540884 13262 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:15:02.573645 13443 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.567998 13491 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.567606 13305 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.647991 13500 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.651726 13533 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.656141  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.723135 13533 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.732249 13500 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.734346 13491 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.692623 13522 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.735780 13522 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.737829 13522 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:02.737972  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 81914.6us
I20260709 12:15:02.738355 13522 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.738709 13522 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.739070  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:02.740722  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49402.8us
I20260709 12:15:02.741741  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:02.656338  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:02.747323  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:02.658284 13497 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.575018 13274 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:02.687651  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.694000  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.769415  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.696144 13483 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.696595  9068 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:02.702220 13234 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:02.704939  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.706161  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 917) took 1087 ms. Trace:
I20260709 12:15:02.706905  9074 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:15:02.802706  8998 rpcz_store.cc:276] 0709 12:15:01.618398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.619108 (+   710us) service_pool.cc:224] Handling call
0709 12:15:01.619404 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:01.713394 (+ 93990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.705850 (+992456us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b540039bcd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:02.706066 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207570176}
I20260709 12:15:02.734357 13500 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.715253 13552 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.739043 13522 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.755105 13435 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:02.776588  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.778528  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.799746  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:02.696144 13456 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.694494 13236 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:02.752022 13262 consensus_queue.cc:1243] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:15:02.740345  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:02.822849  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 82572.6us
I20260709 12:15:02.820773  8916 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:02.805877 13043 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.801340 13234 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:02.755251 12931 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:15:02.811581 13436 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:02.777729 13274 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.831954  9067 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:02.830293  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.835161  9065 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:02.755451 13497 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.823788 13435 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.832391 13433 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:02.821969 13208 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:15:02.857782  9069 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:02.839730 13537 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:02.861826  9070 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:02.845065 13274 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.828966 13236 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.852315 13435 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:02.833616 13524 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:15:02.851326 13433 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.856115 13352 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.866720 13208 consensus_queue.cc:1243] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:02.836598 13043 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.859922 13443 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.884152 13433 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.884768 13352 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:02.893857 13222 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.002s
I20260709 12:15:02.874886 13306 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:15:02.901729 13352 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:02.893462 13443 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.904845 13552 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.905148 13274 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.906780  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:02.911684 13569 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:15:02.912774 13140 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:02.870399 13537 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.924397 13443 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.924996  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:02.936900  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.908231 13236 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:02.940593  9074 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:02.927702 13562 log.cc:927] Time spent T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:15:02.928583 13305 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:02.876583 13234 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:02.914479 13222 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:02.963469 13537 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.964637 13274 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.976934  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:02.989583  8920 raft_consensus.cc:2368] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:15:02.977362  8921 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:02.980747  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:02.983806 13572 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:02.985545  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.988490  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:02.997545  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.998385  8918 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 7.
I20260709 12:15:02.999460  9000 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:03.012310  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:03.015987  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 185752us
I20260709 12:15:03.017696  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:02.997615  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:02.955147 13456 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.036556  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:03.039734  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.041402  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.042245  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:02.970836 13373 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:03.047564  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.049014  8920 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:03.049233  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.050902  8998 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:03.050730  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:02.958091 13483 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:02.948001 13140 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.053495  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:03.054605  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.054996  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.055589  8996 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:03.110859  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.126890  9615 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:03.125770  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.108590  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.189747  8916 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:02.986104 13234 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.110803  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:03.199755  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:03.200759  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.200678  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:03.204036  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 149121us
I20260709 12:15:03.204517  8992 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.139675  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:03.205106  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.025971 13443 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.206672 13436 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:03.209829 13443 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.210384 13436 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.211158  9617 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:03.213353 13222 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.215787  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:03.223690 13043 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.225984 13445 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.226580 13445 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.227087  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.057226 13236 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:03.025877 13552 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.047750 13305 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:03.138136 13173 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:03.075867 13373 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.107461 13498 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:03.227063 13445 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.132053 13491 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.249678  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.124732 13497 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.268175  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.269098  9069 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:03.123524 13233 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 12:15:03.228111 13402 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:03.239112 13483 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:03.239800 13443 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.298486  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:03.245635 13043 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:03.057657 13444 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 12:15:03.284233  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.288856  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.246107 13305 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.026540 13274 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.132402 13500 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:03.259109 13173 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:03.301515  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:03.310042  8992 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:03.301893  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.254379  9616 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:03.206128  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.303372  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:03.317303  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.296249 13425 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.255390 13552 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.332979  8996 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:03.334147  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.334864  9068 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:03.339341  8996 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:03.317443 13305 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.296844 13497 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:15:03.345861  9000 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:15:03.346235  9000 pending_rounds.cc:85] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 5
I20260709 12:15:03.346438  9000 pending_rounds.cc:107] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:15:03.346664  9000 raft_consensus.cc:2889] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:03.343082  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.298717 13402 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.349413  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.350203  8992 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:03.330209 13306 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:03.352051  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.328994 13580 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:03.345322 13233 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.325559 13043 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:03.363305  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60066.2us
I20260709 12:15:03.365937  8992 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:03.367283  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 93548.2us
I20260709 12:15:03.326336 13500 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.349030 13425 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:15:03.373339  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.370594 13443 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.370419 13447 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.387358 13274 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.393381  8992 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:03.364269 13233 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.376930 13584 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.403018  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.404664  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.365669 13173 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.401752 13584 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.405257 13580 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.389420 13443 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.412287  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:03.392719 13447 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.408619 13589 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:03.412212 13583 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.420959 13425 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:03.413908 13584 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.435743  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.437315  8992 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:03.421991  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:03.426909 13578 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:15:03.424484 13552 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.427268 13425 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:03.451848  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.448654  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.467578  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.467680  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3148) took 1031 ms. Trace:
I20260709 12:15:03.465226  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.473254 13233 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.474186  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.474385 13290 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.475257 13552 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.468369  9072 rpcz_store.cc:276] 0709 12:15:02.436340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.526675 (+ 90335us) service_pool.cc:224] Handling call
0709 12:15:02.527112 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.538278 (+ 11166us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:02.869881 (+331603us) log.cc:844] Serialized 14 byte log entry
0709 12:15:03.302827 (+432946us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.318282 (+ 15455us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.318454 (+   172us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:03.318513 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.318606 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:03.467382 (+148776us) raft_consensus.cc:1685] finished
0709 12:15:03.467414 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:03.467595 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28230,"prepare.queue_time_us":36252,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":36697,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":9452,"thread_start_us":693732,"threads_started":2,"wal-append.queue_time_us":445263}
W20260709 12:15:03.464929 13522 consensus_meta.cc:287] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
I20260709 12:15:03.481952 13483 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:03.481807 13522 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.482622 13483 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.484045 13522 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.484679 13522 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:03.485190 13588 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:15:03.485873  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.487213 13026 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:03.487767 13026 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:03.488303 13433 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:15:03.488729 13433 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.488831 13026 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.490635 13026 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:03.491403 13592 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:15:03.493047  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 742215us
I20260709 12:15:03.493367  8995 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:03.494232  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:15:03.495110 13593 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:15:03.497032  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2520) took 1290 ms. Trace:
I20260709 12:15:03.497462  9065 rpcz_store.cc:276] 0709 12:15:02.206799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.320060 (+113261us) service_pool.cc:224] Handling call
0709 12:15:02.320442 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.841369 (+520927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.496763 (+655394us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400218c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:03.496964 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183118080}
W20260709 12:15:03.498947 13587 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:15:03.485257 13483 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.501693 13579 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:03.502352 13579 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:03.503464 13579 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.510135 13500 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.461421 13589 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.513125 13447 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.513530  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:03.513916 13043 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.514325  9616 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:03.515969 13352 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.002s
I20260709 12:15:03.516415 13352 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.518707 13352 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.440593 13577 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:03.520208  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 932) took 1187 ms. Trace:
I20260709 12:15:03.523722  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.525436  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:03.543754  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.545810  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:03.520622  9067 rpcz_store.cc:276] 0709 12:15:02.333127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.389580 (+ 56453us) service_pool.cc:224] Handling call
0709 12:15:02.390032 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.844281 (+454249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.519965 (+675684us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400369554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:03.520149 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007386496}
I20260709 12:15:03.549924  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.556248  9065 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:15:03.547317  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79739.8us
I20260709 12:15:03.549284  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.560384  8999 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:03.550619  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.551574  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.554716 13306 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.563128 13306 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.464634 13425 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.565544 13306 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.519578 13577 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:03.567476 13433 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.568145 13577 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:03.569871 13435 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.686s	user 0.003s	sys 0.007s
I20260709 12:15:03.570286 13435 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.485128 13522 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.557040 13589 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:03.571884 13589 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.572255 13589 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.555075 13447 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.574190 13447 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.548151 13043 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:03.575860  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.513162 13436 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:15:03.580559  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.581830  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:03.585204 13522 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.586964 13447 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.589285 13435 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.561136  8991 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:03.601943 13475 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:03.468429 13402 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.458505 13497 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 12:15:03.555258 13500 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.608698  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.603451 13464 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.602836 13456 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:03.618527  9072 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:03.618853  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.626147  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:03.605023 13475 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.629060  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.630038  8889 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:03.559402 13583 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:15:03.631429  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:03.596946 13551 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:15:03.633325  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:03.635262  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.636730  9066 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:03.651517 13475 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.651796 13590 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.641952 13448 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:03.666177 13448 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.635165 13435 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:03.666596 13448 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:03.666843 13435 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:03.667353 13435 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.666584  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:03.660534 13305 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.661967  9067 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:03.673138  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:03.675877  8997 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:03.673216  9066 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:03.679229  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 176722us
I20260709 12:15:03.693046  8963 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:03.699895  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 91441.1us
I20260709 12:15:03.700729  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.698302  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:03.740134  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57692.4us
I20260709 12:15:03.707118 13475 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:03.716264 13595 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:15:03.776010  9072 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:03.671819 13373 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:03.781730  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.783631  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:03.784579 13290 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:03.784759 13580 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:03.785094 13290 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:03.785676 13580 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:03.786267 13580 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:03.786033 13290 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.736455 13447 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.716032 13222 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:03.786811 13580 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.795961  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.797098 13537 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.798161 13305 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:03.715934 13551 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:15:03.737715 13589 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:03.825701  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 125046us
I20260709 12:15:03.807657  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:03.693001 13609 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:15:03.770681 13535 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:03.772603 13475 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.841029 13475 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:03.844429  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.847136  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:03.847909  8924 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:03.848069  8923 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:03.852140 13305 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.852849 13305 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:03.853415 13305 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:03.855588 13593 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:15:03.856356 13445 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.003s
I20260709 12:15:03.856837 13445 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.738442 13395 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 12:15:03.828181  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.826824  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:03.839306 13610 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:15:03.840185 13535 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.863106  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.810987 13577 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:03.902040  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 933) took 1530 ms. Trace:
I20260709 12:15:03.908434  9073 rpcz_store.cc:276] 0709 12:15:02.339438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.350807 (+ 11369us) service_pool.cc:224] Handling call
0709 12:15:03.869610 (+1518803us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b540030e654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:03.869764 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56194816}
W20260709 12:15:03.903347  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:03.902720  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76025.7us
I20260709 12:15:03.819382 13608 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.906436  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:03.910902  8920 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:03.911211  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.906695  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:03.907162  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:03.912057  8921 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.914096  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:03.869335  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3150) took 1418 ms. Trace:
I20260709 12:15:03.915534  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:03.915572  9070 rpcz_store.cc:276] 0709 12:15:02.451272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.645426 (+194154us) service_pool.cc:224] Handling call
0709 12:15:02.674882 (+ 29456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.866672 (+191790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.869010 (+1002338us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54003ee4d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:03.869261 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429204352}
I20260709 12:15:03.916332  8924 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.793900 13425 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.921924  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.923573 13607 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.924072 13607 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.924466 13607 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.925274 13165 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:03.868790 13589 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.907745 13026 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.899322 13448 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.928066 13026 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.809113 13447 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:03.817528 13222 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.948436  8992 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.819525 13537 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.906611 13606 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:03.964712  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.979693  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:03.979749  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57925us
I20260709 12:15:03.981980  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.981972  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:03.989878  8994 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.983830  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:03.991634 13448 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:03.986605  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:03.992940 13537 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:03.982806 13617 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:03.992944  9072 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:03.998417  8921 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:04.000214  8994 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:03.983649  8920 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:04.001111  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:04.002358 13373 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.002741 12931 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:04.004197 13026 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.004415 13600 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:04.005245  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.010879  9072 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:04.012699  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:04.014142  9068 raft_consensus.cc:2368] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
W20260709 12:15:04.020653  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 103324us
I20260709 12:15:03.970355 13577 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.918315 13583 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:04.018075 13620 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:04.024770  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.025946  8992 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:04.029685  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:03.922576 13608 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:03.982306 13601 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:04.043489  9066 raft_consensus.cc:2368] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:15:04.011736 13425 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.048283  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:04.061848  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.030669 13612 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:04.045578 12931 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:04.038738 13615 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:04.037242 13208 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:15:03.982111 13606 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.101891 13208 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:04.102300 13208 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:04.053185 13614 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.103076 13606 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.036839 13306 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:15:04.070797 13433 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:04.045032 13233 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 12:15:04.104666  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 99495.5us
W20260709 12:15:04.107336  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 67663.8us
I20260709 12:15:04.071830 13395 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:04.054247 13373 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:15:04.094585 13535 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.104691 13445 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:04.146472  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 89465.3us
I20260709 12:15:04.070678 13026 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:15:04.103408 13614 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.149780  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.038537 13577 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.158288  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:04.156015  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.159803  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.115662 12931 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:04.160436  8918 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:04.164628  8918 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:04.171633  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.173451  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:04.173982  8921 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:04.174754  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:04.177825  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.179860  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.117426 13435 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:04.192929  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.196208  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:04.196879  8921 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:04.167665 13306 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:04.199954  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.201973 13577 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.203384 13222 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.164805 13535 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:04.205535  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.205269 13535 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.206687  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.207481 13447 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.207650 13535 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.103124 13208 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.151638 13395 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.151741 13234 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:15:04.195434 13600 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:15:04.223469  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47491.6us
I20260709 12:15:04.224470  9074 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:04.211953 12931 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.228456  8921 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:04.230337  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.123479 13621 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:15:04.240763  8920 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:04.243831 13614 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:04.244527 13618 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:15:04.245858 13623 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:04.247119 13208 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.248518  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.250655  8916 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:04.251452 13632 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:04.233994  8924 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:04.235872  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.256297 13433 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.256867 13433 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:04.260438 13464 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.633s	user 0.000s	sys 0.010s
I20260709 12:15:04.261394  8925 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:04.261838  8925 pending_rounds.cc:85] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 9
I20260709 12:15:04.262109  8925 pending_rounds.cc:107] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:04.262379  8925 raft_consensus.cc:2889] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:04.262997 13262 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.263540 13262 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:04.268659 13500 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.001s
I20260709 12:15:04.269258 13500 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:04.270202  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 92848.4us
I20260709 12:15:04.271296  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:04.271601  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.319427  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.320355  8991 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:15:04.270272 13624 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:15:04.322027  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51324.9us
I20260709 12:15:04.252781 13600 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:04.325196 13435 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:04.327066  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55474.6us
I20260709 12:15:04.328897 13395 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.348563 13600 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:04.334570 13580 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.502s	user 0.014s	sys 0.000s
I20260709 12:15:04.323908 13608 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.336568  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.353566 13637 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:04.354125  9615 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:15:04.355047 13580 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.337494 13621 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.324091 13606 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:04.339794 13584 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.898s	user 0.012s	sys 0.000s
I20260709 12:15:04.272442 13500 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:04.341323 13433 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.341692 13140 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.342478 13607 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.379678  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.380468  8918 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
W20260709 12:15:04.345737 13475 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.003s
I20260709 12:15:04.346536 13274 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:15:04.368468 13305 consensus_meta.cc:287] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 12:15:04.385974  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.334861  8924 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:04.358285  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.323817 13352 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:04.349268 13573 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.402s	user 0.005s	sys 0.003s
I20260709 12:15:04.383708 13274 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:04.389194 13580 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.389999 13483 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:04.399161 13607 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.399346 13483 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.399919 13483 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:04.386250 13475 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.400391  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:04.402308 13475 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.403131  8919 raft_consensus.cc:2368] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:04.403626 13608 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:04.396334 13305 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.395588 13491 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.404661 13491 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.406097 13305 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.391810  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.360199 13606 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.368311 13621 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.398365  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2527) took 1742 ms. Trace:
I20260709 12:15:04.406970 13491 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.413318  8991 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:15:04.413056  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:04.390443  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:04.414189  9071 rpcz_store.cc:276] 0709 12:15:02.655878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.658742 (+  2864us) service_pool.cc:224] Handling call
0709 12:15:02.659006 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.659552 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:02.659579 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:02.660020 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:15:02.827147 (+167127us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:02.827215 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.827358 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.348613 (+1521255us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:04.397972 (+ 49359us) raft_consensus.cc:1685] finished
0709 12:15:04.398002 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.398277 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":9371008,"thread_start_us":166649,"threads_started":1,"wal-append.queue_time_us":230080}
I20260709 12:15:04.416559  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.418147 13395 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:04.415126 13608 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:04.430876  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.413786 13606 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:04.415419 13607 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.369828 13584 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.413705 13352 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:04.413502 13500 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:15:04.434535  8920 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:04.458814  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.432611 13580 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.463562  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2948) took 1463 ms. Trace:
I20260709 12:15:04.464018  9000 rpcz_store.cc:276] 0709 12:15:03.000579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.002892 (+  2313us) service_pool.cc:224] Handling call
0709 12:15:03.055581 (+ 52689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.351579 (+295998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.463275 (+1111696us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540039b2d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:04.463499 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666783104}
I20260709 12:15:04.444729 13619 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:15:04.468585 13500 consensus_queue.cc:1243] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:04.474771 13589 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:04.475797 13395 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.476405 13395 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.478542 13488 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.479308 13629 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:04.479192 13488 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.479662 13475 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:04.481608 13488 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.482003 13352 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.484704 13580 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.445133 13608 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:04.487999 13608 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.490728 13491 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.491230 13436 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.479910 13402 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:04.491515  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.478693 13395 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.471127 13621 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.501403 13443 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.501698 13436 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.501428  8997 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:04.502377  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.499212 13402 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:04.503549 13616 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
I20260709 12:15:04.502858 13491 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.504103  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.504799 13589 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:04.506734  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.536562  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.508235 13635 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:04.511291 13627 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:04.512827  9000 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:04.542501  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.542733  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.543861  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.516438  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.499473  9071 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:04.516791  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.527387  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.545493  9619 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:04.532742  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.533788  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.530560  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.546708  9623 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:15:04.547945  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.549471  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.446893 13607 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.552528  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.541222  9067 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:04.553450  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.555709  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.564095  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.567566  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:04.568176  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.479933 13629 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.574187  9000 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:04.572041  8997 raft_consensus.cc:1217] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-11.10]   Dedup: 11.10->[]
I20260709 12:15:04.580299  8997 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [8.8-11.10]
I20260709 12:15:04.580996  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.583148  9617 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:04.540463 13589 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.608620 13436 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.609637 13589 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.610390 13584 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.610869  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 743) took 1637 ms. Trace:
I20260709 12:15:04.612115 13491 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.549341 13635 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.614779 13635 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.616863  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.617563  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.617457 13483 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.619594  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.620515  8918 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:04.621802  8994 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:15:04.622771  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.556001 13627 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:04.625124  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88815.4us
I20260709 12:15:04.625649  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.628587  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.630314  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.576040 13211 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:04.587762 13607 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.592419  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46176 (request call id 2) took 3263 ms. Trace:
I20260709 12:15:04.600996 13629 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.606469 13274 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.630640  8991 raft_consensus.cc:2368] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:04.585992  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.631889  8917 rpcz_store.cc:276] 0709 12:15:01.328499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.860941 (+532442us) service_pool.cc:224] Handling call
0709 12:15:04.592149 (+2731208us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400244354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c41735 00007f3985c399fa 00007f398ac014c9 00007f398417dc54 00007f398417dbe2 00007f398417db11 00007f398417da8c 00007f398417cd42 00007f3983f7648c 00007f3983f758c6
0709 12:15:04.592323 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4216134912}
I20260709 12:15:04.633430  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.634392  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:04.634640  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.635852  8923 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:04.611446  8922 rpcz_store.cc:276] 0709 12:15:02.973545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.973708 (+   163us) service_pool.cc:224] Handling call
0709 12:15:02.974102 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.335950 (+361848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.336004 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.341192 (+  5188us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.424859 (+ 83667us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:03.424899 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.610320 (+1185421us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:04.610394 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.610464 (+    70us) raft_consensus.cc:1685] finished
0709 12:15:04.610487 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.610787 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":602,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4317,"spinlock_wait_cycles":831001344,"thread_start_us":67107,"threads_started":1,"wal-append.queue_time_us":217453,"wal-append.run_cpu_time_us":1733,"wal-append.run_wall_time_us":1003108}
I20260709 12:15:04.637099  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.638281  8923 raft_consensus.cc:2410] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:15:04.638672  9590 leader_election.cc:400] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:15:04.639127  9590 leader_election.cc:403] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:15:04.635329 13373 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.641579 13373 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.642216  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:04.644672  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:04.643522  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:15:04.577833 13580 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.651755  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.656800  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:04.687172  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:04.687844  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.688068  9617 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:04.688906  8918 raft_consensus.cc:2368] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
I20260709 12:15:04.636076 13491 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:04.635500 13615 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.642731 13233 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.691231  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.692837  8991 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:04.703785  8997 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:04.691426 13274 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:04.696585  8991 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:04.708056  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.686424 13607 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:04.686201 13140 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:04.690594 13491 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.710886  8991 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:04.704370 13621 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:04.699144 13483 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.717497  8991 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:04.686292 13629 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.715150  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:04.709143 13641 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:15:04.716194  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:04.689685 13445 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:15:04.721853  8918 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:04.710225 13607 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.715255 13491 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.725623  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:04.747961 13211 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:04.704766 13233 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.727016 13165 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:04.720170 13621 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.727659 13173 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:04.751995 13503 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:04.752436 13503 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:04.753213 13621 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.753257 13503 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.754885 13233 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.755442 13503 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.703104 13615 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.757763  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 922) took 1755 ms. Trace:
I20260709 12:15:04.758277 13615 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:04.732034 13208 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:04.737474 13373 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.726436 13607 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.740563 13606 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.742913  8964 leader_election.cc:400] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:04.760120  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.776265  8964 leader_election.cc:403] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:15:04.776583  9000 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:04.723462 13629 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.762477  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.781361  9066 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:15:04.723584  8991 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:04.763911  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.781385  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.782671  9071 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:04.782709  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.692018 13627 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.767392  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.774130  8918 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:04.775148  8888 leader_election.cc:400] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:04.797752  8888 leader_election.cc:403] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:04.777410  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.798456  9000 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:04.799343  8991 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:04.799787  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.800791  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:04.801467  9066 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.758121  8998 rpcz_store.cc:276] 0709 12:15:03.002391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.336552 (+334161us) service_pool.cc:224] Handling call
0709 12:15:03.348244 (+ 11692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.348501 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:03.440603 (+ 92102us) log.cc:844] Serialized 14 byte log entry
0709 12:15:04.757288 (+1316685us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800470320. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287
0709 12:15:04.757388 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:04.757435 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:04.757487 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.757596 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.757704 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11069,"prepare.queue_time_us":159174,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":47980,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":19724928,"thread_start_us":332883,"threads_started":3,"wal-append.queue_time_us":256708}
I20260709 12:15:04.779139  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.762795  9069 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:04.783716  9070 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:04.785634  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:04.795989  9073 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:15:04.806133  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.799185  9040 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.804479  9067 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
W20260709 12:15:04.808878  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 119415us
I20260709 12:15:04.760121 13208 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:04.767985 13609 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:04.808005  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.784150 13637 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:04.812767 13600 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:04.813114 13165 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.820456  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.824529  8991 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:04.838169  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.805859 13483 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.831789  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:04.838061  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.821632  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:04.841497  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.842257  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.778504 13491 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.848153  8998 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:04.851483  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.852295  8998 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:04.855755  8964 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:04.853613  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:04.862381  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:04.863300  8998 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:04.833981 13233 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:04.836705 13608 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.810362 13615 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:15:04.874440  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:04.876130  9074 raft_consensus.cc:2368] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:04.877595 13234 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:04.868373 13580 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:04.868968 13621 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:04.884694 13629 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:04.932233  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 57925.9us
I20260709 12:15:04.934104  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.869099 13208 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.889127 13606 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.891990 13637 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:04.894801  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:04.898380 13648 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:04.898705 13233 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.855157 13483 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.858273 13584 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:04.926321  9066 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:04.935827  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.954777  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:04.926877 13553 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.955973  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.867503 13600 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:04.959343 13627 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:04.958688 13600 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.962941 13483 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.963584 13483 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:04.954917 13584 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.965750 13584 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:04.944274 13290 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.966461 13290 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:04.946647 13352 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:04.968451  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:04.891999 13651 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:04.970394 13651 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.970847 13651 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:04.970914 13140 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10.
I20260709 12:15:04.973858 13233 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.946745 13596 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:04.968753 13290 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:04.975063 13596 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:04.975505 13596 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.925400 13619 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:04.950587  9616 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:04.977419  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 123942us
I20260709 12:15:04.978349  8998 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:04.931734 13621 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.982110  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:04.983456  8998 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 8: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:04.947413 13614 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:04.984113  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 141962us
I20260709 12:15:04.978085  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:04.986598  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.926064 13608 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:04.955778 13208 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.945080 13635 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:15:04.982266 13500 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:04.983353 13621 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.000941  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.002105  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:05.005525  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.007799  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:04.981259 13553 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.000857 13395 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:05.018909 13608 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:04.985543 13619 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:05.024595 13598 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.255s	user 0.000s	sys 0.012s
I20260709 12:15:05.025792 13619 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.009109 13140 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:05.026420 13140 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.002441 13491 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.010692 13615 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:05.011152 13500 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:05.028473  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 949) took 1368 ms. Trace:
I20260709 12:15:05.029433 13500 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.026959 13140 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.032054  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.032790  8997 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:05.033035 13262 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.033722  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:05.034336  8997 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:15:05.035362  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.988209 13614 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.037137 13373 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:05.038416 13614 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.040813 13553 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.042368  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:05.044258 13524 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:05.044715 13524 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.045115 13524 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.003364 13650 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:05.047504 13236 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:05.047830 13650 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:05.047957 13236 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:05.048373 13650 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:05.049104 13236 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.049350 13650 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.051651  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.056291  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.028983  9065 rpcz_store.cc:276] 0709 12:15:03.659869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.667641 (+  7772us) service_pool.cc:224] Handling call
0709 12:15:03.667899 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.344636 (+676737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:04.344669 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:04.344711 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:04.344742 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.028195 (+683453us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001b7454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:05.028250 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.028406 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555869440}
I20260709 12:15:05.017176 13395 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.058367 13395 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:05.050971 13236 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.064404 13584 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.066807 13584 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.071007  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.074574  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.075623  9071 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:05.074649  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.076912  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.077046  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.078996  9065 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:05.046738 13607 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.078718 13614 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:05.051162 13650 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:05.093710  9590 leader_election.cc:400] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
I20260709 12:15:05.093578  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.094115  9590 leader_election.cc:403] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:05.100031  9000 raft_consensus.cc:2368] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:15:05.102411  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.103705  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.104847  9071 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:05.106798  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:05.108857  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.109678  9618 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:05.110473  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.111580  8995 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:05.113802  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.107952 13233 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:05.116477  9618 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:05.117417  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.118221  9618 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:05.109745 13605 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:05.118996  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.119776 13605 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:05.119906  9618 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:05.120539 13165 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:05.121238  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.120767 13605 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.130051  9623 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:15:05.130528  9623 pending_rounds.cc:85] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 8
I20260709 12:15:05.130786  9623 pending_rounds.cc:107] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:15:05.134563  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.139947  8996 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.141366  8996 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:05.141366  8995 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:05.145015 13305 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:05.131670 13608 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:05.131048  9623 raft_consensus.cc:2889] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:05.092633 13614 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.160928  8920 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:05.148207 13608 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.110728 13651 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.169852  9616 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:05.170630 13651 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.174214  9623 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:05.179713  9623 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:05.181488  8995 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 12:15:05.183153  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.196197  9623 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.190016  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:05.153227 13583 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.199005  8997 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:05.203606  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:05.199133  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.204865  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:05.202343  8995 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.205617  8991 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.228161  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:05.214385  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.229434  8917 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:05.232523  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.233534  9623 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:05.210595  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.237663  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.238574  8918 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:05.238710  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.241546  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:05.236294 13619 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:05.197646 13498 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.198197 13600 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.259971 13236 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:05.260248 13621 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.227488 13435 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.227121 13352 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.228718 13491 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.235095 13483 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:05.201750 13596 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.227315 13552 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 12:15:05.321408  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.272689 13236 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.327553  8921 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:05.400054  8996 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:15:05.321314  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 86638.7us
I20260709 12:15:05.399688  8993 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:05.404699  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.407307  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.234069 13583 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:05.414534  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.323228 13483 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.389855 13236 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:05.418700  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.417557  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.421382  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.275480 13664 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.146s
W20260709 12:15:05.404152 13648 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:05.278030 13600 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.285998 13498 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.433099  8997 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:05.433290  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.428292  9070 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.424062 13483 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.301458 13352 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.431869  9073 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.322898 13491 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.316475 13305 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:15:05.285866 13435 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.317919 13524 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.301769 13140 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.439658  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.439743  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.444341  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.443769  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.435189 13608 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.453616  9066 raft_consensus.cc:2368] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:05.513679 13524 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.515404 13491 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.515679 13614 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.517596 13650 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.517592 13621 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.518440 13435 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.518236 13650 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.521699 13483 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.522414  9622 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:05.520285  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.520356  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:05.523814  8924 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.517726 13352 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.519902 13140 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.527767  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.522507 13498 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.540333  8995 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:05.541875  8924 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:05.541889  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 137810us
I20260709 12:15:05.545315  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.550347  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.554431  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:05.556365  8995 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.560690  9067 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:05.565485  9073 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:05.567061  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.530149 13650 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.572599  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.573522  8923 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:05.577631  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.576694 13352 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.580998 13596 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.530058 13395 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.584208  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.587667  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:05.577646  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 343402us
I20260709 12:15:05.562909 13208 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.578255  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.618003  9622 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.618085  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:05.614981  8995 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:05.595383  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 936) took 1410 ms. Trace:
I20260709 12:15:05.602615  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.622723 13270 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:05.622498 13208 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.623154 13270 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:05.624013 13270 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.624779 13208 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.626713 13306 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.627226 13306 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.596082  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.600097  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:05.600802  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.632654  9622 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:05.621191  8994 rpcz_store.cc:276] 0709 12:15:04.184757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.213850 (+ 29093us) service_pool.cc:224] Handling call
0709 12:15:04.621557 (+407707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:04.622236 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.595158 (+972922us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54002f5b50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:05.595320 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936358272}
I20260709 12:15:05.628657 13352 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.639593 13306 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.640340 13352 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.640877 13352 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:05.641443 13435 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:05.641943 13435 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.642357 13435 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:05.643198 13650 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:05.638403 13678 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.644642 13678 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.648053  9619 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:05.649451 13600 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.650297 13678 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.651398  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:05.654317 13488 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:05.630229 13672 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:15:05.634459 13668 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.006s
I20260709 12:15:05.653847  9588 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:05.657130 13233 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.005s
I20260709 12:15:05.660355  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:05.634023 13608 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.662298  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.637292 13208 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:05.637889  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:05.663483 13650 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:05.666364 13613 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.887s	user 0.003s	sys 0.004s
I20260709 12:15:05.666781 13608 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.670239  8995 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:05.661916 13488 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:05.673903  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.663938 13233 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14.
I20260709 12:15:05.675817  9588 leader_election.cc:400] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:05.676537  9588 leader_election.cc:403] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:05.673653 13608 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:05.683323  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.674100 13488 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:15:05.684083  9617 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:05.689697  8993 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:05.683415 13650 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.692984  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:05.695396 13503 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:05.695940 13488 consensus_queue.cc:1243] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:15:05.695443  8992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1631) took 2066 ms (client timeout 2086 ms). Trace:
I20260709 12:15:05.697885  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:05.696599  8992 rpcz_store.cc:269] 0709 12:15:03.621415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.624281 (+  2866us) service_pool.cc:224] Handling call
0709 12:15:05.687200 (+2062919us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000f5fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:05.687390 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722993536}
I20260709 12:15:05.676183 13236 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.715204  9618 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:05.706735 13621 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:05.706923 13537 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:15:05.717149 13621 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.724792 13621 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:05.725243 13402 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.716176 13498 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.734431  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114672us
I20260709 12:15:05.736410  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:05.737236  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 119295us
I20260709 12:15:05.741601  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.742410  9068 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:05.732331 13402 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:05.730104 13498 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.743927 13680 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:15:05.747517 13678 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.747498 13600 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.760249  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.761580  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.762311  9069 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:05.764882 13685 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:05.765600  9067 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:05.765727 13678 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.766631  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:05.766884  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2408) took 4105 ms. Trace:
I20260709 12:15:05.767292  8925 rpcz_store.cc:276] 0709 12:15:01.661324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.873934 (+212610us) service_pool.cc:224] Handling call
0709 12:15:01.874200 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.262854 (+2388654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.766671 (+1503817us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400313154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:05.766811 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5488937344}
I20260709 12:15:05.768026  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.768189 13678 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.768584  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.768796 13600 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.769194  8925 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:05.770047  8924 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:05.770347  8925 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:05.770785 13600 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:05.771562 13682 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:15:05.771910  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2541) took 1010 ms. Trace:
I20260709 12:15:05.772267  9074 rpcz_store.cc:276] 0709 12:15:04.761491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.761621 (+   130us) service_pool.cc:224] Handling call
0709 12:15:05.771739 (+1010118us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54000ad554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:05.771859 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175417600}
W20260709 12:15:05.778149  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 83225.5us
I20260709 12:15:05.779582  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:05.780627  9070 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:05.781452  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:05.760134 13583 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:05.784087  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75877.2us
W20260709 12:15:05.785329  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.787377  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:05.783293  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:05.784878 13551 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:05.785336 13503 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:05.794080  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:05.787473 13680 consensus_queue.cc:1243] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:15:05.795871  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 48267.6us
I20260709 12:15:05.798835  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:05.783588 13208 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:15:05.804637  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.806725  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:05.807392  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.802495  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.812337  8889 leader_election.cc:400] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:15:05.816969  8889 leader_election.cc:403] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:15:05.810640 13688 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:05.794974 13551 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:05.823717  9040 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:05.825655 13503 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:05.832087  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:05.795851 13236 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.839354 13686 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:05.839936 13236 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:05.840116 13685 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:05.840544 13236 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.841040 13236 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.841538 13685 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:05.836228  9624 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:05.815265 13680 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.851395  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57422.8us
I20260709 12:15:05.839376 13551 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.857760 13551 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.858294 13696 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10.
I20260709 12:15:05.859018 13696 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:05.839382 13503 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.859846 13696 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.860302 13696 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.861699 13687 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:05.859483 13609 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:05.867571  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55436.1us
I20260709 12:15:05.839933 13686 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:05.848242 13689 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.848106 13688 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:05.850513 13693 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:05.893088  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:05.893381  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45945.8us
I20260709 12:15:05.875100 13589 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.896132  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:05.898283  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.898903  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.898965  8920 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:05.899696  8925 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:05.900213  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.900506  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:05.900687  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:05.902069  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:05.902984  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:05.882120 13686 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:05.904316  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:05.865435 13680 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.919114  9623 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:05.872277 13609 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.909068 13693 raft_consensus.cc:2764] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:05.933665 13702 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:05.928627  9040 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:05.901752 13498 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:05.937717 13701 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.869364 13687 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:05.941545  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.903445 13699 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:05.950469 13704 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:05.952106 13524 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:05.919803 13688 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:05.904734 13696 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:05.918691 13435 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:05.968923  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 1920) took 2104 ms (client timeout 1530 ms). Trace:
I20260709 12:15:05.933336 13306 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:06.018443  8919 rpcz_store.cc:269] 0709 12:15:03.859352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.859486 (+   134us) service_pool.cc:224] Handling call
0709 12:15:05.955270 (+2095784us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540008b1d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:05.963914 (+  8644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128730368}
I20260709 12:15:05.902760 13589 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:05.981621  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96225.7us
I20260709 12:15:06.020193  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:05.891407 13689 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:05.978684 13704 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.971042 13699 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:06.015594 13708 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:05.980711 13524 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.978638 13614 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.030280 13696 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:15:06.036168 13609 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.036386 13687 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.027067 13704 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.037832 13686 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.038707 13689 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.040668 13614 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.045488  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.050194 13686 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:06.054047  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.055692 13704 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.055749 13699 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.057386 13699 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.030514 13524 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:06.059926  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:15:06.064373 13704 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:06.067173 13435 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.069001  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.069590  8921 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.078948 13678 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:06.079685 13678 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:06.080832 13678 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.082473 13678 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.084259  8919 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:06.087604  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 955) took 1092 ms. Trace:
I20260709 12:15:06.087988  8997 rpcz_store.cc:276] 0709 12:15:04.995745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.208138 (+212393us) service_pool.cc:224] Handling call
0709 12:15:05.208405 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.433512 (+225107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.087318 (+653806us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54000f50d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:06.087548 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516321536}
I20260709 12:15:06.088984 13608 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.089577 13608 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.084297  8921 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:06.092170 13608 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.092034  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.093217  8921 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.095930 13590 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:06.096339 13590 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:06.096464 13608 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:06.097071 13608 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.097111 13590 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.098157 13590 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.099509 13608 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:06.103572 13425 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:15:06.109084  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.110325  9040 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.112586 13436 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:06.113050 13619 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:06.113206 13436 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:06.113737 13619 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:06.113857 13395 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:06.112673  8922 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:06.114192 13436 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.116746 13270 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.118340  8925 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
W20260709 12:15:06.128230  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 225271us
I20260709 12:15:06.130883  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:06.140650  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 113076us
I20260709 12:15:06.142024  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:06.145994  8921 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:06.135430  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:06.148861  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:06.149009  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:06.148109  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.027621 13306 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.168501  9621 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:06.114722 13619 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.150542 13696 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:06.150545 13689 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.144127 13537 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.157729 13686 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:06.184963  9070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:06.153381 13600 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:15:06.192385  9070 raft_consensus.cc:606] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:06.195082  9070 raft_consensus.cc:614] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:06.193985  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:06.199571  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.188874 13690 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.177476 13712 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.153837 13693 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:06.226745  8918 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
W20260709 12:15:06.228804 13621 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:15:06.229264 13621 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.231643 13680 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:06.238135  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:06.243005  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.244652  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.245473  8920 raft_consensus.cc:2368] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:06.246340  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.269158  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.269572  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:06.269972  8921 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:06.270314  9622 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:06.271135  8964 leader_election.cc:400] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:06.271879  8964 leader_election.cc:403] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:06.271898  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:06.273339  9074 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:06.274224  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 731) took 1161 ms. Trace:
I20260709 12:15:06.274722  9618 rpcz_store.cc:276] 0709 12:15:05.102469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.120843 (+ 18374us) service_pool.cc:224] Handling call
0709 12:15:06.263730 (+1142887us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540069f354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:06.263917 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292636928}
I20260709 12:15:06.283838  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.285246  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.286396  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.268904 13621 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.272228 13524 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.271771 13620 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.292747 13620 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.293493 13524 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.294771 13620 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.301659  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:06.302312 13650 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.001s
I20260709 12:15:06.302448  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:06.302747 13650 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:06.302831  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:06.303706 13589 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.303956  9066 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:06.304371 13456 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:06.304726  9068 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:06.304889 13456 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.307675  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:06.309608  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:06.307690  8920 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:15:06.310201  8997 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.310736  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.226644 13236 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.313609  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:06.302913  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:06.314278  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 66304.1us
I20260709 12:15:06.314347  9073 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.328512  8997 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:06.330207  9037 leader_election.cc:400] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:15:06.330586  9037 leader_election.cc:403] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:06.330678  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.331337  8993 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:15:06.336045  9619 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:06.307089 13456 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.338070  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.278636 13686 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:06.282850 13425 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:06.342607  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.341828  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:06.344405  8997 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:06.344527  9618 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.329919 13678 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:06.352878 13686 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.342612  8993 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:06.360082 13605 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:06.360520 13605 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:06.361289 13605 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.360126  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.362330 13605 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.362696  8992 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:06.330497 13537 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:06.364332 13537 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.364691 13537 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.364754  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:06.365417  9074 raft_consensus.cc:606] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:06.365767  9074 raft_consensus.cc:614] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:06.366699  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.369719  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:06.370596  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.376142  9618 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:06.381728  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.388188  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.404117  8992 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:06.362227 13701 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.396963  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.402493  8919 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:06.411039  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.414052  8919 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:06.420778  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.393813 13664 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.394068 13425 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:06.424480  9037 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:06.424928  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46997.6us
I20260709 12:15:06.425812  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.381209 13678 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:06.430276  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.429551  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.435411  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.436187  9074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:06.436941  9074 raft_consensus.cc:606] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:06.437350  9074 raft_consensus.cc:614] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:06.440251  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:06.441207  8993 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:06.442793  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.443465  8918 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:15:06.443849  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.444095  8997 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:15:06.450276  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 424443us
I20260709 12:15:06.429364 13704 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:06.462296  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.439155 13620 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.431809 13715 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:15:06.460363  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:06.465065  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.468320  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:06.469002  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:06.471961  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:06.472416  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.473448  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.473824  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:06.475162  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:06.476876  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.441013 12931 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:06.477854  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:06.450277 13717 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.478179  8919 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:06.480767  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.493242  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.493499  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.427524 13491 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:15:06.458716 13664 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.439340 13589 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.493809  8919 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:06.494421  8923 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:06.482780  8993 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:15:06.508002  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.491849  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:06.512743  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:06.435962 13425 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.508399  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:06.513348  8923 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.508745  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.512681  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.515072  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.515828  8919 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:06.516908  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:06.492173 13551 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.524842  8919 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:06.480896 13395 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.475610 13609 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.528757  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:06.543330  9620 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:06.535504  8916 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:06.538097  8923 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:06.541622  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:06.550154  8997 raft_consensus.cc:2376] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11. Re-sending same reply.
I20260709 12:15:06.463428 13620 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.552937  9620 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:06.510278 13524 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:06.509059 13664 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.560863  8917 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:06.511863 12931 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:06.483310 13608 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:15:06.578861  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:06.575595  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:06.576879  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:06.562736  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:06.646476  9620 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.557372 13524 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:06.631317  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.509886 13680 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:15:06.552223 13701 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:06.551774 13652 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:06.554612 13236 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.510226 13717 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.677378  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:06.532990 13551 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.579865  9624 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:06.622470 13435 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:15:06.581259 13664 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.647277  9066 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.529718 13589 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.653101  9069 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:06.633244 13043 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.552186 13395 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.555012 13609 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.638931 13704 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.528960 13678 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.702548  9616 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:06.627982  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49196.6us
I20260709 12:15:06.706352  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:06.706619 12931 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:06.708393 13720 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:15:06.709129 13721 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:15:06.715827 13718 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:15:06.717856  9073 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:06.721818 13620 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.652181 13600 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.723030 13425 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:06.652042 13524 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:06.678738 13701 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:06.678602 13652 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:06.730906 13729 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:15:06.676932 13723 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:15:06.650430 13443 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:06.732918 13689 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
W20260709 12:15:06.675283 13590 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.001s
I20260709 12:15:06.742105  9620 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
W20260709 12:15:06.746178  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 272776us
I20260709 12:15:06.814167  8966 leader_election.cc:400] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:06.814512  8966 leader_election.cc:403] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:06.815548  8966 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:06.744943  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 271164us
I20260709 12:15:06.771008  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:06.816414  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:06.816583  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45645.6us
I20260709 12:15:06.817485  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.778546  9066 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:06.768132 13583 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.746191 13043 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.788142  8917 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:06.818709  8992 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:06.821136  8963 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:06.781479 13708 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12.
I20260709 12:15:06.825369  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.827448  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:06.775738 13537 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:06.805095  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 250477us
I20260709 12:15:06.818106 13689 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:06.848038  8924 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:06.790127 13600 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.848403  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:06.828140 13605 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.828320 13305 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.858572  8917 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:06.855453  8924 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:06.865926  8919 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 12:15:06.822048 13043 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.824290 13686 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:06.812805 13425 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:15:06.812806 13443 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:06.844194 13590 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:06.843951 13608 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.823751 13731 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
W20260709 12:15:06.880128 13727 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:15:06.880911 13730 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:15:06.881731 13733 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:15:06.882508 13725 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:15:06.846314 13373 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.836356 13435 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:06.883527 13717 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:06.864584 13605 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:06.885138 13583 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.888023 13688 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.849858 13491 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.892925 13732 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:07.122633 13435 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.895973 13590 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.123461 13650 raft_consensus.cc:2764] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:15:06.892483 13608 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.094568 13537 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.096215 13443 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.100649 13600 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.101759 13589 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.102324 13524 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.103266 13652 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.102999 13043 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.103832 13551 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:07.106931  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 258603us
I20260709 12:15:07.163570 13608 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.865532 13305 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:06.870740 13680 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.252s
W20260709 12:15:07.047643  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.890275  8922 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:15:07.124934 13605 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.245577 13689 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.246124 13689 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.253278 13043 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.241043 13614 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.255916 13605 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:07.257826  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd11e77b4be14e658672599b30d51e76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:07.258183  8921 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:07.159206  9588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.013s
I20260709 12:15:07.123669 13236 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.259476  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2436) took 1063 ms. Trace:
I20260709 12:15:07.259137 13236 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.093364  8820 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:07.261138  8923 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:15:07.261389  9588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.013s
I20260709 12:15:07.119468 13620 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.121266 13731 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:07.139953 13491 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:07.161631 13435 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:07.202548  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 387059us
W20260709 12:15:07.242671  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.289641  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:07.262008  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 684652us
I20260709 12:15:07.260020  8921 rpcz_store.cc:276] 0709 12:15:06.195995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.286144 (+ 90149us) service_pool.cc:224] Handling call
0709 12:15:07.259188 (+973044us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540008b1d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.259393 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233017728}
I20260709 12:15:07.174363 13395 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.274370  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.141948 13688 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.279280  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.297253  8924 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:07.297878  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.279969  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.292963  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.243677 13305 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:07.303426 13589 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:07.298854 13731 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.304107 13425 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:07.304512 13236 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.305238  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.161914 13732 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.298755  8916 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:07.300336  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.312847  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.313232  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.271951 13614 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.289382 13491 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.291397 13696 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:07.316082  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.319525  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:07.319986  9616 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:07.243316 13652 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:15:07.300587 13043 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.317274  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:07.323381  9621 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.308163 13589 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.318089  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:07.328712  8916 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:07.329447  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.324445  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:07.331125  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.334054  9620 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:07.313942 13443 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.289573 13620 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.316908 13583 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:07.331292  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:07.322234 13488 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:07.344416  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.345096  8916 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:07.320396 13736 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:07.346807  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 477063us
I20260709 12:15:07.345250  8966 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.287670 13605 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:07.347427  8920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.005s	sys 0.019s
I20260709 12:15:07.335105 13589 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.328568 13425 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:07.339217 13637 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:07.355551  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:07.357044  8920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.006s	sys 0.019s
I20260709 12:15:07.372310  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:07.372939  8997 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:07.361132  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47977.1us
I20260709 12:15:07.340456 13607 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.320854 13614 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.369941  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:07.383781  9073 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.323534 13696 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.375161  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.347174 13443 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:07.351680 13686 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:07.388967  8916 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:07.390753  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.393591  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.355957 13676 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.367641 13425 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.371035 13637 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.396525  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.356599 13488 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:07.397881  9621 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:07.347751 13717 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:15:07.378152 13043 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.388222 13443 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.427404  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:07.428049  8993 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.394871 13701 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.400557 13607 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:07.397535 12931 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:07.407754 13590 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.407955 13425 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.424803 13443 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.423609 13758 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:07.435375 13680 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:07.500105 13731 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.501706 13696 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:07.443735 13744 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:15:07.446259 13620 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.447256 13488 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:07.450876  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 95645us
I20260709 12:15:07.510396  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:07.511968  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.383066 13736 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:15:07.398260 13583 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:07.518983  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.422992 13637 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.530360  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.531963  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.533808  8996 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:07.537266  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.538736  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.543668  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.544842  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.514009 13688 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.547696 13732 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.494165 12931 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.551772  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 1987) took 1317 ms. Trace:
I20260709 12:15:07.491400  8993 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:07.430850  8997 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:07.396031  9073 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:07.431567 13717 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:07.592126 13717 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:07.530717 13551 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:07.592555  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.592955 13551 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:07.593413 13551 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.593061 13717 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.594129  9073 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:07.594388 13717 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.497210 13758 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:07.595743  9073 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:07.596102 13758 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.597383  8921 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:07.600536 13754 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:07.602710 12931 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.603905 13756 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.599411  8920 rpcz_store.cc:276] 0709 12:15:06.234411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.677069 (+442658us) service_pool.cc:224] Handling call
0709 12:15:06.677349 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:06.677784 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:06.677821 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:06.678378 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.373148 (+694770us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:07.373340 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.373519 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:07.551547 (+178028us) raft_consensus.cc:1685] finished
0709 12:15:07.551566 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:07.551718 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1361,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":31712,"thread_start_us":694228,"threads_started":1,"wal-append.queue_time_us":835179}
I20260709 12:15:07.504254  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.505125  8998 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:07.454830 13524 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.507681  8916 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:07.612294  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.507879  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:07.403218 13676 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.613277  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.508946  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.613970  9074 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:07.512761  9068 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:07.615402  9067 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:07.464265 13607 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:07.616137 13607 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.514392  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:07.552671 13696 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.552691 13583 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.555697  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.624740  8996 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 8.
I20260709 12:15:07.556522  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:07.624822  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 248158us
I20260709 12:15:07.494630 13686 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.630436 13305 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.489933 13435 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.604518 13756 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.614090  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:07.633903 13651 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:07.634332 13651 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.634678 13651 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.634917  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 978) took 1163 ms. Trace:
I20260709 12:15:07.635448  9069 rpcz_store.cc:276] 0709 12:15:06.471725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.472278 (+   553us) service_pool.cc:224] Handling call
0709 12:15:06.472548 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:06.741154 (+268606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.634705 (+893551us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:07.634861 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414703360}
I20260709 12:15:07.636981  9066 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:07.625363  8995 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:07.632826 13491 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:07.557200  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.599s (SENT) [suppressed 8 similar messages]
W20260709 12:15:07.640448  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 83294.5us
I20260709 12:15:07.641042 13443 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.641384 13491 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.642256 12931 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.642360  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.642762 12931 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.643627  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.644982 12931 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:07.623170  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 108827us
I20260709 12:15:07.615103 13676 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:07.650373  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73169.2us
I20260709 12:15:07.632820 13435 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:07.627537  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.634852 13756 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.619428 13680 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.654412  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:07.628271  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.650396  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:07.662568  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:07.663375  9000 raft_consensus.cc:2393] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:07.664074  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.667477  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.668236  9000 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:07.674006  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.678177  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:07.692811  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.697331  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:07.702953  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:07.703797  9066 raft_consensus.cc:606] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:07.704252  9066 raft_consensus.cc:614] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:07.708141  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:07.660918 13736 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:07.658188 13443 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.664520 13732 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:07.684165 13664 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.001s
I20260709 12:15:07.846104  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.847090  8925 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:07.715113  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.717159  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2448) took 1500 ms. Trace:
I20260709 12:15:07.718482 13589 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:07.719448  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48671.5us
I20260709 12:15:07.851480  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.721364  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 977) took 1249 ms. Trace:
I20260709 12:15:07.853166  9070 rpcz_store.cc:276] 0709 12:15:06.471457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.472144 (+   687us) service_pool.cc:224] Handling call
0709 12:15:07.721142 (+1248998us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002d46d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.721304 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963146112}
I20260709 12:15:07.725912  8820 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:07.684381 13596 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.745177  9069 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:07.649631 13696 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.852298  9615 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:07.693444 13701 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.714557 13620 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:07.878940  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:07.730970  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2432) took 1536 ms (client timeout 1613 ms). Trace:
W20260709 12:15:07.880450  8922 rpcz_store.cc:269] 0709 12:15:06.194683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.195347 (+   664us) service_pool.cc:224] Handling call
0709 12:15:07.730741 (+1535394us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000c9ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.730894 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500487552}
I20260709 12:15:07.664830 13680 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.752312  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2434) took 1557 ms. Trace:
I20260709 12:15:07.884333  8919 rpcz_store.cc:276] 0709 12:15:06.195452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.526691 (+331239us) service_pool.cc:224] Handling call
0709 12:15:06.527090 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:06.866392 (+339302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.751991 (+885599us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001e55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:07.752237 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778675456}
I20260709 12:15:07.759734  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.764830  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.885663  9067 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:07.888082  9067 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:07.766855 13609 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:07.890745  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.891748  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:07.894222  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.776686 13444 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.769503  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.771314 13738 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:07.897833  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.904531  8921 raft_consensus.cc:2410] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:15:07.905721  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.855305 13731 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:07.772548  9074 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:07.779659  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82358.4us
I20260709 12:15:07.781931  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:07.908241  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 126442us
I20260709 12:15:07.785807  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.787292 13650 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:07.794014 13614 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.859323 13736 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:07.804175  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1664) took 1381 ms. Trace:
I20260709 12:15:07.809717  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1652) took 2662 ms. Trace:
I20260709 12:15:07.811003  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 987) took 1255 ms. Trace:
I20260709 12:15:07.812206 13704 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:07.816195  8823 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 319) took 42591 ms (client timeout 15000 ms). Trace:
I20260709 12:15:07.838636  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.672660 13537 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:07.747527 13689 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:07.849603  8923 rpcz_store.cc:276] 0709 12:15:06.216854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.545791 (+328937us) service_pool.cc:224] Handling call
0709 12:15:07.260772 (+714981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:07.261674 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.716950 (+455276us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540008b1d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.717097 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642249600}
I20260709 12:15:07.854681  8820 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 10, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 10 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:07.885702  9072 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:07.765146  9066 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:07.896605  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:07.897536  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:08.042882  8920 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.043020  8919 raft_consensus.cc:2376] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8. Re-sending same reply.
I20260709 12:15:07.907168  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:07.893918  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:07.927937  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:07.698899 13608 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.969265  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:08.077549  8820 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 6, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 6 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:07.982487  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:08.079514  8994 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:07.903838 13738 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:07.993726  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 82657.4us
W20260709 12:15:07.996237  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 91565.5us
I20260709 12:15:07.776461 13756 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 12:15:07.857712 13716 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:07.796149  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:07.856701 13732 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.857949 13664 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:07.930539 13596 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.930179 12931 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:08.000794  8999 rpcz_store.cc:276] 0709 12:15:05.147364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.570249 (+422885us) service_pool.cc:224] Handling call
0709 12:15:06.087517 (+517268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:06.087869 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:06.087897 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:06.088361 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:15:06.407304 (+318943us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:06.407364 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.407456 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:06.828748 (+421292us) raft_consensus.cc:1685] finished
0709 12:15:06.828773 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:07.809296 (+980523us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000f50d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.809588 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5034,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1188831488,"thread_start_us":318502,"threads_started":1,"wal-append.queue_time_us":404287,"wal-append.run_cpu_time_us":2639,"wal-append.run_wall_time_us":1345112}
I20260709 12:15:07.999940  8992 rpcz_store.cc:276] 0709 12:15:06.422882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.423004 (+   122us) service_pool.cc:224] Handling call
0709 12:15:07.803864 (+1380860us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400171954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:07.804075 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894361984}
I20260709 12:15:08.002501  9618 rpcz_store.cc:276] 0709 12:15:06.555172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.555337 (+   165us) service_pool.cc:224] Handling call
0709 12:15:06.555615 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:06.821723 (+266108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:06.821751 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:06.821788 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:06.821821 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.810620 (+988799us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540046ee54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:07.810706 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:07.810891 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611488000}
W20260709 12:15:08.030118  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 244390us
W20260709 12:15:08.045656  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 130924us
I20260709 12:15:08.079128  8820 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:15:08.080686  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 186828us
I20260709 12:15:07.995890 13747 raft_consensus.cc:2764] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:15:07.945307 13609 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:15:07.883330 13701 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:07.951119 13444 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:08.036427  8823 rpcz_store.cc:269] 0709 12:14:25.224633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.237459 (+ 12826us) service_pool.cc:224] Handling call
0709 12:14:26.146029 (+908570us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba5090 00007f3985c43f3a 00007f398b9f9e9c 00007f398baf804e 00007f3989fb92a4 00007f3989fb9232 00007f3989fb9161 00007f3989fb90dc 00007f3989fb8392 00007f3983f7648c 00007f3983f758c6
0709 12:15:07.816079 (+41670050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:00.405203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:00.430710 (+ 25507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:00.430781 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:15:00.430811 (+    30us) tablet.cc:662] Decoding operations
0709 12:15:00.432025 (+  1214us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:00.432138 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:00.432177 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:15:00.433311 (+  1134us) tablet.cc:701] Row locks acquired
0709 12:15:00.433380 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:15:00.433578 (+   198us) write_op.cc:270] Start()
0709 12:15:00.433758 (+   180us) write_op.cc:276] Timestamp: P: 1783599300433502 usec, L: 0
0709 12:15:00.433817 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 12:15:00.434695 (+   878us) log.cc:844] Serialized 3185 byte log entry
0709 12:15:00.742614 (+307919us) op_driver.cc:464] REPLICATION: finished
0709 12:15:00.976101 (+233487us) write_op.cc:301] APPLY: starting
0709 12:15:01.005482 (+ 29381us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:01.244632 (+239150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:01.244985 (+   353us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:01.516001 (+271016us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:01.516319 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:15:01.516387 (+    68us) write_op.cc:312] APPLY: finished
0709 12:15:01.516757 (+   370us) log.cc:844] Serialized 81 byte log entry
0709 12:15:01.516970 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:01.517113 (+   143us) write_op.cc:454] Released schema lock
0709 12:15:01.517179 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:01.517707 (+   528us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:01.517739 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":694382,"reported_tablets":48,"spinlock_wait_cycles":499936128,"child_traces":[["op",{"apply.queue_time_us":195546,"apply.run_cpu_time_us":26015,"apply.run_wall_time_us":564355,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":175740,"prepare.run_cpu_time_us":15286,"prepare.run_wall_time_us":203621,"raft.queue_time_us":116356,"raft.run_cpu_time_us":25611,"raft.run_wall_time_us":131697,"replication_time_us":308599,"thread_start_us":368816,"threads_started":4,"wal-append.queue_time_us":128897,"wal-append.run_cpu_time_us":73178,"wal-append.run_wall_time_us":1981056}]]}
I20260709 12:15:08.241662  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.487639  9619 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
W20260709 12:15:08.441465  9065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.008s
W20260709 12:15:08.490648  9065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.005s	sys 0.008s
I20260709 12:15:08.490993  9069 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:08.488086  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:08.143097  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:08.205163  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58623.9us
I20260709 12:15:08.492751  8997 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
W20260709 12:15:08.260396  9000 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.019s
W20260709 12:15:08.493605  9000 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.019s	sys 0.024s
I20260709 12:15:08.493669  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:08.370481  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:08.495322  8998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.002s	sys 0.010s
W20260709 12:15:08.495640  8998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.002s	sys 0.011s
I20260709 12:15:08.087457  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.436189  8920 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:08.494366  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.488196  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:08.497838  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:08.498447  9619 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:08.530886  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:08.502687  8820 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.531633  8994 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:08.532569  8820 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 9, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:08.533962  8820 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 10, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 10 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:08.536474  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.536796  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:08.536871  8820 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:08.542022  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.543278  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:08.343003 13680 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.388120 13781 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:08.384900 13774 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.147639 13435 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.437s
I20260709 12:15:08.310858 13589 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.545291  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:08.537860  9624 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.081533 13140 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:08.565915  8997 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:08.300849 13762 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:15:08.460892 13717 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.005s
I20260709 12:15:08.566850  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:08.566257  8820 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.616629  9066 raft_consensus.cc:606] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.567009  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:08.568663  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 75465.6us
W20260709 12:15:08.445952 13779 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:15:08.298852 13771 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:15:08.400738 13760 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.363s	user 0.000s	sys 0.002s
W20260709 12:15:08.274259 13765 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:15:08.438817 13758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.000s	sys 0.012s
W20260709 12:15:08.231701 13425 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.002s
I20260709 12:15:08.544123  9622 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:15:08.399509 13637 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.865s	user 0.005s	sys 0.005s
I20260709 12:15:08.572695  9071 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:08.542689 13236 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:08.391014 13777 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.649428  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:08.457226 13551 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.000s
I20260709 12:15:08.663334 13551 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.576292  9619 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:08.302693 13689 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.530848 13716 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.194252 13650 consensus_queue.cc:1243] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:15:08.328816 13608 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:08.538409  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 451008us
I20260709 12:15:08.675804  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.250176 13305 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.542587 13443 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:08.601998  9620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.025s	sys 0.029s
I20260709 12:15:08.578631  9616 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
W20260709 12:15:08.681093  9620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.026s	sys 0.030s
I20260709 12:15:08.575910  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:08.542829 13688 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:08.606808  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.609167  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.609526  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:08.684336  9068 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.613157  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.615417  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:08.686312  8997 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:15:08.686646  8997 pending_rounds.cc:85] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 6
I20260709 12:15:08.686923  8997 pending_rounds.cc:107] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:15:08.661770 13739 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.542845 13614 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.565399 13488 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:08.189137 13395 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.407s
I20260709 12:15:08.085708 13537 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.078267 13704 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.617504  8820 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 14, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 14 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:15:08.626363  8888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.006s	sys 0.022s
W20260709 12:15:08.699056  8888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.022s
W20260709 12:15:08.699457  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 765213us
I20260709 12:15:08.626307  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:08.079262 13607 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.638160  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.137032 13651 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.638911  8994 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:08.701911  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:08.683326 13443 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:08.640799  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.530254 12931 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.541996 13596 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.192739 13696 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.661857  9623 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:15:08.605159 13140 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.648192  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:08.581216 13732 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.666447  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.645236 13717 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.667819  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:08.694226 13743 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:08.671141  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2570) took 1157 ms. Trace:
W20260709 12:15:08.671351  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 168054us
I20260709 12:15:08.730012  9071 rpcz_store.cc:276] 0709 12:15:07.513429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.544602 (+ 31173us) service_pool.cc:224] Handling call
0709 12:15:08.670986 (+1126384us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002d4bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:08.671086 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326043392}
W20260709 12:15:08.644986 13758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.000s	sys 0.013s
I20260709 12:15:08.734325  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:08.734845  8991 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:08.636267 13775 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:08.321568 13736 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.610723 13781 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.687307  8997 raft_consensus.cc:2889] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:08.703313 13620 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.688763  8999 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:08.688869  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:08.743424  9074 raft_consensus.cc:2376] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12. Re-sending same reply.
I20260709 12:15:08.744951  9074 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:08.625593 13747 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:15:08.640908  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:08.746703  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 105868us
I20260709 12:15:08.668596 13777 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.666060 13425 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.751989  9070 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 8.
I20260709 12:15:08.704435  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3206) took 2432 ms. Trace:
I20260709 12:15:08.752491  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:08.618932 13774 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.699548  8820 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 9, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:08.755389  8820 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 11, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:08.689404 13688 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.722273 13140 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.686173 13583 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:08.710538  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62433.8us
I20260709 12:15:08.711138  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2576) took 1110 ms. Trace:
I20260709 12:15:08.761699  9073 rpcz_store.cc:276] 0709 12:15:07.600429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.613179 (+ 12750us) service_pool.cc:224] Handling call
0709 12:15:07.613462 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.645017 (+ 31555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.645051 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.645490 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.696750 (+ 51260us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:07.696790 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.696850 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.710904 (+1014054us) raft_consensus.cc:1685] finished
0709 12:15:08.710932 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.711073 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31177,"raft.queue_time_us":31727,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4686,"thread_start_us":50924,"threads_started":1,"wal-append.queue_time_us":221149}
I20260709 12:15:08.137609 13433 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:08.665436 13637 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.695307 13739 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.765965 13664 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.766665 13637 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.696429 13488 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.767390 13488 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:08.770470  8993 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:08.694339 13373 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:08.680019 13689 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.721799  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:08.670322 13236 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.617987  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.740727  9068 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:08.749130  8994 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:08.707883 13443 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:08.673444 13680 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:15:08.756064  9040 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.757575  8820 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 3 to 10, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:08.758267 13676 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:08.752610  9065 rpcz_store.cc:276] 0709 12:15:06.265531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.266669 (+  1138us) service_pool.cc:224] Handling call
0709 12:15:06.267098 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:06.312368 (+ 45270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:06.312418 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:06.312957 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.652765 (+1339808us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800394f00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:08.491987 (+839222us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:08.662252 (+170265us) log.cc:844] Serialized 14 byte log entry
0709 12:15:08.692615 (+ 30363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.692688 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.692724 (+    36us) raft_consensus.cc:1685] finished
0709 12:15:08.697536 (+  4812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.697669 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74879,"prepare.queue_time_us":197185,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4048,"raft.queue_time_us":75092,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":16685,"spinlock_wait_cycles":12087552,"thread_start_us":1008944,"threads_started":2,"wal-append.queue_time_us":2008705}
I20260709 12:15:08.764169 13444 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.735018 13696 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:08.803164 13758 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:08.803529 13696 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.805625 13696 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.777043  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:08.806288  9073 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:08.709372 13759 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:15:08.696283 13614 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.807197 13759 consensus_queue.cc:1243] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:08.789731  8995 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:08.796554  8820 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 8, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:08.809109  8820 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 9, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:08.729018 13436 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:08.797528  9624 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:15:08.797678  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54652.5us
I20260709 12:15:08.758565 13790 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.710282 13785 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:15:08.822281  8999 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:08.741446 13717 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.811573  8820 catalog_manager.cc:5697] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 12, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 12 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:15:08.812779 13778 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:15:08.813349 12931 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.815718 13236 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.816181 13551 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.789155 13583 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.785331 13792 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.841466 13717 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.841554 13792 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.824245 13433 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:08.842589 13433 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.844204 13792 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.844504 13777 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.845913 13688 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.819880  8889 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:08.826521  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 70573.3us
I20260709 12:15:08.827878 13708 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.757246 13620 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.763460 13627 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:15:08.831321  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:08.848412  8997 raft_consensus.cc:2368] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:08.833662  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:08.848544  9000 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:08.788009 13456 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:15:08.839289 13651 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.839839 13716 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.840993 13583 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.847003  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.832437  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:08.808296 13775 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:08.818833 13436 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.802285 13676 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.862076  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:08.867866 13787 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:15:08.868054  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:08.869347  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1674) took 1227 ms. Trace:
I20260709 12:15:08.869433 13435 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.869752  8996 rpcz_store.cc:276] 0709 12:15:07.641747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.645943 (+  4196us) service_pool.cc:224] Handling call
0709 12:15:07.665307 (+ 19364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.685020 (+ 19713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.685064 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.697184 (+ 12120us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.302891 (+605707us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800073a20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:08.612199 (+309308us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:08.612244 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.612310 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.869043 (+256733us) raft_consensus.cc:1685] finished
0709 12:15:08.869065 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.869284 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19317,"raft.queue_time_us":19856,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":83677,"spinlock_wait_cycles":2723584,"thread_start_us":309127,"threads_started":1,"wal-append.queue_time_us":847285}
I20260709 12:15:08.831398 13696 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:15:08.872071 13696 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:08.872439 13696 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:08.871111 13797 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:08.873493 13607 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.873255 13696 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.824950 13790 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.874468 13696 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:08.852037 13792 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:08.856017 13627 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:08.825238 13664 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:15:08.875895 13790 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.876093 13775 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.882956 13701 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.883960 13704 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:08.884974 13789 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:15:08.855672 13596 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.848305 13747 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:15:08.890933 13774 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.862533 13753 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.892421 13614 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.846987 13488 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.865087 13436 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.878098 13676 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.854723 13777 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:08.872108 13425 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.920965 13738 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.925781 13140 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.928646 13620 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.875854 13627 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.930656 13627 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.931182  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 760) took 1273 ms. Trace:
I20260709 12:15:08.932613 13774 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:08.931604  9620 rpcz_store.cc:276] 0709 12:15:07.657924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.658533 (+   609us) service_pool.cc:224] Handling call
0709 12:15:07.658940 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.659363 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.659388 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.683185 (+ 23797us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.681479 (+998294us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:08.686566 (+  5087us) log.cc:844] Serialized 14 byte log entry
0709 12:15:08.925117 (+238551us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800420880. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:08.930717 (+  5600us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800420880. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287 00007f3985c56208
0709 12:15:08.930888 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.930960 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.931000 (+    40us) raft_consensus.cc:1685] finished
0709 12:15:08.931015 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.931129 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8422,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":100,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":13689,"spinlock_wait_cycles":9886848,"thread_start_us":997625,"threads_started":1,"wal-append.queue_time_us":1010161}
I20260709 12:15:08.933643 13676 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.932997 13774 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:08.936563 13774 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:08.937685 13774 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:08.938441 13140 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.938529 13488 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:08.930755 13433 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.935606 13739 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:08.941241 13689 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:08.904011 13443 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:08.975704  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:08.981211  8820 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 10, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:08.985373  8820 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:08.850807  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:08.995194  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:08.998138  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 147237us
I20260709 12:15:08.833855  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:09.004532  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 170621us
I20260709 12:15:09.005741  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:08.994927  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:09.016781  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.019315  9073 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:09.019964  8820 catalog_manager.cc:5697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 1 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 12 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.947539 13676 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:09.034370 13425 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:09.043538 13425 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:08.937709 13436 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.045481 13614 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.045377 13425 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.046157 13614 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:09.046756 13614 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:09.035029  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.035914 13395 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:09.048767 13395 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.049139 13395 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.049522 13443 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.037072 13620 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:09.051838 13620 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.052248 13620 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.052359 13488 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.053365 13488 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.054255 13443 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.055222 13443 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.060325 13443 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.060462  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.061277  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.066248  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1680) took 1402 ms. Trace:
I20260709 12:15:09.068020  9071 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:09.042383 13696 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.071916  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.071524 13696 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.073454  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.074733  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.074970 13696 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:09.040267  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 348246us
I20260709 12:15:09.024729  8820 catalog_manager.cc:5697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 8, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.078671  8820 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 9, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.079684 13701 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.023168  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:09.032891  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 456854us
I20260709 12:15:09.066805  8993 rpcz_store.cc:276] 0709 12:15:07.663198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.663345 (+   147us) service_pool.cc:224] Handling call
0709 12:15:07.663673 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:08.770922 (+1107249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.065437 (+294515us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000f5ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:09.065985 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544773376}
I20260709 12:15:09.046957 13436 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.040851  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.042042 13689 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.093187  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:09.094146 13806 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:15:09.095002 13701 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.096055  8820 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.097627 13701 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.099767  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.101647  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.102486 13433 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.104463 13716 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:09.104966 13736 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.105568 13775 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.107278 13488 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.115375 13537 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.116904  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1673) took 1475 ms. Trace:
I20260709 12:15:09.118324  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 2998) took 1435 ms. Trace:
W20260709 12:15:09.104486  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 81618.2us
I20260709 12:15:09.128130  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3218) took 1353 ms. Trace:
I20260709 12:15:09.131529 13777 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.132668 13790 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:09.134467 13772 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.135066 13792 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.136449 13781 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.137774 13800 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:09.098346  8820 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:09.145429  9067 rpcz_store.cc:276] 0709 12:15:07.774274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.888938 (+114664us) service_pool.cc:224] Handling call
0709 12:15:07.889210 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.729743 (+840533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:08.729776 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:08.729816 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:08.729844 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.127515 (+397671us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400421dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:09.127576 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.127902 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932607360}
I20260709 12:15:09.144876  8995 rpcz_store.cc:276] 0709 12:15:07.641452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.647317 (+  5865us) service_pool.cc:224] Handling call
0709 12:15:07.647576 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.808232 (+1160656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.116315 (+308083us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001a1dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:09.116667 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626129664}
I20260709 12:15:09.145226  8991 rpcz_store.cc:276] 0709 12:15:07.682796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.691839 (+  9043us) service_pool.cc:224] Handling call
0709 12:15:07.692083 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.740220 (+1048137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.117762 (+377542us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002350d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:09.118098 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397700864}
I20260709 12:15:09.143625 13236 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:15:09.156085  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.157316 13802 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.158192 13651 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:15:09.158905  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118374us
I20260709 12:15:09.160090  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.158386 13620 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.162338 13689 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.162544 13777 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.162586  8963 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.149480 13790 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.174255 13609 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.175709  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.175858  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:09.176757 13443 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:09.177444 13736 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:09.178210 13731 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:09.178696 13731 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.179176 13731 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.151227 13800 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:09.179836  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.181123 13800 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.177081  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:09.187693  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:09.190033  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.191632 13444 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.191721  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:09.192715  8920 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.192627 13444 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.198134  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:09.199083  8921 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:09.203624  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:09.205039  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:09.205487  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:09.206666 13775 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.207890  8820 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.209502 13775 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.210191 13738 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.210050  8820 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.212520 13777 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.162333 13772 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.214077  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.165488 13433 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.215930 13772 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.216022 13433 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.217074  8922 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:09.217752 13775 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:09.220399  8919 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:09.221009 13140 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:09.221508 13140 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:09.223706 13785 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.224162 13785 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:09.224534 13785 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.224632  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.225001  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.225914  8920 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:09.228021 13737 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.233223 13792 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.233922 13737 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.228665 13759 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.235560  8916 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.183297 13790 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.235801 13651 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.236533 13651 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.238816 13651 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.239903 13651 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.235689 13759 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.229817  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:09.241180 13651 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.243443 13759 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.243994  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:09.244835  8921 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:09.245574 13759 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.245723 13236 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.240705 13737 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.232365 13689 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:09.232982  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57504.8us
I20260709 12:15:09.246517 13236 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.250147 13751 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:09.248468  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:09.253047 13609 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:09.250968 13236 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.253741 13609 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.253080 13443 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.257072 13736 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.257699  9037 leader_election.cc:400] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:09.258066 13736 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.258594  9037 leader_election.cc:403] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:09.260143 13444 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:09.260921 13436 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:09.258572 13596 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.261657 13790 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.262631 13686 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:09.262828 13596 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.246429 13759 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.265761 13596 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.256073 13443 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.257509 13651 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:09.232000  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76106.5us
I20260709 12:15:09.268272 13443 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.251953  8820 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:09.266511 13759 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.270932  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.271703  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.271937  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.272774  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.274708 13792 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.255038 13609 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.277082 13790 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.276296  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.272454  8820 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 12, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 12 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:09.285029  8919 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:09.277217 13686 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:15:09.288204 13736 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.288331 13686 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:09.288947 13686 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:09.279856  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.222761 13140 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.292449 13140 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.290325 13686 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.296020  9618 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:09.297511 13686 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:09.218945 13433 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.291409 13743 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:09.301769  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fd11e77b4be14e658672599b30d51e76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:09.303407 13736 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.307580 13425 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:09.307991 13614 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.317504  8820 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:09.319572  8916 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:09.314899 13743 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.322952 13743 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.323632 13614 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.327219  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.328027  9070 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.328271  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:09.329142  9000 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:09.322253  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.332086  9065 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:09.332473  8991 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:09.312270 13620 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.333570  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:09.333606 13800 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.344790  9068 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:09.345866 13456 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:09.347151 13673 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:09.347982  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.348073  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.348971  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.352366  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.352398  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.354899  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.356248  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.357038  9072 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:09.356917  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:09.357925  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.358469  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.358595  9072 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.273101 13751 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:15:09.358726 13772 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.351361  8820 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.378535  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.374969  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.378271  8820 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 6 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:09.382573  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.388880  9070 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:09.391829  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.392280  9071 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:09.406538  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:09.407691  9074 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:09.387580 13731 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.413756 13731 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.418335  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.419880  9069 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:09.420905  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.435667  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:09.436529  8993 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
W20260709 12:15:09.437162  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118529us
I20260709 12:15:09.437909  8999 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.438632  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:09.439030  9620 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:09.440027  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:09.440357  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.441290  9621 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:15:09.486958  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 108842us
W20260709 12:15:09.501814  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 185784us
I20260709 12:15:09.505836 13739 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:09.506618 13739 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.509196 13739 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.556005  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:09.577992  9618 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:09.433252 13395 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.593418  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:09.597667  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.637774 13814 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:15:09.661391  9615 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:09.681222  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.685513  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:09.685945  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:09.687194  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44145us
I20260709 12:15:09.688819  9072 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:09.691733  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.693904  9620 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:09.696584  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.701463 13627 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:09.746541 13627 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:09.747010 13627 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:09.748072  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.748216 13627 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.749194 13614 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:09.749686 13614 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.750125 13614 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.700764 13731 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:09.750041 13620 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:09.751003 13731 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.751190  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:09.745692 13701 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:09.751420 13620 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:09.752053 13620 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.753032 13305 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.753527 13305 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.753134 13620 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.753898 13305 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.754221 13673 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.754667  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.754765 13673 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.755779 13731 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.756403  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:09.758239 13637 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:09.758358  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:09.702183 13751 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:09.759203 13751 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.759357 13794 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:09.759720 13751 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.760263 13794 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:09.760761 13794 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.762624 13758 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:09.763000 13758 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.763355  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.764019 13758 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.764914 13456 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:09.765496 13758 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.765813 13456 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:09.747035 13785 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.004s
I20260709 12:15:09.759146 13614 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.770140 13614 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.761699 13794 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.758747 13637 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.694417 13395 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.781864  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.757109 13673 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:09.773016 13785 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.779808 13637 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:09.785092 13620 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.789099  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.786412 13785 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.793794  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.790061  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.794519  9621 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.799399  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.749946 13627 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:09.812500  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.805724 13743 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:09.820745  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 127928us
I20260709 12:15:09.823125  9621 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
W20260709 12:15:09.827948  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 138284us
I20260709 12:15:09.832623  9067 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:09.837635  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.843575  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.822947 13614 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:15:09.859643  8963 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:09.851680 13443 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:09.862255  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:09.872640  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.873404  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:09.867668 13140 consensus_meta.cc:287] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.003s
I20260709 12:15:09.876221  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:09.867282 13614 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:09.876286 13785 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:09.876775  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:09.867547 13800 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 12:15:09.868325 13425 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.894449  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.868105 13583 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.879300 13743 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.909859  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.884729 13614 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.929121  8920 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:15:09.920742 13583 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.932574  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.911334 13785 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.939530  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.943475 13785 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:09.944573  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.946286  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:09.947028 13794 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:09.949672  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.950861  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.951637  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.952400  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.947753  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.952553  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.947141 13758 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.953451 13758 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:09.953485  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:09.954068 13758 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:09.954288 13686 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.001s
I20260709 12:15:09.954417  9071 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:09.956336  9073 raft_consensus.cc:2410] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:15:09.954487 13758 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.957062 13614 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:09.953786  8966 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:09.933585 13425 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:09.947891  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:09.959965 13425 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.959615 13794 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:09.960974 13794 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:09.962126 13425 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:09.961921 13794 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.920938 13637 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.964672 13637 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:09.957684  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.992439  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:09.988696 13758 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:09.995847  8921 raft_consensus.cc:2368] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
W20260709 12:15:09.997422  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 43720.6us
I20260709 12:15:10.010149 13305 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.012611  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:10.014390  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 105105us
I20260709 12:15:10.024682  8916 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:10.027100  9074 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:10.034243  9070 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:15:10.003959 13758 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:10.054147  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.048273 13609 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:10.065868  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.058712 13731 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:10.082211  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.090144  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.065485 13781 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:10.093820  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.091959  9618 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:10.097481  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.097757  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.099752  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.102969  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.103202  8917 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:15:10.097532  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.079131 13609 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:10.112167  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.105072  8920 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:10.103752  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.122401  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.106221 13800 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.130985  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.105737 13821 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.106113 13794 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.137681  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.134971  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.143153  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.105858 13620 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.141175  9620 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:10.149176  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.145592  8924 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:10.146064  8918 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:10.107472 13751 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.140084 13425 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:10.162181  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.159560  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.163636  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.164413  8917 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.165231 13717 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.160535 13620 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.165880 13717 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.168745 13717 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.171734  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.181738  8924 raft_consensus.cc:2393] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:10.121101 13781 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.204667 13696 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.205399 13696 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.207510 13696 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.209554  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.153971 13305 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.158010 13758 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.216245  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.216945  8999 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:10.220103  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.220697  9620 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:10.225422  8922 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.233896  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.237736  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.239981 13758 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.241526  9000 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.152283 13794 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.248160 13701 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:10.248700 13701 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:10.249110 13701 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.249887 13794 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.251166  9000 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:10.156858 13800 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.150471 13821 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.272625  8924 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:10.243072 13758 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:10.276818  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67410.9us
I20260709 12:15:10.274144  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.281787  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.282502  8919 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:10.277972  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:10.276368 13435 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:10.229820 13717 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:15:10.224303 13425 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.293334  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.295560  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:10.327018  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.230154 13609 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.363646  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.289988 13435 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:10.286970  8991 raft_consensus.cc:2376] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11. Re-sending same reply.
I20260709 12:15:10.368645  9620 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:10.387269  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 91761us
I20260709 12:15:10.410059  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.412683 13790 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:10.412979  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.413630  8920 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.411947  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.418068  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.422958  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.379065 13696 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:10.426578  8994 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:10.426963  8996 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:10.429404  8920 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:10.384706 13140 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:10.428704  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.433137  8924 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.435874  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.431798  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.439556  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.440939  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:10.441682 13841 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:15:10.442338  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.443080  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.444036  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.443770 13435 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:10.444447 13832 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:15:10.444957 13435 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.445155  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.446247  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:10.446768  8923 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.447690 13781 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:10.444026  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.449055  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.437904  8925 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:10.444026  8997 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:10.451658  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.422693 13751 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:10.453676  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.457383  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.464052 13433 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:10.464286  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.465158  8925 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:10.465296  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.466770  8925 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:10.466784  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.469868  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.432250 13842 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.473279  8992 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.478116  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.482570  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.485507  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.488188  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:10.491669  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50004.5us
I20260709 12:15:10.491928  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.493813  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.488363  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.495532  8999 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:10.496559  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.497407  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:10.498982 13843 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:15:10.499356 13837 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:15:10.498973 13851 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.501432  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.502182  8921 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:10.499462  9040 leader_election.cc:400] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:10.506165  8924 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:10.508594  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:10.509053 13833 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:15:10.509742 13800 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.512202  9040 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:10.480605 13140 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.514384 13140 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:10.515373  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.515523 13821 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.518329  8922 raft_consensus.cc:2410] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:15:10.519636  8917 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:10.523191 13433 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:10.523870 13433 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:10.523799  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.525053 13731 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:10.525614 13731 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.530046  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:10.526292  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.532641  8999 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:10.525070 13433 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.515848 13425 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:10.525084 13751 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:10.543478  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:10.544845  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.546098  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.547794  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.548520 13781 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.550303 13800 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.546026 13847 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:15:10.551045 13800 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.560846 13696 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.561699 13696 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.565706  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:10.567193 13751 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.567407 13790 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.567472 13847 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.568112 13790 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.568368 13847 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.570374 13751 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.570959 13751 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.573158  9065 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:10.578562  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.570407 13790 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:10.583150  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.583279  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.581274  8925 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:10.588377  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.589915  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.590610  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:10.590827 13607 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.591531  9068 raft_consensus.cc:2393] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:10.594998  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 172145us
I20260709 12:15:10.570901 13847 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.598003  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:10.609844  9069 raft_consensus.cc:1217] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[9.9-13.11]   Dedup: 9.9->[11.10-13.11]
W20260709 12:15:10.603745  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 56485.3us
I20260709 12:15:10.604445  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.616031  8996 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.616405  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.627645  9069 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: [9.9-13.11]
I20260709 12:15:10.627748  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.630239  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.634318  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.635095  8994 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:10.594192 13425 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:10.636364  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:10.629017  9067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2597) took 1261 ms (client timeout 1625 ms). Trace:
I20260709 12:15:10.596292 13842 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:10.638496  9067 rpcz_store.cc:269] 0709 12:15:09.346729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.347804 (+  1075us) service_pool.cc:224] Handling call
0709 12:15:10.608045 (+1260241us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000e79d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:10.608274 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097833856}
I20260709 12:15:10.643193  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.607482 13607 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.648859 13861 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:10.607436 13853 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:15:10.649969  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52104us
I20260709 12:15:10.651937  9624 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:10.608752 13790 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:10.662673  8925 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:10.662982  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:10.665773 13838 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.444s	user 0.007s	sys 0.000s
I20260709 12:15:10.667553  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:10.608952 13839 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:15:10.644454 13842 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:10.673061  8996 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:10.672889  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:10.650779 13847 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.679504  8923 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:10.675755  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.676204 13842 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.674908 13861 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:10.676508 13800 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:10.671175 13790 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.687350 13395 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:10.698629  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.704226  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.705482 13854 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.705519 13852 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.706357 13855 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.707019 13855 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:10.707293 13859 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:10.707595 13855 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.713621 13620 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.717468 13701 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.719264  8920 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:10.691111 13737 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:15:10.719580  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.720270 13140 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:10.720686 13140 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:10.721797  9616 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:10.721601 13140 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.723220  9616 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:10.723915 13140 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.726311 13731 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.728428  9616 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:10.720844  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.735426 13425 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:15:10.735694 13736 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:10.737608  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2600) took 1387 ms. Trace:
I20260709 12:15:10.737978  9073 rpcz_store.cc:276] 0709 12:15:09.349716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.352072 (+  2356us) service_pool.cc:224] Handling call
0709 12:15:10.737423 (+1385351us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000acb54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:10.737552 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386727296}
I20260709 12:15:10.735469 13596 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:10.740437 13596 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:10.740643  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.741127 13851 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:10.741412 13596 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.741859 13738 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.742029  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.727733 13751 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.744321 13738 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.745177 13751 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.745312 13701 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.745975 13395 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:10.746914  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:10.747074 13395 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:10.747464 13395 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:10.747756  8999 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:10.747902  8994 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:15:10.742602 13596 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.748515 13395 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.750123 13395 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:10.750192 13781 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:10.750649 13781 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:10.751489 13781 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.752899 13781 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.758456  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.758745 13861 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.759588  9624 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:10.760704  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.742636 13851 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:10.761300  9624 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:10.761401 13851 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:10.761708 13854 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:10.762225  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:10.762466 13854 consensus_queue.cc:1243] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:10.762346 13851 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.763226 13848 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:10.763612 13848 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:10.763947  8924 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:10.758550  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:10.787565  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:10.789778  9622 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.790741 13790 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.729349 13696 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.765158 13443 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:10.795812 13435 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.796404 13435 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:10.798367  9621 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:10.798625 13435 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:10.764508 13848 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.809484  9622 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:10.817971  9621 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:10.867959  9616 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:10.800865 13851 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:10.868345  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 52286.7us
I20260709 12:15:10.871191  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:10.867077 13848 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:10.877669  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 247511us
I20260709 12:15:10.881985  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.871182 13596 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:10.883351  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 211052us
I20260709 12:15:10.885315  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.887501  8923 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:10.885804  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.886318  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.888145 13696 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:10.924791 13696 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:10.925868  9587 leader_election.cc:336] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.551s (SENT)
I20260709 12:15:10.926545  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.932194  8922 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:10.864204 13855 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:10.934552  8920 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:10.935624  8916 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:10.948551  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.879334 13443 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.948230  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:10.953229  8917 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:10.941643  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59729.5us
I20260709 12:15:10.950906  8925 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:10.955293  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.959988  8921 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:10.967655  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:10.968240  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 168556us
W20260709 12:15:10.968873  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.971216  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45422.8us
I20260709 12:15:10.927084 13696 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:10.887476 13596 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:10.982040  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:10.982543  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:10.879583 13637 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:15:10.987474 13785 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.989603 13847 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:10.982860  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:10.973987  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:10.948024 13790 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:10.992089  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:10.959619 13738 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.984545  9073 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:10.952709 13443 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:10.993261  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 193042us
I20260709 12:15:10.950620 13620 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.017102 13443 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.967227 13854 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.028898 13743 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.029132 13854 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.032016 13854 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.010747  9074 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:10.955699 13842 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.003144 13731 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.028255 13436 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.051081 13785 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:11.000950  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:11.028096  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 54196.9us
W20260709 12:15:11.038830  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.049808 13873 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:11.025245 13620 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:11.017846 13830 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:11.050582 13867 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.056315  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:11.054962 13873 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:11.063055 13456 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:11.058362 13435 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:11.078868  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 89431.8us
I20260709 12:15:11.075807  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:11.077275  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:11.073792  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:11.080717  8922 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
W20260709 12:15:11.065506 13869 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:15:11.084451  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:11.065026 13673 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 12:15:11.017716 13863 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:15:11.056860 13436 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.023375 13596 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.169795 13731 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:11.173767 13785 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:11.194891  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 114878us
I20260709 12:15:11.083109 13435 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:11.235590  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 151200us
I20260709 12:15:11.242488  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:11.201360 13596 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:11.091598 13867 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.203555 13842 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:11.274153  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:11.266266 13395 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.017s
W20260709 12:15:11.292554  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 87626.8us
I20260709 12:15:11.296170  9065 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:11.232758 13731 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.282809 13696 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:11.179798 13873 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.328229  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 983) took 1088 ms. Trace:
I20260709 12:15:11.297276 13875 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:11.329452  9000 rpcz_store.cc:276] 0709 12:15:10.234423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.237454 (+  3031us) service_pool.cc:224] Handling call
0709 12:15:11.322273 (+1084819us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:11.322439 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6966528}
I20260709 12:15:11.325301  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:11.334034  9619 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:11.336680 13844 raft_consensus.cc:993] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:15:11.355926  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:11.323328 13696 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:11.330950 13620 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:11.371497 13877 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:15:11.386991  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.361431 13848 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:11.379459 13855 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:11.386863  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85363.9us
I20260709 12:15:11.390693  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.341922 13875 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.395752  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:11.378479 13731 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.400022  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:11.393026 13882 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:15:11.403637  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:11.425345  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.391499 13848 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:11.428071  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 130335us
I20260709 12:15:11.433616  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:11.404184 13436 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:11.404343 13880 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.438261  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:11.422557 13847 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:11.432271 13881 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:15:11.428359 13865 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.253s	user 0.000s	sys 0.004s
I20260709 12:15:11.445578  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:11.428190 13848 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:11.425441 13855 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.463481  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:11.438783 13891 raft_consensus.cc:1081] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:15:11.461975 13436 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.460449 13887 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.467023 13781 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.472779 13781 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.444737 13871 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.473143 13781 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:11.478235 13607 consensus_meta.cc:287] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.815s	user 0.012s	sys 0.005s
I20260709 12:15:11.478664 13607 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:11.481210  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:11.484408  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59173.8us
I20260709 12:15:11.480481  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:11.469004 13673 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:11.496248  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:11.473510 13844 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:11.498252 13875 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:11.492195 13436 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:11.496270 13673 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:11.498782 13436 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.499181 13436 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:11.499722 13673 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.503746 13607 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.504305 13607 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.494277  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:11.508240 13435 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.510519  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:11.463521 13855 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.511968  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:11.497009  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:11.513625  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.514467  8924 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
W20260709 12:15:11.530222  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.544729  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.580637  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.511898 13855 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:11.487421 13785 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:11.589188  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 103642us
I20260709 12:15:11.467638 13847 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.473489 13696 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.605065  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:11.568493 13882 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:15:11.607051  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.597905 13861 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.616284 13861 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.620088 13861 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.604362  8924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47330
I20260709 12:15:11.641839 13435 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:11.642661  9065 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:11.642611 13435 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.649158  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:11.593396  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 130003us
I20260709 12:15:11.655639  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:11.657387  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:11.640830 13898 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:11.672850 13898 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.674163  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:11.675479  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:11.676343  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:11.676924  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:11.677489  9074 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.677521  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:11.678750  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:11.679828  9072 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:11.680197  9069 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:11.680552  9069 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:11.681253  9069 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.682278  9069 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:11.683359 13785 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:11.683792 13785 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.683910 13901 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.684218 13785 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:11.686305  8888 leader_election.cc:400] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:11.690327  8888 leader_election.cc:403] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:11.687424 13883 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.687908  9068 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:11.687947 13889 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.686796  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:11.688498  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:11.689504  9072 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:11.687052 13743 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.692147  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:11.700569  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.702999  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.703660  8917 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:11.707381  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.715713  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.716482  8925 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:11.717417  9074 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:11.675082 13898 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.721233  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:11.725919  8916 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:11.692730 13861 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:11.693673 13860 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.710247 13901 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:11.741328  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.691507 13607 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.724805  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.705765 13731 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:11.706061 13305 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.733817  9072 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:15:11.747771  9072 pending_rounds.cc:85] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 5
I20260709 12:15:11.710520 13874 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:11.718480 13851 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.001s
I20260709 12:15:11.749053  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.748399  9072 pending_rounds.cc:107] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:11.754721  9072 raft_consensus.cc:2889] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:11.706281 13883 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.710016 13743 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.763530  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:11.764415  8922 raft_consensus.cc:2376] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13. Re-sending same reply.
I20260709 12:15:11.767014  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:11.772001  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:11.779837  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.768841  8918 raft_consensus.cc:2376] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13. Re-sending same reply.
I20260709 12:15:11.781324  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.783514  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.785392 13880 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:11.789644 13879 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.747563 13305 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.767808  8925 raft_consensus.cc:2376] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9. Re-sending same reply.
I20260709 12:15:11.793660  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.796356  9068 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:15:11.796835  9068 pending_rounds.cc:85] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 8
I20260709 12:15:11.797111  9068 pending_rounds.cc:107] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:15:11.797339  9068 raft_consensus.cc:2889] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:11.751127 13874 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:11.711304 13889 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.809054  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:11.810994  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 95881.3us
I20260709 12:15:11.792102 13851 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:11.751518 13861 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:11.798509 13443 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 12:15:11.794770 13305 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:11.813925  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:11.818773  8991 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:11.818961  8925 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:11.757426 13731 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.798743 13874 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:11.745359 13860 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.817862  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:11.823557  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:11.822150  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:11.823854  8995 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:11.825263  8994 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:11.826090  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:11.826514  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:11.826694  9000 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:15:11.827900  8992 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:11.828985 13842 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.830015  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:11.830653 13889 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.836460 13435 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:11.812667 13898 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.806826 13855 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.814429 13851 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:11.869994 13731 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.873013  8925 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:11.878484 13860 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.879793 13743 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:11.880497 13883 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:11.884035 13596 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 12:15:11.884440 13842 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.837278 13607 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:15:11.889915  9069 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:11.878734 13781 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.821287 13443 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.944309 13855 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.945055 13855 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.945489 13855 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.935551 13851 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.884444 13848 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.947801 13785 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.949260 13848 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.949962 13785 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.950450 13731 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.937260 13395 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.950994 13731 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:11.951431  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79219.5us
I20260709 12:15:11.951745 13395 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.953058 13731 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.953806 13395 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:11.944404 13443 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.956240  8920 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:11.821166 13436 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:11.974264 13673 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:15:11.981434  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:11.982208  9623 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:11.939143 13906 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.986502 13906 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.989061 13907 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.989609 13907 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.988911 13906 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:11.936616 13901 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:11.994453  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 211018us
I20260709 12:15:11.937076 13879 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.838444 13696 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:11.977561  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 168601us
W20260709 12:15:11.995792  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.957378  9624 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:11.996441  8924 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.005697  8924 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.995890  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:12.011629  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.011420  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.014166  9070 raft_consensus.cc:2368] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:15:11.931911 13898 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.016857  9072 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.017338  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:11.994681 13855 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.022465  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.022958  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.023054  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.023751  9000 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:12.024606  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.025125  9000 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 8.
I20260709 12:15:12.026353  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.025898  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.020665  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.027462  9000 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:11.979044 13785 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.027957  8994 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:12.034104  8991 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:12.034968  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.013118  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.058640  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.033039  8924 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:12.060307  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.059666  8998 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:12.074647 13913 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:12.075157 13785 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.076300  8995 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:12.077420 13785 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.058748  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:12.079819  8992 raft_consensus.cc:2376] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13. Re-sending same reply.
I20260709 12:15:12.080084 13873 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.003170 13906 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.001528 13696 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.075505  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:12.074508  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.086573  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:12.079916 13904 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:12.026859 13596 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.018116 13842 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.002451 13879 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:11.997643 13901 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.100438 13906 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.100566 13696 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.100694  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.103181 13880 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:12.100294  9623 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:12.118242  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:12.118937  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 123094us
I20260709 12:15:12.157714  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:12.106284 13790 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.108459  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.110528 13436 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:12.116346 13874 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.124428  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.124927 13898 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.126539 13781 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.132167 13861 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.135757  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.173764  9620 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.027014 13907 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:12.137104  8810 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:15:12.060285 13673 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:12.150974  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 139380us
W20260709 12:15:12.153020  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 284562us
I20260709 12:15:12.178563  8995 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.179997  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.155104  8925 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.180580  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.155198  9619 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:12.181372  8922 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.167564  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.098363 13910 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:12.163853 13863 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.183579  8923 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:12.188383  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.193284  8919 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:12.158430 13914 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:12.155404 13842 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.233384  9620 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:12.138540 13913 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.195369 13607 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:12.205528 13785 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:12.185783 13916 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:12.190711 13443 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:15:12.209367 13906 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.195837 13863 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.183178 13673 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.270021 13863 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.270160 13673 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:12.211898 13781 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:12.212121 13879 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.213973 13874 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.224855 13912 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:12.153564 13596 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:12.229764  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 216748us
I20260709 12:15:12.232550  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.199950  9590 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:12.241585  8993 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:12.241823 13851 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.234715 13790 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.278611  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.190642 13731 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:15:12.235342 13880 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.251855  8922 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.289781  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.239207 13861 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:15:12.235921 13305 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:12.296444  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 96581.9us
I20260709 12:15:12.297541  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.299643  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.300537  8919 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:12.276068 13916 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:12.307945  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.308841  8922 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:12.291139 13781 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:12.305284 13879 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.316761  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.325893  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:12.327600  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.275691 13785 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:12.302951 13909 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.296054 13915 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:12.324810 13848 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.342427 13305 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:12.343823 13596 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.310180 13919 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.346807 13919 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.347581 13845 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:12.347994 13845 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:12.349027 13919 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.348850 13845 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.295907 13880 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.350070 13845 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.351147 13880 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.351812 13880 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:12.352277 13880 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:12.352962 13847 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.353166 13880 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.342042 13848 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:12.368271  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 179946us
I20260709 12:15:12.370178  8924 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.370810  8964 leader_election.cc:400] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:15:12.371533  8964 leader_election.cc:403] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:12.334690 13395 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:12.303840 13790 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:12.384362  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 155620us
W20260709 12:15:12.384826  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57321.9us
I20260709 12:15:12.389895  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.379030 13395 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.377487 13915 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:12.385370  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.396066  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.402891  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:15:12.404253  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 158783us
I20260709 12:15:12.383881 13443 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.373768 13596 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:15:12.407620  8918 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.417039 13901 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.420548  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.421186  9622 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.378849 13731 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:15:12.422523  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.379349 13696 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.399869 13395 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.444188  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.441001  8999 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:12.399703 13912 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:12.446590  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.457763  9622 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:12.458009  9623 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:12.445688  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.448288  8924 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.448684 13924 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:12.442371 13901 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.446897 13751 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:12.449331 13915 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.456837  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.443574  8918 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:12.446082  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.374550 13909 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.464870 13922 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.460475 13924 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.397107 13916 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.466305 13924 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:12.471933 13885 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:15:12.474612  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.440652 13842 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.475477  8919 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:12.477663  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:12.480405  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:12.455559 13923 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.126s	user 0.002s	sys 0.001s
I20260709 12:15:12.445161 13921 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:12.504244  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.479683  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.498726  8924 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:12.499739  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.491169  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.519477 13922 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.521149  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.521962  9070 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:12.522552 13867 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.464120 13785 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.462114 13751 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:12.532626  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.536885  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.537732  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.481577 13874 raft_consensus.cc:2764] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:15:12.537043  9066 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:12.534482  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.541173  9065 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:12.541106  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:12.533707  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 54106.3us
I20260709 12:15:12.542361  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.542723  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.543501  9070 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:12.543907  9070 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:12.548012  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.544659  9070 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.566049  9070 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.511089 13921 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.576719  8916 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 14. Ops: []
I20260709 12:15:12.511679 13913 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.573302  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.475425 13901 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.585275 13874 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.585777 13874 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.586184 13901 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.587832 13874 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.588975  8920 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:12.594319  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.595535 13751 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.575421  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.580675 13435 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.596663 13751 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:12.596784 13435 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.598857 13435 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.599512 13873 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.582947 13596 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:12.600030 13873 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.578120 13847 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:12.601145 13847 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.601536 13847 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.602043 13873 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.604615  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.605391 13696 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.605926 13919 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:12.605990 13696 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.606491 13914 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.606578 13919 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:12.608328 13848 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.608069 13919 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.608844 13848 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.609325 13848 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.610730 13912 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.578773 13790 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.546334 13917 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.614544 13917 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.538686 13926 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.622092 13926 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.624840 13305 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:12.625378 13305 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.625670 13686 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:12.626348 13686 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.627187 13844 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.627939 13844 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.579392 13921 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.630728  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.583986 13781 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:12.638907  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.643772 13790 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.648782 13790 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.649384 13851 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:12.650341  9624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 1057) took 1910 ms (client timeout 2156 ms). Trace:
I20260709 12:15:12.650933 13790 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.654614 13781 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.655102 13781 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:12.656208 13909 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.655952 13781 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:12.656680  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.657112 13781 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.657405  8998 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:12.658926  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:12.650779  9624 rpcz_store.cc:269] 0709 12:15:10.739757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.761993 (+ 22236us) service_pool.cc:224] Handling call
0709 12:15:12.650163 (+1888170us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b5400770e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:12.650263 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284389248}
I20260709 12:15:12.660521  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.661336  8993 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:12.663172  8995 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:12.663916  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:12.664583  8991 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.664718 13443 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 9. Current term is 10.
I20260709 12:15:12.577199 13731 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:12.665802 13731 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.666137 13731 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.645851  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.667523  9623 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:12.646423 13910 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:12.607065 13914 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.671712  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.671706 13910 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:12.673272 13910 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.676659  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.678531  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:12.678925 13435 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:12.680305 13917 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:12.681355 13909 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.682502 13914 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.654693  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:12.647403  9619 raft_consensus.cc:2393] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:12.682071 13909 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.685731  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.698835  8999 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:12.647715  9070 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:12.644594  8920 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:12.696372  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.700549  9074 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:12.703207  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.705014  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.705648  9622 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:12.709165  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.710235  9070 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:12.716722  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.718235  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.720516  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:12.722651  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 147335us
I20260709 12:15:12.723441  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:12.726981  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.727485  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.728118  9622 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:15:12.730366  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.731150  8995 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:12.732079  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.732815  9068 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.733999  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.739356  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.740145  8916 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:12.718941  9072 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.743355  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.711635  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.745257  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.746285  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.748312  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.748826  9069 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.751293  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:12.753243  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:12.758080  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:12.760979  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.807914  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.808298  9068 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:12.809501  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.777119 13926 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.758965  9616 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:12.757019 13871 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:12.777894 13305 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:12.707896 13885 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:12.709157 13867 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:15:12.761420 13855 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:12.719300 13443 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:15:12.763048  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.859436  9622 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.780035  9624 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 14. Ops: []
I20260709 12:15:12.794327  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.781477  8916 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:12.769637  8920 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:12.842175 13785 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.715543 13790 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:12.756479 13928 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.150s	user 0.003s	sys 0.010s
I20260709 12:15:12.815975  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.759697 13847 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.871001  8923 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.778687 13924 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:12.751998 13913 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:12.815145  9074 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.879818  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.823495  8991 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:12.760499 13917 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:12.888155  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.844215  8888 leader_election.cc:400] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
W20260709 12:15:12.890542  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46541.4us
I20260709 12:15:12.845310  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.846716  8919 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:12.771389  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.893566  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:12.849131 13920 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.450s	user 0.005s	sys 0.009s
I20260709 12:15:12.847297 13885 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:12.849964  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.853513  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.899004  8918 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:12.854586  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.899940  9616 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:12.813969 13879 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:12.855026  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:12.817690 13873 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:12.709339 13875 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:12.864209  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:12.906553  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:12.862213  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:12.907680  8921 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.835278 13871 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:12.869201  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.869549  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:12.873577  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:12.875272  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.884881 13860 raft_consensus.cc:2764] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:15:12.882460  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.925087  9624 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:12.883731  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.925737  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.903008  9621 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.926405  9622 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:12.856621 13855 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.928480  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.904016  8923 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:12.907752  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:12.914824  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 805) took 1210 ms. Trace:
I20260709 12:15:12.915364  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.876946 13790 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:12.937080  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.918833  9068 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:12.916146  9617 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:12.888255 13848 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:12.882884 13913 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:12.890369 13917 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:12.991104  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:12.905375 13873 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.861392 13845 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:12.931142  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:13.003401  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:12.996306  9040 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:13.006115  9621 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.932339  9619 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:15:12.933426  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:12.902797 13885 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.011961  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.945288  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.013530  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.948243  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.015250  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.015955  8993 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:13.016889  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.017566  8993 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:13.018435  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.949380  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.950033  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.934885  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:12.967070  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:13.020164  8996 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:13.020255  8992 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:12.907958 13879 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.990458  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.029222 13879 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:12.924250 13871 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.997603  8997 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:12.998834  9000 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:15:12.999251  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.971200 13901 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:15:13.035902  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:13.025082  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.006552  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.007390  8921 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:13.007525  9069 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:13.020977  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:13.039824  8996 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:12.932458 13855 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:13.037655  9617 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:12.930514  8917 rpcz_store.cc:276] 0709 12:15:11.704593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.704696 (+   103us) service_pool.cc:224] Handling call
0709 12:15:11.704957 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.705155 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:11.734456 (+ 29301us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.603919 (+869463us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18000182e0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:15:12.914473 (+310554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.914534 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:12.914584 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.914647 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.914772 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27638,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":823,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6730,"spinlock_wait_cycles":4549376,"thread_start_us":308867,"threads_started":1}
I20260709 12:15:13.001921 13917 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:13.026403  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.028555  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:12.926046  8995 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:13.041558  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.056197  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:12.969373 13785 raft_consensus.cc:2764] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:15:13.052958  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:13.005273 13873 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:13.026346  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:13.004774  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:13.055728  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:13.062597  9617 raft_consensus.cc:2410] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:15:13.063951 13924 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.066551 13847 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.068951 13909 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:13.060619 13673 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:13.071707 13673 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.072052 13673 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.072142 13790 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:13.081398  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.082142  9069 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:13.083101  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.084153  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.085125  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.086030  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.086525  9069 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:13.042742 13607 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.087610 13607 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:13.087837 13395 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.000s
W20260709 12:15:13.088006 13932 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:13.088301 13395 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.088969  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.090245  9071 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:13.091729  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.100869  9622 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:13.092438  9621 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:13.049510 13845 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.109015  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:13.057262 13930 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:15:13.111171  9615 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:13.114378  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.115298  9616 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:13.022502 13912 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:15:13.118276 13912 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:13.118824 13912 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:13.051435 13731 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.120357 13913 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.121168 13731 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:13.121937  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 117226us
I20260709 12:15:13.122785 13915 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:13.123202 13915 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.123574 13915 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.123979 13845 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.124140  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:13.088014 13607 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.125566  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:13.127425 13933 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:13.130318 13848 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:13.130479 13933 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.130985 13933 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.064069 13922 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.136355  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.147337  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.147648  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:13.149606  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:13.090474 13395 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:13.132683  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:13.152453  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.148046  9068 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:13.132475 13912 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.173676  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:13.181085  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:13.171957 13921 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.003s
I20260709 12:15:13.247910  9619 raft_consensus.cc:2410] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 12:15:13.146788  9073 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:13.172921 13916 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:13.173142 13934 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:13.244750 13781 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.001s
W20260709 12:15:13.309886  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 380497us
W20260709 12:15:13.315368  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 318724us
I20260709 12:15:13.316227  9040 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:13.300557 13844 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.276352 13921 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.276995 13673 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.332545  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:13.308290 13916 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:13.329252  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:13.348536  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:13.346452  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 309497us
I20260709 12:15:13.309260 13934 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:13.304776 13914 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:15:13.354369  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 384063us
I20260709 12:15:13.350641  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:13.356680  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:13.376578  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:13.408196  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79040.4us
W20260709 12:15:13.409092  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 474279us
I20260709 12:15:13.372938  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:13.410494  8991 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:13.332464 13867 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:15:13.413978  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.409874  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:13.412683  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:13.477943  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 104017us
I20260709 12:15:13.483542  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:13.479072  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 69793.3us
W20260709 12:15:13.479194  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 106353us
I20260709 12:15:13.485074  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:13.332141 13751 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:15:13.415448 13435 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:13.411907 13951 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:13.475514 13867 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:13.480773 13919 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:13.490634 13898 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.512610 13435 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.516911 13867 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:13.556463 13940 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:15:13.547257 13939 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:15:13.521409 13898 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:13.522586 13686 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:13.593178  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 183344us
I20260709 12:15:13.594882  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:13.597057  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:13.600265  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:13.601665  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:13.603212 13922 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:13.612025  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 199314us
I20260709 12:15:13.556918 13925 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.549255 13951 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:15:13.620862 13925 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.622210 13925 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.555294 13435 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.625111 13860 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:13.625535 13860 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.625851 13860 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.626775 13874 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.627527 13961 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.628310 13961 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.628659 13955 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.628938 13961 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:13.629377 13961 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.629175 13955 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.629760 13961 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.550443 13893 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:13.631654 13955 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:13.631887 13944 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:15:13.632129 13918 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:13.632679 13918 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:13.633615 13918 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.634825 13918 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.556968 13934 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:13.637632 13938 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:15:13.619724  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 134544us
W20260709 12:15:13.635645 13941 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 12:15:13.639590  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 154614us
I20260709 12:15:13.554790 13790 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:13.621814 13948 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:15:13.627127 13607 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.000s
W20260709 12:15:13.639150 13935 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
W20260709 12:15:13.653592  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52074.3us
I20260709 12:15:13.557843 13957 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.563663 13898 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.658897  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:13.650862 13855 consensus_meta.cc:287] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:15:13.641911 13913 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.556829 13919 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.639672 13848 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:13.666426 13673 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:13.649868 13893 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:13.683477  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:13.665416 13871 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.635s	user 0.015s	sys 0.006s
I20260709 12:15:13.551721 13916 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.658372 13957 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:13.667670 13922 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.690876  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:13.694106 13947 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 12:15:13.695351 13937 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:15:13.698038 13921 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:13.702976  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.000s	sys 0.014s
W20260709 12:15:13.703380  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.014s
I20260709 12:15:13.705788  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:13.687613  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:13.708276  9067 raft_consensus.cc:606] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:13.708652  9067 raft_consensus.cc:614] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:13.710754 13874 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:13.713757 13915 consensus_meta.cc:287] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.000s
I20260709 12:15:13.659653 13607 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:13.704008  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 677666us
I20260709 12:15:13.654822 13790 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.753903  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.766933  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:13.700771  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:13.776180  8995 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:13.780721  8992 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 9: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:13.780619 13686 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:13.781814 13951 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:13.782202 13951 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:13.783067 13951 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.784384 13951 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.785391 13953 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 12:15:13.788414 13873 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 12:15:13.788924 13873 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.699167 13435 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.793532 13435 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.790441 13596 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.798214 13305 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:13.798671 13305 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:13.699043 13893 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.669333 13855 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.770895 13913 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:13.796500 13435 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:13.803628  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 102940us
I20260709 12:15:13.710691 13912 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.802827  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2645) took 1048 ms. Trace:
W20260709 12:15:13.804232  9587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.574s (SENT) [suppressed 16 similar messages]
W20260709 12:15:13.771744 13943 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
I20260709 12:15:13.690588 13847 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:15:13.700452 13957 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.767267 13673 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:13.686107 13848 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.793073 13919 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.811609  9072 rpcz_store.cc:276] 0709 12:15:12.754549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.754893 (+   344us) service_pool.cc:224] Handling call
0709 12:15:12.755328 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.755862 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.755902 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.764002 (+  8100us) log.cc:844] Serialized 26 byte log entry
0709 12:15:12.899911 (+135909us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:12.899951 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.900019 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.802550 (+902531us) raft_consensus.cc:1685] finished
0709 12:15:13.802581 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.802749 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":24734,"thread_start_us":83275,"threads_started":1,"wal-append.queue_time_us":428788}
I20260709 12:15:13.813850  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:13.808454 13781 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:13.791040 13873 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.799371 13596 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.700737 13871 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.805292 13915 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.744346 13925 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.799556 13305 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:13.916553  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 112340us
I20260709 12:15:13.819551 13922 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:13.901115  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 87308.6us
W20260709 12:15:13.906374  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 236223us
I20260709 12:15:13.819836 13673 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:13.924463  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2518) took 1062 ms. Trace:
I20260709 12:15:13.925853  9069 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:15:13.827207 13953 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.930043  8919 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:13.920147  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:13.816108 13913 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:13.916230 13910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.003s	sys 0.008s
W20260709 12:15:13.859889  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.927799  9069 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:13.816136 13435 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.924909  8920 rpcz_store.cc:276] 0709 12:15:12.861741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.862316 (+   575us) service_pool.cc:224] Handling call
0709 12:15:12.862648 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.863038 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.863072 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.869533 (+  6461us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.136109 (+266576us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:13.136149 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.136211 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.920420 (+784209us) raft_consensus.cc:1685] finished
0709 12:15:13.920440 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.924395 (+  3955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":486,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8100,"thread_start_us":257582,"threads_started":1,"wal-append.queue_time_us":425229}
I20260709 12:15:13.922252  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:13.933593  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:13.941967  8917 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.942359 13978 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:13.940023  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:13.933537  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:13.921130 13885 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.006s
I20260709 12:15:13.936260  9620 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:13.906958 13919 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:13.937202  9069 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:13.937947  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:13.965879  8923 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
W20260709 12:15:13.938663  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:13.939035  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:13.966892  8918 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.938702  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:13.967520  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:13.947093  8920 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:13.947696  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:13.936580 13910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.004s	sys 0.008s
I20260709 12:15:13.930395 13673 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.860383 13844 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:15:13.929445 13922 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.962594  8917 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:13.931897 13305 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.001004 13898 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:13.939469 13917 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
I20260709 12:15:14.003540 13917 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.005605 13917 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.006062 13860 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.935775 13873 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.975837 13912 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:13.972358 13596 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:13.959105 13885 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:13.969560 13851 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.991343 13686 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:13.997296  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 520694us
I20260709 12:15:13.958233 13751 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.936930 13953 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:13.998867 13855 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:13.999838 13909 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.006255 13979 consensus_queue.cc:1175] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd11e77b4be14e658672599b30d51e76" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 12:15:13.982446 13781 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:13.979539  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:14.010854  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:14.015060  8918 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:15:14.128424  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 148953us
W20260709 12:15:14.019083  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.129290  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:13.969167 13919 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.028077  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1007) took 1114 ms. Trace:
I20260709 12:15:14.059195  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:14.062364  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:14.063433  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.173612  8991 rpcz_store.cc:276] 0709 12:15:12.913440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.919498 (+  6058us) service_pool.cc:224] Handling call
0709 12:15:12.919899 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.410995 (+491096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.027829 (+616834us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400236ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:14.028016 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127769344}
I20260709 12:15:13.991531 13978 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:14.119077  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 86713us
I20260709 12:15:14.120028 13966 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.121142 13973 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:15:14.121598 13972 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
W20260709 12:15:14.123314 13945 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:15:14.125412 13909 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.131130  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.196223  9074 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:15:14.196734  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 1030) took 1158 ms. Trace:
I20260709 12:15:14.146963  9071 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:14.025923 13917 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.180035  9072 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:14.181061  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 194598us
I20260709 12:15:14.050046 13686 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:14.007401 13873 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:14.185640  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 126546us
W20260709 12:15:14.189967  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 127696us
W20260709 12:15:14.173321 13879 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.006s
I20260709 12:15:14.120036 13860 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.193246  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:14.268340  9066 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.062170 13607 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.126220 13898 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.179406 13919 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.197126  9074 rpcz_store.cc:276] 0709 12:15:13.038193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.130872 (+1092679us) service_pool.cc:224] Handling call
0709 12:15:14.196664 (+ 65792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.171154 13790 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.179682 13781 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.255039  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.255319  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.254048 13686 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.306475  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.256865  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.307206  8991 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:14.257774  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.191707 13848 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.272344  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.273522  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.313047  8997 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:14.274065  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.312853  8994 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:14.269845 13978 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.196465 13855 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:14.193076 13874 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:14.272789  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:14.361109  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88415.4us
W20260709 12:15:14.337073 13933 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 1.165s	user 0.014s	sys 0.001s
I20260709 12:15:14.185781 13966 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.289520  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.198036 13596 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.362263  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.301198  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.367545  9000 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:14.327828 13925 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.278439 13842 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:14.335647  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2515) took 1485 ms. Trace:
I20260709 12:15:14.301999 13731 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.310156 13867 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.003s
I20260709 12:15:14.344961  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.343487 13435 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.347702  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2648) took 1482 ms. Trace:
I20260709 12:15:14.411077  9070 rpcz_store.cc:276] 0709 12:15:12.864950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.865170 (+   220us) service_pool.cc:224] Handling call
0709 12:15:12.865569 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.865972 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.866011 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.874513 (+  8502us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.301196 (+426683us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:13.301243 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.301314 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.347408 (+1046094us) raft_consensus.cc:1685] finished
0709 12:15:14.347439 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.347626 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3412,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":2936,"thread_start_us":395396,"threads_started":1,"wal-append.queue_time_us":927223}
W20260709 12:15:14.188983 13934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.037s	sys 0.067s
I20260709 12:15:14.350607  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.425166  8995 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.425274  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.426966  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.373831 13971 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.399s
I20260709 12:15:14.427635  8916 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.429018 13953 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.371673 13972 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:14.429750 13972 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.430128 13972 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.431140 13983 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:14.431715 13983 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.366077 13978 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.435907  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.436354 13978 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.437510  9000 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:14.371387 13875 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:14.438434 13875 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.269086 13917 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.440430 13875 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.441239 13917 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.353361 13855 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:14.375151 13918 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.002s
I20260709 12:15:14.329820 13898 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:14.362540  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:14.287751  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:14.470752  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 108282us
I20260709 12:15:14.279569 13879 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.254001  9588 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:14.287547 13696 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.324680  8923 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:15:14.316823 13961 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.010s
I20260709 12:15:14.372524  8924 rpcz_store.cc:276] 0709 12:15:12.850718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.850924 (+   206us) service_pool.cc:224] Handling call
0709 12:15:12.851356 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.873068 (+ 21712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.873104 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.882718 (+  9614us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.276333 (+393615us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:13.276374 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.308349 (+1031975us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540008b6d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:14.308405 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.308456 (+    51us) raft_consensus.cc:1685] finished
0709 12:15:14.308486 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.335573 (+ 27087us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5906,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7137,"spinlock_wait_cycles":29673216,"thread_start_us":347084,"threads_started":1,"wal-append.queue_time_us":570716}
I20260709 12:15:14.381495 13999 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.382177  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2519) took 1382 ms. Trace:
I20260709 12:15:14.383522 13982 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.389492  9025 heartbeater.cc:646] Failed to heartbeat to 127.7.137.62:33577 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.137.62:33577 timed out after 15.000s (SENT)
W20260709 12:15:14.390856 13986 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:15:14.392186  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.394151  9066 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:14.398686  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.346752 13871 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.399457 13867 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.400435 13731 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.371701 13933 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.401787 13987 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:14.366582 13751 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:14.405400 13909 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.406613 13842 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.407454 13966 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.408898 13951 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:14.413295 13596 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.328514 13851 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:15:14.415566 13874 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:14.416364 13984 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:15:14.351369 13915 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.424033 13873 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.458935  8996 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:14.441819 13983 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.363667 13913 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.359194  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.473471  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:14.424791 13934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.037s	sys 0.067s
I20260709 12:15:14.475304  9618 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:14.467507 13790 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:14.480505  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 226594us
I20260709 12:15:14.479342  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.484431 13696 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.524488  8919 rpcz_store.cc:276] 0709 12:15:12.999699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.000873 (+  1174us) service_pool.cc:224] Handling call
0709 12:15:13.001185 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.932375 (+931190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.381860 (+449485us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540020f8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:14.382108 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135764352}
I20260709 12:15:14.505628 13916 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:14.468878 13855 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.527735  8925 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:14.505481  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.528296  8923 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:14.529542  8995 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
W20260709 12:15:14.533253  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 171037us
I20260709 12:15:14.602164 13305 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.602690  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.602756 13305 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.605120 13305 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.609555 13919 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.612279 13933 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.612686 13696 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.615574 14006 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:14.616128  8922 raft_consensus.cc:2368] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:14.616184 14006 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:14.617242 14006 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.621354 13842 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.622218 13686 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.410324 13781 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.522195 13975 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:14.554319  9622 raft_consensus.cc:2368] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11.
I20260709 12:15:14.554992  8999 raft_consensus.cc:2410] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:15:14.526115 13978 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:14.358438  8918 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:14.533383  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 278168us
I20260709 12:15:14.478933 13918 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.484092 13961 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.640331  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.626567 13972 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.639312  8922 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:14.647428 14015 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:15:14.647989  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.648797  9068 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:14.648888 13696 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:14.651911  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.598934 14007 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:14.558786  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 429474us
I20260709 12:15:14.562469  9621 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:14.532305 13871 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.533138 13751 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.565621  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:14.533001 13974 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.569873  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:14.572748  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.551168 13987 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:14.550805 13951 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:14.578435  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:14.578787  8996 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:14.573932  8997 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:14.581436  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:14.597056  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:14.664788  9615 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.580530 13790 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.598891  8924 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:14.669073  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:14.670218  8924 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:14.600206  8919 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:14.532166 13982 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.675855 13790 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.676229 13731 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.676934 13982 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.554739 13999 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.679158 13999 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.625842  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:14.680027  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 54267.4us
I20260709 12:15:14.626418 13851 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:14.649482 13696 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.681104 13686 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.681981 13851 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:14.682498 13696 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.682560 13851 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:14.627750 13848 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:14.628101  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.683943 13848 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:14.628641  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:14.684407 13848 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:14.629443 13916 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:14.685110  8993 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:14.634569  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.636464  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.685979  8918 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:14.686122 13991 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.685803 13916 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:14.685971  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51478.5us
I20260709 12:15:14.686699 13991 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.688243  8966 leader_election.cc:400] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:14.688602  8966 leader_election.cc:403] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:15:14.664172 13751 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.654814 13873 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:14.690775 13933 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:14.665084  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 83746.1us
I20260709 12:15:14.667564  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.672310  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.672524 14004 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:14.642697 13305 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:14.673521 14002 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:14.642609 13925 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:15:14.667688 14007 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.629657 13975 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.683207 13961 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.558782  8916 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:14.643272 13918 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.689227 13991 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:14.739365  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70519.3us
I20260709 12:15:14.740672  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.693302  8997 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:14.694410  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:14.744153  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49805.5us
W20260709 12:15:14.633795  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 160444us
I20260709 12:15:14.745343  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:14.746786  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:14.696197  9615 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
W20260709 12:15:14.673130 13957 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.844s	user 0.009s	sys 0.002s
I20260709 12:15:14.728260  8920 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:14.667546 13951 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:14.751562  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:14.751716  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:14.752187  9072 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.752354  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:14.730509  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 61579.6us
I20260709 12:15:14.716557 14002 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:14.716372 14004 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.732196 13922 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.722281 13305 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.645318 13978 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.738375 13982 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.740831 13918 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.744418  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.771000  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.748993  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.754635  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:14.755350  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:14.668442  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.757301  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.758209  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.773563  9067 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:14.758426  8919 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:14.753710 13696 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:14.758855  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:14.759326 14014 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:14.760190 13968 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:14.782799  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:14.760131 14007 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.761018 14004 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.789237  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.789937  9067 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:14.761093 14006 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.761786 13987 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:14.765290  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.726753 13607 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:14.667266 13974 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.768631  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:14.769003  9621 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:14.782096 13949 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:14.754132 14013 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:14.722589 13855 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.756498 13395 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.790671  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.791508  9588 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:14.727890 13909 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:15:14.781716 14014 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.799216  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:14.784003 13880 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:14.771765  8923 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:14.783910 13686 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:14.783864 13968 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.785173 13867 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.820071  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:14.770331 13934 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:15:14.756903 13848 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.756642 13957 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.796739 13999 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:14.825553  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:14.795926 13873 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:14.826671  8922 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:14.867553  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.834649 14014 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.835407  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.801276 13607 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:14.838588  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:14.872632  8923 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:14.837931 13880 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:14.817119 13949 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.840283  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:14.859697 13974 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.781567 14002 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.823180 14013 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.894582 14013 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:14.895689  8919 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:14.860045  9072 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
W20260709 12:15:14.861724  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 217814us
I20260709 12:15:14.898036  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.898629  9072 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:14.899475  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:14.787317 13851 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.868403  8922 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:14.833174  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:14.905217  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 72171us
I20260709 12:15:14.905411 13922 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.905925 13922 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.907939 13922 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.860198 13968 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.908376  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 809) took 1814 ms. Trace:
I20260709 12:15:14.838467 13933 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:14.861903 13896 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:14.837659 13985 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.801378 14006 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.880345  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:14.872428 13607 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:14.892983 13975 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.893873 13596 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:14.864980  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:14.900277  9072 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.902963 13978 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.909721  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:14.839577 13961 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:15:14.908816  9618 rpcz_store.cc:276] 0709 12:15:13.094250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.312215 (+217965us) service_pool.cc:224] Handling call
0709 12:15:13.327725 (+ 15510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.580046 (+1252321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.908126 (+328080us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400551254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:14.908295 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627464576}
I20260709 12:15:14.839277 13395 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:14.916261  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:14.921829  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:14.884064 13949 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.882766 13972 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:14.870841 13875 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:15:14.920372 13985 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:14.928049  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:15.129182  8995 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:14.976105  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76525us
I20260709 12:15:15.042498  8919 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:15.085840  9069 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.093477  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:14.977415 13673 consensus_meta.cc:287] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.004s
I20260709 12:15:15.135993  8993 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:15.129245  9621 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:15:15.136772  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 220582us
I20260709 12:15:15.137527  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.138448  9069 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.957125 13305 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:14.914182 13991 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:14.913630 13933 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:15.045651 14016 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:15:15.045040 14018 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 12:15:14.928254  8997 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:15.154392  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:15.134984 14002 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.141337  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:15.132716 14027 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:15:15.145385  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:15.160614  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.083472 13952 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:15:14.926414 13942 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.515s	user 0.000s	sys 0.005s
I20260709 12:15:15.150784  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:14.925841 13998 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:15.151875  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:15.157896  9072 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:15.141808 13978 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:15.145285 13999 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:15.160065  9069 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:15.184908  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:15.185652  8992 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:15:15.185812  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3288) took 1258 ms. Trace:
I20260709 12:15:15.186967  9619 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:15.187497  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.159611  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:15.162190  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.182128  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.184011  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.189214  9618 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.188692  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.184893 13855 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.191071  9623 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:15.192008  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.192580  9623 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:15.193450  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.194504  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.195550  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.196630  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.197443  9623 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:15:15.198190  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.097201 13880 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:15.199379 13845 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:15:15.200317 13957 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:15.203259 13879 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.204967  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:15.206009  9073 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 10: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:15.239382 14031 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:15:15.240552 13985 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:15.244369  9000 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:15:15.244768  9000 pending_rounds.cc:85] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 7
I20260709 12:15:15.244974  9000 pending_rounds.cc:107] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:15:15.245203  9000 raft_consensus.cc:2889] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:15.246322  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.247108  9068 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:15.092562 14014 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.248203 13972 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:15.249318 14014 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.249744 14013 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.237656 13934 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:15:15.251628  8918 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:15.247140  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:15.254071  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:15.255223  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.255523 13975 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.255929  8919 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:15.256264 13968 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.256711  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.257387  9623 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:15.258358 13968 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:15.258517  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.209159 13998 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.259097  8919 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:15.260022  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.260594  8919 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:15.261564  8919 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:15.208818  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46679.6us
I20260709 12:15:15.187966  9069 rpcz_store.cc:276] 0709 12:15:13.927119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.927284 (+   165us) service_pool.cc:224] Handling call
0709 12:15:13.927631 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.409188 (+481557us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b540029b420. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb906f 00007f3985c31f60 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62
0709 12:15:15.085507 (+676319us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540029b420. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb8520 00007f3985c31f70 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62
0709 12:15:15.185394 (+ 99887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.185738 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78025728}
I20260709 12:15:15.262602  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.259163 13998 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:15.150182  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.266443  8917 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:15:15.347369  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:15.264294  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2638) took 2560 ms. Trace:
I20260709 12:15:15.207108  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.272856  9072 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
W20260709 12:15:15.351878  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55585.2us
I20260709 12:15:15.184093 13996 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:15.167459 13952 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:15.364269 13951 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.597s	user 0.003s	sys 0.007s
I20260709 12:15:15.365305  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:15.394757  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.143630 13673 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.400456  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:15.401187  8919 raft_consensus.cc:2376] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12. Re-sending same reply.
I20260709 12:15:15.401805 13673 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:15.237953 13305 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.404564 14013 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.405494  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.406123  9621 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:15.405934 13952 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.407466 13952 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.348496  9065 rpcz_store.cc:276] 0709 12:15:12.703430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.721867 (+ 18437us) service_pool.cc:224] Handling call
0709 12:15:12.762788 (+ 40921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.763260 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.763305 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.815858 (+ 52553us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.137238 (+321380us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:13.137294 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.137371 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.796033 (+1658662us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:15.263961 (+467928us) raft_consensus.cc:1685] finished
0709 12:15:15.263983 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.264199 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28201,"raft.queue_time_us":106,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":34640,"spinlock_wait_cycles":147551616,"thread_start_us":279837,"threads_started":1,"wal-append.queue_time_us":464923}
I20260709 12:15:15.272625 13999 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:15.187785 13978 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.479089  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.366734 13996 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:15.519781  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:15.346172 13855 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 12:15:15.200344 13880 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:15.512326 13996 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.536885  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.569114  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.565053  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:15.151770 13933 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:15.429733 13951 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.512681 14013 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:15.571843  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 203786us
I20260709 12:15:15.580554  9067 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:15.512475 14006 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:15.555080 13751 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.000s
I20260709 12:15:15.585248  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.580391 14014 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.589155  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:15.580878  9618 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:15.716327  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:15.724128  9620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 807) took 2627 ms (client timeout 2458 ms). Trace:
I20260709 12:15:15.726749  9621 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:15.727025  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 141885us
W20260709 12:15:15.729492  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 116943us
I20260709 12:15:15.728653  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:15.580560 14030 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:15.731280  8919 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:15.726555  9620 rpcz_store.cc:269] 0709 12:15:13.093664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.173326 (+ 79662us) service_pool.cc:224] Handling call
0709 12:15:15.720551 (+2547225us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540027c254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:15.720729 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676320640}
W20260709 12:15:15.736516  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.737813  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:15.740291  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.741959  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.742679  9616 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.717027 13972 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.745790  9617 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:15.791138  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 48384.3us
W20260709 12:15:15.797632  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.750545  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.823772  9067 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:15.824505  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 3299) took 1024 ms. Trace:
I20260709 12:15:15.824929  9067 rpcz_store.cc:276] 0709 12:15:14.800208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.736763 (+936555us) service_pool.cc:224] Handling call
0709 12:15:15.824428 (+ 87665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.826494 14036 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:15.792241  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.728338 13855 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.645304 13885 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:15.848476  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:15.871471  9618 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:15.867877  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3281) took 2796 ms. Trace:
I20260709 12:15:15.693747 13917 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.687757 13395 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.737648 13968 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:15.948742  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 156597us
I20260709 12:15:15.949848  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:15.827103 14036 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.879660  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:15.889434 13978 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:15.872722  9071 rpcz_store.cc:276] 0709 12:15:13.071645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.092679 (+ 21034us) service_pool.cc:224] Handling call
0709 12:15:13.092966 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.197763 (+1104797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.867640 (+1669877us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400422cd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:15.867815 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423431936}
I20260709 12:15:15.890132  9618 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:15.890156  9616 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:15.955150  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:15.890599 13951 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:15.732245 14035 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:15.910159 13305 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:15:15.744033 14012 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.170s
I20260709 12:15:15.866643 13972 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.745774 13933 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.920571 13596 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:15.924382  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.927011 13967 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:15:15.935679  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.639493 13751 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.616022 14013 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.990749 14013 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:15.647433 14014 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.947360  8919 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:15.827270 13921 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:15.991961 13921 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.992863 14014 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:15.993789  9065 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:15.972067 13949 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.828s	user 0.004s	sys 0.008s
I20260709 12:15:15.959543  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:15.946626 13982 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.161s	user 0.012s	sys 0.000s
I20260709 12:15:15.959824 14032 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:15.969187  9616 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:15.948001 13968 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.975808  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:15.979207  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:15.953367 14005 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:15.987926  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.004632  9067 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:15:15.967767 13896 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:15.681492 13999 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:15.957858  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.008715  9071 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:16.008881  8918 raft_consensus.cc:2393] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:15.964676 13395 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:15.996220  9590 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:15.941782 14034 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.108s
I20260709 12:15:15.969841 13305 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:16.020159  9072 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:15.964089 14033 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:16.003826 13951 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:16.026223 13951 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.027732 14012 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:15.982301 13596 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:16.001694  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1051) took 1220 ms. Trace:
I20260709 12:15:15.948666 13917 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:15.980183 13967 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:16.011405  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2656) took 1152 ms. Trace:
I20260709 12:15:16.003410 13968 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:16.029832  9071 rpcz_store.cc:276] 0709 12:15:14.858642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.965013 (+1106371us) service_pool.cc:224] Handling call
0709 12:15:16.011353 (+ 46340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.002615 13982 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11.
I20260709 12:15:16.029245  9616 rpcz_store.cc:276] 0709 12:15:14.782286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.965246 (+1182960us) service_pool.cc:224] Handling call
0709 12:15:15.965681 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.001406 (+ 35725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.001635 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.027276 13951 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.036154  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.038880  9067 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.006934 13896 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.059799 13896 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.060860 13896 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:16.062467 13933 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.063112  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.064268 13972 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.065152 13751 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.066190  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 833) took 1809 ms. Trace:
I20260709 12:15:16.066565 14036 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:16.032958 13607 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.074s	user 0.010s	sys 0.003s
I20260709 12:15:16.044643  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:16.011938 14005 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.052350 13844 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.054471 14012 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.054764 13395 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.002173 13949 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.055337  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.076316  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.077450  9069 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:16.056655  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:16.066795  8920 rpcz_store.cc:276] 0709 12:15:14.256303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.551598 (+295295us) service_pool.cc:224] Handling call
0709 12:15:14.728090 (+176492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.749901 (+ 21811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.065891 (+1315990us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400313150. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.066106 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405084032}
I20260709 12:15:16.069420  9073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:16.083452  9073 raft_consensus.cc:606] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:16.084008  9073 raft_consensus.cc:614] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:16.030578 13952 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 12:15:16.015588 13893 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.034879 14014 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.078996  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.090974  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.095356  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:16.096413  8921 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:15:16.088253 13998 consensus_meta.cc:287] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.005s
I20260709 12:15:16.087874 14030 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:16.107378  9071 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:15:16.108058  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 76940.7us
I20260709 12:15:16.113523  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1046) took 1364 ms. Trace:
I20260709 12:15:16.074184 13607 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.044636 13996 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.115345  9071 rpcz_store.cc:276] 0709 12:15:14.748600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.090825 (+1342225us) service_pool.cc:224] Handling call
0709 12:15:16.105640 (+ 14815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.108028 (+  2388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.113466 (+  5438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.117513  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 806) took 3016 ms. Trace:
I20260709 12:15:16.122695  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:16.107424 13880 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 12:15:16.123742  9619 rpcz_store.cc:276] 0709 12:15:13.093379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.301193 (+207814us) service_pool.cc:224] Handling call
0709 12:15:13.301499 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.187467 (+1885968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.109426 (+921959us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400496bd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.109615 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4335625984}
I20260709 12:15:16.086690 13844 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.132133 13952 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:16.137929 14013 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:16.140378  9616 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:16.140277  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:16.144171  9619 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:16.097110 14014 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.093920 13893 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.095780 13596 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.148972 13596 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.149518 13880 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:16.149912 13916 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:16.150338 13916 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.151408 13305 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:16.152043 13305 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.154404 13305 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:16.154824  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2541) took 1400 ms. Trace:
I20260709 12:15:16.155333 14013 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.155207  8924 rpcz_store.cc:276] 0709 12:15:14.754635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.754771 (+   136us) service_pool.cc:224] Handling call
0709 12:15:14.755096 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.763669 (+  8573us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:14.822652 (+ 58983us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.864153 (+ 41501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.864218 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:14.864322 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.153687 (+1289365us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b18003f1600. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419
0709 12:15:16.154596 (+   909us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b54000c9c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.154640 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.154767 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129463,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":132,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4374,"spinlock_wait_cycles":31243776,"thread_start_us":81006,"threads_started":2,"wal-append.queue_time_us":61485}
I20260709 12:15:16.157907 14013 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.158138 13996 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:16.160416  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1053) took 1377 ms. Trace:
I20260709 12:15:16.160794  9619 rpcz_store.cc:276] 0709 12:15:14.782803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.159591 (+1376788us) service_pool.cc:224] Handling call
0709 12:15:16.159895 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.160084 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.160109 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.160150 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:16.160187 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.160238 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.160362 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.161422 14014 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.146899 13952 consensus_queue.cc:1243] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:16.162077  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:16.162686  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.163462  9071 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.164981 13607 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.163028  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3292) took 1523 ms. Trace:
I20260709 12:15:16.165880 13395 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.166384  9070 rpcz_store.cc:276] 0709 12:15:14.639277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.639389 (+   112us) service_pool.cc:224] Handling call
0709 12:15:14.639660 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.645105 (+  5445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.645135 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.652181 (+  7046us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.999457 (+1347276us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18003e81e0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:16.099269 (+ 99812us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:16.099307 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.099371 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.162745 (+ 63374us) raft_consensus.cc:1685] finished
0709 12:15:16.162766 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.162968 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306,"raft.queue_time_us":6969,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12370,"spinlock_wait_cycles":2906368,"thread_start_us":99596,"threads_started":1,"wal-append.queue_time_us":1470540}
I20260709 12:15:16.168308  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.168845  9070 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:16.170543  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41290 (request call id 6) took 1386 ms. Trace:
I20260709 12:15:16.171483  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1080) took 2688 ms. Trace:
I20260709 12:15:16.171912  9617 rpcz_store.cc:276] 0709 12:15:13.483037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.495956 (+ 12919us) service_pool.cc:224] Handling call
0709 12:15:15.720935 (+2224979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.774019 (+ 53084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.170731 (+396712us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b540027c254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.171294 (+   563us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540027c250. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.171423 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5168841856}
I20260709 12:15:16.151155 13916 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.173424 13916 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:16.173570  9617 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.174324  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1056) took 1262 ms. Trace:
I20260709 12:15:16.174626  9617 rpcz_store.cc:276] 0709 12:15:14.912233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.173065 (+1260832us) service_pool.cc:224] Handling call
0709 12:15:16.173392 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.174085 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.174269 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:16.177315  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.183569  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.184473 13970 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.184613 14005 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.185065  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:16.100777 13967 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.185232 13970 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:16.185913 13967 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.186151  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.186349 13970 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.156502 13893 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.188678  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.189463 14002 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:16.141368 14033 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:15:16.107539 13998 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:16.192845  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.193532  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.193804 13998 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.195353 13998 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.196725 13917 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.198613 13844 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.122519 14030 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.199865 14030 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.200636  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2663) took 1337 ms. Trace:
I20260709 12:15:16.201025  9072 rpcz_store.cc:276] 0709 12:15:14.863469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.975491 (+1112022us) service_pool.cc:224] Handling call
0709 12:15:16.200440 (+224949us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54000e8dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.200571 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35667328}
I20260709 12:15:16.202132  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.209257  8918 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:16.210713  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:16.211687  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.223692  8919 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:16.212513  9069 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:16.170861  9070 rpcz_store.cc:276] 0709 12:15:14.784603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.169435 (+1384832us) service_pool.cc:224] Handling call
0709 12:15:16.170470 (+  1035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.216922  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.214926  8923 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:16.231372  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.233384  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:16.234555  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.240592  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.241586  8924 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:16.235463  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:16.243660  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.245298  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:16.236056  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.250733  8923 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:16.198662  8964 connection.cc:256] RPC call timeout handler was delayed by -1.02419731100008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 12:15:16.268549  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:16.271643  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.271934  8917 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.273398  8918 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:15:16.275370  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:16.187094 13970 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:16.286063  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:16.139570 14012 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.162781 13968 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:16.294874  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 78032us
I20260709 12:15:16.295635  9071 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:16.251525 13848 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.252310 13607 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:16.278630  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2649) took 1438 ms. Trace:
I20260709 12:15:16.282461  9070 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:16.297782  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:16.283381  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:16.312184  8994 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:16.278095 13751 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:16.296715  9067 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:16.303030  8996 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:16.303056  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:16.304435  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:16.316586  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:16.317003  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:16.300673  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:16.281441  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3291) took 1642 ms. Trace:
I20260709 12:15:16.318002 13305 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.280776 13970 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.317874  9066 rpcz_store.cc:276] 0709 12:15:14.638781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.638905 (+   124us) service_pool.cc:224] Handling call
0709 12:15:14.647445 (+  8540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.788617 (+141172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.788647 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.788688 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:14.788725 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.281196 (+1492471us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003f0554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.281248 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.281382 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324190080}
I20260709 12:15:16.267966 13844 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:15:16.319512 13970 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.312209  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2650) took 1471 ms. Trace:
I20260709 12:15:16.320878 13970 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.320956  9070 rpcz_store.cc:276] 0709 12:15:14.840927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.281861 (+1440934us) service_pool.cc:224] Handling call
0709 12:15:16.282223 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.311884 (+ 29661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.312140 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.322384  9070 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.322945  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2654) took 1481 ms. Trace:
I20260709 12:15:16.281658 13982 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:16.323268  9070 rpcz_store.cc:276] 0709 12:15:14.841833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.321923 (+1480090us) service_pool.cc:224] Handling call
0709 12:15:16.322220 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.322739 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.322895 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.323838 13982 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:16.314463  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.278538 13987 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:16.283056  9617 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.292438 13917 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:16.331189  9620 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:16.329090  8917 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:16.288739 14033 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:16.334475  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:16.333901  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:16.332932  9070 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.333784  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1058) took 1239 ms. Trace:
I20260709 12:15:16.337095  8997 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.337239  9617 rpcz_store.cc:276] 0709 12:15:15.094868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.205021 (+1110153us) service_pool.cc:224] Handling call
0709 12:15:16.282865 (+ 77844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.333530 (+ 50665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.333720 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.302518 13996 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.326251 13982 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.302667 13999 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:16.339378  9072 rpcz_store.cc:276] 0709 12:15:14.840590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.277773 (+1437183us) service_pool.cc:224] Handling call
0709 12:15:16.278099 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.278294 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.278319 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.278360 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:16.278399 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.278458 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.278572 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.305040 13880 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.296080 13915 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:15:16.383693  8917 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.386341  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3306) took 1299 ms. Trace:
I20260709 12:15:16.386823  9072 rpcz_store.cc:276] 0709 12:15:15.087227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.382377 (+1295150us) service_pool.cc:224] Handling call
0709 12:15:16.382707 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.382900 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.382926 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.382967 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:16.382997 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.384966 (+  1969us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.386278 (+  1312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.314554 13998 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:15:16.377092 13919 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.333444 13844 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:16.345825 13893 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.390671  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:16.395891  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.392125  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3307) took 1142 ms. Trace:
I20260709 12:15:16.420674  9072 rpcz_store.cc:276] 0709 12:15:15.249925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.387966 (+1138041us) service_pool.cc:224] Handling call
0709 12:15:16.391439 (+  3473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.391700 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.391742 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.391803 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:16.391852 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.391932 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.392062 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.337956 14002 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:15:16.390393 13982 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.337798 13987 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.343338  9067 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:16.317759 13607 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.381824 13979 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:16.345432 13917 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.343384 14033 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.423059  9072 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:16.463951  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1048) took 1692 ms. Trace:
I20260709 12:15:16.356443  8923 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:16.378926 13999 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.347878 13596 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:16.428387  9622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 804) took 3335 ms (client timeout 1980 ms). Trace:
W20260709 12:15:16.428472 14045 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:15:16.434361  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2661) took 1574 ms. Trace:
I20260709 12:15:16.378983 13880 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.331954 13751 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.435145  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:16.410101  8997 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:16.430836 13982 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.456332  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1049) took 1675 ms. Trace:
I20260709 12:15:16.556499  9618 rpcz_store.cc:276] 0709 12:15:14.780764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.965513 (+1184749us) service_pool.cc:224] Handling call
0709 12:15:15.973811 (+  8298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.975046 (+  1235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:16.099715 (+124669us) log.cc:844] Serialized 14 byte log entry
0709 12:15:16.252711 (+152996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.252765 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:16.252828 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.456014 (+203186us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b54004d3fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.456079 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.456257 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152909,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1731,"raft.queue_time_us":1187,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10657,"spinlock_wait_cycles":2298752,"thread_start_us":254419,"threads_started":2,"wal-append.queue_time_us":364158}
I20260709 12:15:16.457603  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3052) took 2184 ms. Trace:
I20260709 12:15:16.461786  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:16.559780  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 98086.8us
I20260709 12:15:16.560740  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:16.442633 13996 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:15:16.468225  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 133798us
W20260709 12:15:16.486703  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:16.563038  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:16.558923  8991 rpcz_store.cc:276] 0709 12:15:14.273577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.426257 (+152680us) service_pool.cc:224] Handling call
0709 12:15:14.426540 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.560570 (+134030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.560618 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.560678 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.560724 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.457295 (+1896571us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400290254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.457357 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.457533 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307646208}
W20260709 12:15:16.564890  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.567381  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2658) took 1708 ms. Trace:
I20260709 12:15:16.567983  9070 rpcz_store.cc:276] 0709 12:15:14.859183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.324078 (+1464895us) service_pool.cc:224] Handling call
0709 12:15:16.332668 (+  8590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.340407 (+  7739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.567022 (+226615us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b5400218c50. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.567302 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19014400}
I20260709 12:15:16.466711  9621 rpcz_store.cc:276] 0709 12:15:14.771360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.406808 (+635448us) service_pool.cc:224] Handling call
0709 12:15:15.726558 (+319750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.727187 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.463648 (+736461us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54006103d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.463860 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734615808}
W20260709 12:15:16.469600  9622 rpcz_store.cc:269] 0709 12:15:13.092726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.134266 (+ 41540us) service_pool.cc:224] Handling call
0709 12:15:16.426048 (+3291782us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54005929d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:16.428299 (+  2251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185241344}
I20260709 12:15:16.537814  9067 rpcz_store.cc:276] 0709 12:15:14.859999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.338719 (+1478720us) service_pool.cc:224] Handling call
0709 12:15:16.343131 (+  4412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.432272 (+ 89141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.432523 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.444133 13979 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.446877 13949 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.574012  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1092) took 1166 ms. Trace:
I20260709 12:15:16.454119 13966 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:15:16.625196  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 64580.9us
I20260709 12:15:16.626307  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:16.574462  9624 rpcz_store.cc:276] 0709 12:15:15.407976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.469338 (+1061362us) service_pool.cc:224] Handling call
0709 12:15:16.573341 (+104003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.573616 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:16.573640 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.573683 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:16.573726 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.573791 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.573928 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.656548  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:16.536877 13596 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:16.737188  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 292952us
W20260709 12:15:16.735843  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 449825us
I20260709 12:15:16.572619 13996 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.741325 13996 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.742596 13996 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:16.573673 13979 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.740206  9617 raft_consensus.cc:2376] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15. Re-sending same reply.
I20260709 12:15:16.618605 13982 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.619215 13919 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.826226  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 814) took 1417 ms. Trace:
I20260709 12:15:16.835348  9618 rpcz_store.cc:276] 0709 12:15:15.408497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.652029 (+1243532us) service_pool.cc:224] Handling call
0709 12:15:16.825523 (+173494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.825770 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.825810 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.825866 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:16.825919 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.825989 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.826151 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.630976 13950 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.621220 13966 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.840994  9067 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.841064  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2089) took 2092 ms. Trace:
I20260709 12:15:16.844251  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2538) took 2190 ms. Trace:
I20260709 12:15:16.861136  9624 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.866215  9617 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.871934  9624 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:16.877485  9040 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:16.878749  9040 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:16.878985 13898 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:16.806984 13847 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:16.616940 14002 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 12:15:16.848929  8916 rpcz_store.cc:276] 0709 12:15:14.748851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.748993 (+   142us) service_pool.cc:224] Handling call
0709 12:15:14.763966 (+ 14973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.801427 (+ 37461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.801457 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.801496 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:14.801532 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.840846 (+2039314us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540008c0d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.840890 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.841009 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85688064}
I20260709 12:15:16.826535 13949 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.738750 13596 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.834373 13919 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.916091  9067 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:16.850235  8925 rpcz_store.cc:276] 0709 12:15:14.654161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.654276 (+   115us) service_pool.cc:224] Handling call
0709 12:15:14.654554 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.655960 (+  1406us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:14.842201 (+186241us) log.cc:844] Serialized 14 byte log entry
0709 12:15:16.843721 (+2001520us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b1800239500. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a
0709 12:15:16.843907 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.843957 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:16.844009 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.844084 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.844197 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37302,"prepare.queue_time_us":214781,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":2244,"raft.queue_time_us":2207,"spinlock_wait_cycles":13099904,"thread_start_us":174067,"threads_started":2,"wal-append.queue_time_us":403005,"wal-append.run_cpu_time_us":1055,"wal-append.run_wall_time_us":1009506}
I20260709 12:15:16.879738 13983 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:15:16.923671  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.848809 13968 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.847560 14014 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:16.883543 13910 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.904803 13998 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:16.929522 13898 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.915417 13949 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.921073 13919 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.920809 13847 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:16.904162 13861 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:15:16.927755 13983 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:16.941359 13949 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.946725 13898 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.947341 13847 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:16.971647 14046 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 12:15:16.949527 13987 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:16.953014 13967 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.767s	user 0.006s	sys 0.004s
W20260709 12:15:16.953960 13896 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.003s
I20260709 12:15:16.929920 13731 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:16.959043  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 302610us
W20260709 12:15:16.963515  8993 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.021s	sys 0.042s
W20260709 12:15:16.943807 13916 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.768s	user 0.007s	sys 0.004s
W20260709 12:15:16.966945 14047 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 12:15:16.973605 13731 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:16.975477  8993 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.021s	sys 0.042s
I20260709 12:15:16.975849 14058 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:16.942467 13998 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:16.979676 13999 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.980248 13998 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.983878 13751 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.984496 13966 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.985639 13966 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.987715 13880 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.989516 13917 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.990257 13607 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:16.991452 14052 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:16.992010 14052 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.994055 14052 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.937391 13910 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:16.997314 13910 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:16.936893 14014 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:16.967803 14048 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:15:16.968554 13983 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:16.969317  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2652) took 2128 ms. Trace:
W20260709 12:15:17.005896  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 267480us
I20260709 12:15:16.945802 13861 consensus_queue.cc:1243] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:17.008077  9066 rpcz_store.cc:276] 0709 12:15:14.841373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.319417 (+1478044us) service_pool.cc:224] Handling call
0709 12:15:16.319774 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.390127 (+ 70353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.390162 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:16.407169 (+ 17007us) log.cc:844] Serialized 26 byte log entry
0709 12:15:16.700882 (+293713us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:16.700931 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.956091 (+255160us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b54000abc54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:16.956143 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.969022 (+ 12879us) raft_consensus.cc:1685] finished
0709 12:15:16.969043 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.969254 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3287,"raft.queue_time_us":5858,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11423,"spinlock_wait_cycles":153106688,"thread_start_us":261964,"threads_started":1,"wal-append.queue_time_us":509539}
I20260709 12:15:16.997087  9619 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:17.011638  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:16.966966 14049 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:15:17.034178  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.026409  9070 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.999935 13975 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.000136 13790 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:16.998044 13950 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:15:17.044330 13982 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.045907 13950 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:17.046345 13950 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:17.038188 13983 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:17.048681  9623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 1052) took 2266 ms (client timeout 2359 ms). Trace:
W20260709 12:15:17.049144  9623 rpcz_store.cc:269] 0709 12:15:14.782559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.197927 (+415368us) service_pool.cc:224] Handling call
0709 12:15:17.048483 (+1850556us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b5400770e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.048619 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134637440}
I20260709 12:15:17.051651 13879 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:17.032411 14052 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:17.052066 13879 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:17.052350 14052 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.052781 14052 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:17.053042 13879 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.054395 13879 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:17.056349 13848 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.001s
I20260709 12:15:17.057739  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 1095) took 1053 ms. Trace:
I20260709 12:15:17.058144  9616 rpcz_store.cc:276] 0709 12:15:16.004558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.085566 (+ 81008us) service_pool.cc:224] Handling call
0709 12:15:17.057572 (+972006us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540043a3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.057680 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101836160}
I20260709 12:15:17.059420  9615 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:17.041422 13975 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.061146  9615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 1046) took 2290 ms (client timeout 1637 ms). Trace:
W20260709 12:15:17.061546  9615 rpcz_store.cc:269] 0709 12:15:14.770741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.819723 (+ 48982us) service_pool.cc:224] Handling call
0709 12:15:17.060914 (+2241191us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b540046ee54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.061059 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5004589824}
I20260709 12:15:17.036577 14033 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.062112 13975 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:17.043184 13970 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.001s
I20260709 12:15:17.069240  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:17.065657 13851 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.079360  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 337014us
I20260709 12:15:17.077628  9066 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:17.079015  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 818) took 1120 ms. Trace:
I20260709 12:15:17.082039  9066 raft_consensus.cc:614] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:17.081650  9624 rpcz_store.cc:276] 0709 12:15:15.958308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.862505 (+904197us) service_pool.cc:224] Handling call
0709 12:15:16.870741 (+  8236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.874338 (+  3597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.078783 (+204445us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b54006ab8d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.078952 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17704320}
I20260709 12:15:17.081837  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:17.130263  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 48540.5us
I20260709 12:15:17.131283  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.047350 13982 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.042001 13790 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:17.150009  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 223401us
I20260709 12:15:17.134680 13861 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.153800  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.157763 13751 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.158488 13751 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.039747  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:17.157785  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:17.161119  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 121514us
I20260709 12:15:17.071098 13919 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.163163  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.066812 13950 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.163445 13982 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:17.137013 13596 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:17.175856  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.178504 13596 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.161988  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.185314 14002 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.186455  9587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.007s	sys 0.023s
W20260709 12:15:17.186823  9587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.007s	sys 0.023s
I20260709 12:15:17.176332 13751 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.186071 14002 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.187098  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 931630us
W20260709 12:15:17.191496  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:17.192132  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.127530 13851 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.187310 13875 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.201474  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.205641  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:17.199967  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68834.1us
I20260709 12:15:17.201032  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.205283  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.208791  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.211292  8919 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:17.213989  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:17.214854  9068 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:17.222304  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.222440 13967 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:17.222733  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.222998 13967 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.223012  9066 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:17.205662 13982 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.226446  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.229060  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.227205  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.232679  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.210143 13596 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:17.237408  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.241008  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.219347 13875 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.244796  9070 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:17.247467 13875 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:17.248291  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.266409  8919 raft_consensus.cc:2410] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:15:17.223523 13967 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.230105 13970 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:17.212427 14064 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:17.227396 13917 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.267297  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.010s	sys 0.011s
W20260709 12:15:17.268908  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:17.296051  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.011s	sys 0.012s
I20260709 12:15:17.296921  9618 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:17.261951 13982 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:17.303646  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:17.266855 13951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.016s	sys 0.008s
W20260709 12:15:17.296927  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 1.10167e+06us
I20260709 12:15:17.240785 14033 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:15:17.310005  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:17.309548 13951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.018s	sys 0.009s
W20260709 12:15:17.324105  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:17.379854  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 153490us
I20260709 12:15:17.299363 13607 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:17.304601 14064 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.310298 13847 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:17.307304 14065 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:17.385432  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 76700.8us
I20260709 12:15:17.390677  9071 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.381484  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:17.393402  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.278416 14052 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.398072  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2671) took 1198 ms. Trace:
I20260709 12:15:17.395494  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.309305 13861 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:15:17.380972 14063 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.380456 14068 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.313776 13917 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.390058 13847 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.387753 14064 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:17.417826  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 156564us
W20260709 12:15:17.418515  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 181230us
I20260709 12:15:17.417028  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2670) took 1220 ms. Trace:
I20260709 12:15:17.396935 13996 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:15:17.422333  9065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2657) took 2563 ms (client timeout 2087 ms). Trace:
W20260709 12:15:17.423815  9065 rpcz_store.cc:269] 0709 12:15:14.858915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.477323 (+618408us) service_pool.cc:224] Handling call
0709 12:15:17.422129 (+1944806us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400368154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.422263 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070992768}
I20260709 12:15:17.420377  9074 rpcz_store.cc:276] 0709 12:15:16.198913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.044163 (+845250us) service_pool.cc:224] Handling call
0709 12:15:17.044470 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.044669 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:17.282128 (+237459us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.416676 (+134548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:17.416730 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:17.416777 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.416844 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.416969 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131163,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":49,"raft.queue_time_us":1920,"thread_start_us":351009,"threads_started":2}
I20260709 12:15:17.408133 13596 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:17.397354 13982 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:15:17.427754 14063 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:17.417922 13910 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:15:17.419911 14069 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:17.471364 14063 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:17.471796 14069 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:17.471872 14063 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.472205 13910 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:17.427474 13949 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.418936 13847 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.473028 14069 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.418771 14068 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.464699 14086 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:17.476200 14086 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:17.467795  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45600.5us
I20260709 12:15:17.394888 14065 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.421212 13996 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:17.505267  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 83762.9us
I20260709 12:15:17.511910  9068 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:17.475153 13949 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.469219 14052 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.422835 13607 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 12:15:17.521772  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 126801us
W20260709 12:15:17.519757  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 125500us
I20260709 12:15:17.505825 13919 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.518288 13885 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.470690 13596 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.486351 14068 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:17.517881 14002 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:17.528517 13979 consensus_meta.cc:287] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.004s
W20260709 12:15:17.543761  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56298.8us
I20260709 12:15:17.545584  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:17.505575 14085 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:15:17.548275  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.551637 13917 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.551484 14093 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:15:17.552919 14066 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:15:17.526034 14052 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:15:17.561159  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:17.564221 13983 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.006s
I20260709 12:15:17.565238 13607 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:17.566274 13607 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.545295 13885 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.567615  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:17.568374  8919 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:17.569269 13885 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.569752 14086 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.570350 14086 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:17.570693 14086 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:17.572634 13975 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:17.572914  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.573226 13975 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:17.573606  9616 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:17.573977 14082 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:17.574472 14082 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.575065 14082 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:17.574947  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.576730  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.576947 13844 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:17.577406  8917 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:17.577454 13844 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:17.574282 13975 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.582300  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.550671 13982 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:15:17.588364 13982 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:17.588739 13982 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:17.546136 13919 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:17.590817  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.533659 13996 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.566749 13607 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.592458  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.574692  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.620497  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:17.620347  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.574301  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:17.621802  9624 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:15:17.596381  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.602133  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.627149  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.628631  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:17.629908  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.631203  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.633023  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.633733  8997 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:17.633658  8919 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.632516  9623 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:17.635504  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.636471  9616 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:17.637029  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:17.640676  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:17.642215  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:17.642817  9621 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.642388  8991 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.642542  8999 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.644958  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:17.648573  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.649609  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.646385  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:17.648612  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.650447  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:17.651165 14068 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:17.652663  8991 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:17.653369  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.656714  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.594195 13919 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:17.657083  8992 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:17.662976  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.642146 13996 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:17.664806  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.649497 14002 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:17.620267 13983 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.578711 13844 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.675086  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.675719  8991 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:17.659611  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.660105  8995 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:17.651988  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.548914 13979 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.668609  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.672050  8996 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:15:17.658772  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 151699us
I20260709 12:15:17.665211  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:17.678013  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:17.679929  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.680064  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.656486 14068 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.663594 14069 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:17.589712 13982 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.662678 13885 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:17.692557  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.675577 13921 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.693261  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.694428  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.695444  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:17.696276  9623 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:17.686862 14069 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:17.696573  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.697289  9068 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:17.697593 13607 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.697402 14069 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.698589 14069 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.698463 13951 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:17.699510 13951 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:17.699541  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.700013 13951 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:17.700752  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.700838 13951 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.702126 13951 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:17.704581  9621 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:17.664758 14091 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:15:17.716346  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 192833us
W20260709 12:15:17.688854  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.664831 14094 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.687044  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.710034  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.710445  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.708885  9621 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:15:17.712322  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.718514  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:17.719492  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.720156  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.727829  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.778540  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.729293  9000 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:17.779521 14055 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.662842 14086 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.814463  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:17.832589  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 168645us
I20260709 12:15:17.688196 14068 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:17.780126  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.779757  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:17.780625  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1049) took 1707 ms. Trace:
I20260709 12:15:17.780200  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.844790  9066 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:17.847103  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.848284  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:17.850414  8998 raft_consensus.cc:2368] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14.
I20260709 12:15:17.844758  9072 rpcz_store.cc:276] 0709 12:15:16.073022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.569379 (+496357us) service_pool.cc:224] Handling call
0709 12:15:16.569814 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.739658 (+169844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.739692 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:16.807559 (+ 67867us) log.cc:844] Serialized 26 byte log entry
0709 12:15:17.098264 (+290705us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:17.098304 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.780207 (+681903us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54004204d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:17.780258 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:17.780308 (+    50us) raft_consensus.cc:1685] finished
0709 12:15:17.780325 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.780566 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344995584,"thread_start_us":194180,"threads_started":1,"wal-append.queue_time_us":423887}
W20260709 12:15:17.798017  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77941.3us
I20260709 12:15:17.723958  8991 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:17.716431 14091 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:17.793561  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.707410 14099 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:17.684834 13983 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.853317  9074 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:17.853574  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.858932  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.819811 14101 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:17.856871  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.832535 14065 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.860263  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.867113  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:17.863595  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 205910us
I20260709 12:15:17.876773  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.877522  8998 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:17.878484  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.878505 13983 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.879575  9624 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 10: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:17.861749 14099 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.398547  9073 rpcz_store.cc:276] 0709 12:15:16.199205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.056021 (+856816us) service_pool.cc:224] Handling call
0709 12:15:17.056413 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.056630 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:17.321890 (+265260us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.397725 (+ 75835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:17.397781 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:17.397834 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.397899 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.398016 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1546,"prepare.queue_time_us":119521,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":1678,"thread_start_us":338753,"threads_started":2}
I20260709 12:15:17.892751  9074 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:17.778323 14094 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.899672  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.898159  8919 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:17.903209  8999 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:17.859793 14100 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:17.868634 14098 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.879127  8998 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:17.906419  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:17.904484  8919 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:17.852102 13982 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:17.910166  8888 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Timed out: RequestConsensusVote RPC to 127.7.137.4:33071 timed out after 1.764s (SENT)
I20260709 12:15:17.922796  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.721740 13919 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.863272 13921 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:17.904538  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:17.861172 14106 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:17.916182  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.946802  8999 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
W20260709 12:15:17.947921  9069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 1053) took 1858 ms (client timeout 1811 ms). Trace:
W20260709 12:15:17.948372  9069 rpcz_store.cc:269] 0709 12:15:16.089406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.090705 (+  1299us) service_pool.cc:224] Handling call
0709 12:15:17.947753 (+1857048us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002d41d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.947852 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275712384}
W20260709 12:15:17.918599  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61817.8us
W20260709 12:15:17.920394  9620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 815) took 2511 ms (client timeout 2064 ms). Trace:
W20260709 12:15:17.950042  9620 rpcz_store.cc:269] 0709 12:15:15.408795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.737585 (+328790us) service_pool.cc:224] Handling call
0709 12:15:17.920245 (+2182660us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540069f354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:17.920339 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362666880}
I20260709 12:15:17.950510  8889 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:17.921204  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:17.951519  8992 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:17.925309  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.874398 14101 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:17.927780 14094 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:17.929199 13967 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 12:15:17.919605 13966 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:15:17.931567 14100 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:17.934738 14064 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 12:15:17.993831 14064 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.996040 14064 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.842121 14055 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.996246 14100 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.998674 14055 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:17.957887 14095 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:17.938328  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:18.000551  8917 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.002475 13966 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:18.002908 13966 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:17.945616  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:18.003912 13966 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:17.952591  9000 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:15:18.006332  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.007014  9000 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:17.953701  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.944638 13874 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:17.955976  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:17.954270  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:17.949551 13751 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.016330  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.018805  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:18.021687  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67491.2us
I20260709 12:15:18.022261  8999 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.024730  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.026604  8925 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:18.027652  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.027923  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.029482  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:18.021266  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 75729us
W20260709 12:15:18.031044  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.025683  8919 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:18.032868  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.033221  8992 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:18.032106  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.034184  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.034861  8992 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:17.957998 13910 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:18.038196  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.040640  8999 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:17.993260 13919 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.048355  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.053673  9000 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:18.050259  8917 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:17.954258 13921 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.031666 13966 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.936749 14098 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.036772 14084 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:18.094776  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.107777  9620 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:18.103197  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.065869  9618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1059) took 2373 ms. Trace:
W20260709 12:15:18.075104  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.054085  8999 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:18.036950 13979 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.021102 14055 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.099197  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:18.071149 14075 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.607s	user 0.000s	sys 0.001s
W20260709 12:15:18.068655 14070 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.653s	user 0.000s	sys 0.002s
I20260709 12:15:18.123713  9615 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:18.059341  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.083940  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:18.087430  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.125800  8992 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.011626 14091 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.127588 14091 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.128015 13921 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.104671  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:18.088115  8997 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:15:18.094323  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.129441  9617 raft_consensus.cc:2393] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:18.130342  8917 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:18.132911 14063 consensus_meta.cc:287] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:15:18.133343 14063 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:17.955832 14106 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.137991 13790 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:18.140404 14083 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:18.140839 14083 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:18.094483  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.141767 14083 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:18.143867 14110 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:15:18.106245  9073 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:18.094563  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.108758  9065 raft_consensus.cc:2410] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:15:17.960232 13847 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.145385  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1059) took 1949 ms. Trace:
I20260709 12:15:18.146162 14063 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:17.990821 13967 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.146909 13847 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:18.109180  9618 rpcz_store.cc:276] 0709 12:15:15.692199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.836575 (+1144376us) service_pool.cc:224] Handling call
0709 12:15:16.836958 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.297425 (+460467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.065502 (+768077us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400316fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:18.065782 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056907008}
I20260709 12:15:18.147289 14098 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.116961 14101 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.148141 13751 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.148830 13751 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:18.149040  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:18.149971 14109 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:15:18.150362  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.056277  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.055789  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.110146  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:18.153661 14095 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:18.051435 13848 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.116982  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.161199  9620 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
W20260709 12:15:18.067911  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.057036  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:18.069537 14088 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.618s	user 0.001s	sys 0.000s
I20260709 12:15:18.120193 14084 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:18.143703  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.105965  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.168924  9616 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:18.145121  9070 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:18.149268 13751 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.153972  8994 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:18.153977  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:18.154587  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44541.7us
I20260709 12:15:18.174959  8998 raft_consensus.cc:2376] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15. Re-sending same reply.
W20260709 12:15:18.154806  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.170989  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:18.176321  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:18.177014  8917 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.145800  9067 rpcz_store.cc:276] 0709 12:15:16.195610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.922005 (+726395us) service_pool.cc:224] Handling call
0709 12:15:16.922327 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.926555 (+  4228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.926593 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:16.929855 (+  3262us) log.cc:844] Serialized 26 byte log entry
0709 12:15:17.227271 (+297416us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:17.227312 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.227377 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:18.068056 (+840679us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:18.145084 (+ 77028us) raft_consensus.cc:1685] finished
0709 12:15:18.145111 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:18.145328 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3869,"raft.queue_time_us":11816,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":28201216,"thread_start_us":297073,"threads_started":1,"wal-append.queue_time_us":457533}
W20260709 12:15:18.103147  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.163770  9000 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:18.112576  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.181313  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.181995  8999 raft_consensus.cc:2376] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11. Re-sending same reply.
I20260709 12:15:18.148213  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.182720  9618 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:15:18.121254  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:18.184619  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.187441  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.187698  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.188391  8992 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:15:18.190151 13898 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.190834 13985 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.174695 13848 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.191378 13985 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.193454 13848 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.193549 13985 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.194080 13848 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.194578 13848 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.190702 13898 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.197253 13898 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.198117  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:18.191424 13950 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:18.199576 14067 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.807s	user 0.000s	sys 0.002s
W20260709 12:15:18.200091  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78936.4us
I20260709 12:15:18.199936 14084 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.200874  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1093) took 2792 ms. Trace:
I20260709 12:15:18.201241  9622 rpcz_store.cc:276] 0709 12:15:15.408295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.570967 (+1162672us) service_pool.cc:224] Handling call
0709 12:15:16.651573 (+ 80606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:16.827901 (+176328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.827946 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:16.828515 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:15:17.145339 (+316824us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:17.145387 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.145465 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:18.198914 (+1053449us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:18.200584 (+  1670us) raft_consensus.cc:1685] finished
0709 12:15:18.200611 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:18.200818 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175865,"raft.queue_time_us":179748,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10479,"spinlock_wait_cycles":28178304,"thread_start_us":237015,"threads_started":1,"wal-append.queue_time_us":447975}
I20260709 12:15:18.203302  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.204139  8918 raft_consensus.cc:2410] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:15:18.205081  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.205884  8991 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:18.206732  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.207685  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:18.208742 14089 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.741s	user 0.000s	sys 0.003s
I20260709 12:15:18.208846  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.209503  9000 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:18.209792 13848 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:18.178958 14082 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
I20260709 12:15:18.210307  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.210503 14082 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.179289 14105 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.167529 13979 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:15:18.213330 13851 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.215348 13967 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:18.187314 13921 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.217226 13921 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:18.217525  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.218129 13921 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:18.218747 14077 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.801s	user 0.002s	sys 0.000s
I20260709 12:15:18.216516  8991 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:18.223366  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.227032  9067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:18.154215 14095 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:18.256243  8917 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:18.393909  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:18.228878  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.231101  8996 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:18.230813  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:18.307551  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.403172  9067 raft_consensus.cc:606] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.404410  9067 raft_consensus.cc:614] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:18.407203  8922 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:18.416388 14095 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:18.419723  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.021s	sys 0.039s
W20260709 12:15:18.420365  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.039s
I20260709 12:15:18.421387  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:18.422459  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:18.421852  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 193341us
W20260709 12:15:18.423115  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:18.424331  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 193622us
I20260709 12:15:18.422150  8917 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:18.426015  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 233543us
I20260709 12:15:18.427377  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:18.414932 13996 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 12:15:18.438974  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.440433  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.441128  8998 raft_consensus.cc:2376] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12. Re-sending same reply.
I20260709 12:15:18.442248  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.407008 13985 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:18.454583  9068 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:18.454704  9616 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:18.429396  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.429674  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.430583  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:18.456920  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49092.8us
I20260709 12:15:18.457647  9615 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:18.432103  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:18.459692  9623 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:18.406418 13951 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.461231  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.419783 13898 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.462574  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.465131  9615 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:15:18.230034 13896 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:18.461668  8917 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:18.188987 13966 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.264s
I20260709 12:15:18.497393  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.431121 14055 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.498318  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:18.501866  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:18.425806 13917 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:18.503297  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.504364  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.511401  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:18.511621  9615 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:18.512353  9623 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:18.513549  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.509684  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.515115  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.516213  8998 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:18.516705  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:18.519388  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:18.465984 14068 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.003s
I20260709 12:15:18.465617 13979 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.523705  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.510602 13975 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.525723  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:18.532586  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.468219 13919 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.568145  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.566138  9615 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:18.571460  8923 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 12:15:18.459642 14064 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:15:18.506031 13951 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:18.507925 14084 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:18.582301  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 56684.6us
I20260709 12:15:18.583662  9588 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:18.585824  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.586947 14097 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:18.587405 13975 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:18.587599 14097 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:18.588056 13975 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:18.588758 14097 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.589049 13975 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.525462 13790 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.571833 13979 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.508023 13898 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.594340  8920 raft_consensus.cc:2410] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:15:18.573041 13917 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:18.512894 14055 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.596184  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:18.584209 14084 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:18.467468 13985 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.525511 14124 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.521567 13847 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.505542 13896 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.526000 13874 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:18.602809  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 175478us
I20260709 12:15:18.594934 13951 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.564177 14068 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.609647  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:18.575700 13919 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:18.620934  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.624553  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.609506 14084 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:18.610606 13910 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.624935  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.619266 13874 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:18.636089  9619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 1096) took 2486 ms (client timeout 1764 ms). Trace:
W20260709 12:15:18.674521  9619 rpcz_store.cc:269] 0709 12:15:16.149237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.161819 (+ 12582us) service_pool.cc:224] Handling call
0709 12:15:18.635895 (+2474076us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540069e954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:18.636010 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867777408}
I20260709 12:15:18.673544  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:18.678681  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95149.4us
I20260709 12:15:18.679817  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:18.639423  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.639834 14126 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:18.641762  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.642023 14055 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.633455 14111 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:18.644188 14106 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:18.616541 14124 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.645717 13898 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.647362 13875 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:18.699787 13875 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:18.700556 14118 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:15:18.687093 14126 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:18.701116 14126 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:18.700802 13875 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.633628  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:18.703172  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69883.7us
I20260709 12:15:18.704025  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.655179 14128 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.696396 14127 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:18.706401  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.706305 14128 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.707136  8997 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:18.708170  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.708565 14128 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.709544  8997 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.706422 14127 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.656495  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1777) took 2371 ms. Trace:
I20260709 12:15:18.656730 13985 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.663561  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2660) took 3803 ms. Trace:
I20260709 12:15:18.664553 13896 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.629598 13999 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:18.671118  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.671865 14014 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.625636 13919 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.664562  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.624435 14005 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.627533 13847 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.682017  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.725720  9070 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:18.638298  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.688766  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:18.635917 14101 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:18.644114 13751 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.676803 14100 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.674242 13874 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.731953  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:18.732764 13751 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.679363 14033 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.733152  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.697280  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.734019  9073 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:18.734148  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.684777 13998 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.734943 13998 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.718724  9071 rpcz_store.cc:276] 0709 12:15:14.859750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.329638 (+1469888us) service_pool.cc:224] Handling call
0709 12:15:16.329932 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.392285 (+1062353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.663312 (+1271027us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000ab254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:18.663483 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438916352}
W20260709 12:15:18.721959 14125 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:15:18.753676  8991 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:18.722568 14130 consensus_queue.cc:1059] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:18.722960 14127 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:18.692624 14111 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:18.755157 14111 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:18.756258 14119 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:15:18.727149  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88925us
I20260709 12:15:18.714301  8993 rpcz_store.cc:276] 0709 12:15:16.285148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.285280 (+   132us) service_pool.cc:224] Handling call
0709 12:15:16.285557 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.453272 (+167715us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:16.976037 (+522765us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.304991 (+328954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:17.305066 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:17.305138 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.656230 (+1351092us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400196c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:18.656283 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:18.656406 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16425,"prepare.queue_time_us":490618,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":109905,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2706,"spinlock_wait_cycles":384968064,"thread_start_us":834488,"threads_started":2,"wal-append.queue_time_us":551509,"wal-append.run_cpu_time_us":1146,"wal-append.run_wall_time_us":1026543}
I20260709 12:15:18.728343 13979 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.730551  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.758832  8991 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:15:18.738425  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:18.761014  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:18.760056  8993 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:18.738689  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.719961 13999 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:18.757663  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:18.763002  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.768538  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:18.768639  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:18.759706  9000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.009s
I20260709 12:15:18.764160  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.771766  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.773329  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.774724  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.757488  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:18.765583  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 61623.2us
W20260709 12:15:18.778402  9000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.009s
I20260709 12:15:18.736719 13896 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.782071 14093 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.784082 13987 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:18.784523 13987 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.784881 13987 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:18.786928 14121 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.787389  9070 raft_consensus.cc:2368] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14.
I20260709 12:15:18.769775  8916 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:18.788878  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:18.789470  9069 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.789359  8966 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.790308  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.792187  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:18.797821  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:18.798445  8916 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.800108  9074 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:18.800309  9070 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:18.800661  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.753193 14014 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.801678  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:18.724481 14012 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:15:18.803169  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:18.757997 14033 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:18.803432  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:18.803028  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 110079us
I20260709 12:15:18.805895  8921 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:18.758459 13966 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.807979  9072 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:18.769923 13921 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.866701  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:18.804703  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:18.770547 13999 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:18.865329  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76034.4us
I20260709 12:15:18.758059 14131 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.875176  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.767019 14106 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.809170 13951 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:18.867419  9066 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:18.867976  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68670.4us
I20260709 12:15:18.888176  8889 leader_election.cc:400] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14.
I20260709 12:15:18.888528  8889 leader_election.cc:403] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.737118 14005 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:18.873813  9069 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:18.797340 14121 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:18.881037  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.881513  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.881991  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.899264  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.882419  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.757326 14100 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.805028 13847 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:18.883028  9065 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.815439 14055 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:18.802567 13979 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.862541 14063 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.910339 14093 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:18.892130  9073 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:18.894923  8916 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:18.912899  8916 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:18.883143 13998 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:18.922019  8993 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:18.862185 14014 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.930814  9070 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:18.908762 14111 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.910178 14063 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.911712 14093 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:18.940553  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68852.1us
I20260709 12:15:18.906231 13975 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14.
I20260709 12:15:18.908638 14101 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:18.928335 14120 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 12:15:18.893723  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:18.876567 13861 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.905795 14068 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.904392 13847 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.941303  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.913784 13790 raft_consensus.cc:2764] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:18.950129  9624 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:18.950941  9066 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 10.
I20260709 12:15:18.888924 14106 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:18.948237 13998 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:15:18.958765 14081 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.491s	user 0.004s	sys 0.000s
I20260709 12:15:18.960326 14063 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:18.960783  9588 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:19.009968  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49257us
I20260709 12:15:19.010742  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.962703 14086 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:18.965749 13848 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.956424 13847 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:18.970826 14092 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:19.019665 13848 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:18.933908 14055 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:19.012745  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:18.962984 14111 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.050480  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:19.051760  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 176669us
I20260709 12:15:19.051940  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:18.948603 14101 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:18.971802 14123 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:19.045535  9615 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:19.054781  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:19.021510 14092 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:19.081897  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.104918  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:19.059906 14131 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:19.045143 13966 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.056826  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.058471  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:19.119199  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:19.045251 14147 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:15:19.056597  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 167317us
W20260709 12:15:19.071341  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58645.4us
I20260709 12:15:19.108737  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2115) took 1956 ms. Trace:
I20260709 12:15:19.123544  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.096746  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:19.124249  9065 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:19.123620  8924 rpcz_store.cc:276] 0709 12:15:17.152062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.155382 (+  3320us) service_pool.cc:224] Handling call
0709 12:15:17.155813 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:17.156307 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:17.156351 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:17.156976 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:15:17.388578 (+231602us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:17.388631 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.388716 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:18.951781 (+1563065us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:19.100850 (+149069us) raft_consensus.cc:1685] finished
0709 12:15:19.100871 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:19.108657 (+  7786us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7862,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":27334,"spinlock_wait_cycles":14962048,"thread_start_us":231129,"threads_started":1,"wal-append.queue_time_us":271216}
I20260709 12:15:19.022972 14130 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.956606 14033 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.042693 14127 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:15:19.044166 13848 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.099284 14123 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:19.060137 13921 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:15:19.145143  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 92696us
I20260709 12:15:19.148602  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:19.146725  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.150945  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.151611  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:19.152398 14138 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:15:19.151633  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.154458  9069 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.113916 14131 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.155812  9065 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:19.151650  9073 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:19.162706  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.062028 14014 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.163950  9066 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:19.170287  9069 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:19.170543  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.174201  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:19.176303  8994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 3073) took 1482 ms (client timeout 1508 ms). Trace:
I20260709 12:15:19.177605  8991 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:15:19.176774  8994 rpcz_store.cc:269] 0709 12:15:17.693985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.694224 (+   239us) service_pool.cc:224] Handling call
0709 12:15:19.176121 (+1481897us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54000f5ad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.176241 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055609088}
I20260709 12:15:19.104337 13874 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.181375  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.182029  9624 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:19.182682  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.139689 14127 consensus_queue.cc:1243] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:19.185992  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.187002 14142 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.138s
W20260709 12:15:19.187698 14140 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:15:19.188829 14146 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:19.191841 13844 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.197167 13596 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.147871 14092 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.204583  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.205204 14100 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:19.205336 14084 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.007s
I20260709 12:15:19.154489 14093 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:19.206736 13917 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260709 12:15:19.208016 14106 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.208743  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 865) took 1302 ms. Trace:
I20260709 12:15:19.268867  8920 rpcz_store.cc:276] 0709 12:15:17.906066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.906179 (+   113us) service_pool.cc:224] Handling call
0709 12:15:19.208520 (+1302341us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400245c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.208654 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556327296}
I20260709 12:15:19.209280  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2553) took 1165 ms. Trace:
I20260709 12:15:19.162238 14131 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:19.211397 14124 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.211730 14096 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.213760  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:19.288371  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 74681us
I20260709 12:15:19.289222  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.289863  8920 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:19.290681  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.291501  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.214989 14014 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:19.215693  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.216046 13975 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:19.221650  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.185412  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:19.295698  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 74175.7us
I20260709 12:15:19.246905 13898 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.179924 13731 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.249504  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.298666  8925 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:19.255085  8995 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:19.300566  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:19.295146 14097 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:19.303588 14097 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.303941 14097 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:19.307062 14082 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:19.308213  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.604s (SENT) [suppressed 36 similar messages]
I20260709 12:15:19.256225 13874 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.256603 14005 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.257050 14149 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.239403 14146 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.258610 13921 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.249250 14123 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:19.262384 14126 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 12:15:19.219012 14055 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.269902  8922 rpcz_store.cc:276] 0709 12:15:18.044156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.044628 (+   472us) service_pool.cc:224] Handling call
0709 12:15:19.209127 (+1164499us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54000cbcd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.209227 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647863680}
I20260709 12:15:19.292719  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.293049  9074 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:19.127307 13966 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.270852 14084 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.297987  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.311878  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1784) took 1594 ms. Trace:
W20260709 12:15:19.315029  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 129668us
I20260709 12:15:19.334510  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:19.288451 13917 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:19.294869 14063 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:15:19.317422 13896 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.295917 14106 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.309144 13861 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.300266 14096 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.333616  9000 rpcz_store.cc:276] 0709 12:15:17.717492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.218376 (+500884us) service_pool.cc:224] Handling call
0709 12:15:18.218662 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:18.219351 (+   689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:18.219380 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:18.219877 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:15:18.778883 (+559006us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:18.778924 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.778999 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:19.311685 (+532686us) raft_consensus.cc:1685] finished
0709 12:15:19.311709 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:19.311824 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":195,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":558654,"threads_started":1,"wal-append.queue_time_us":584264}
I20260709 12:15:19.339614  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.317763 13970 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.320076 14146 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.310917 14093 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 12:15:19.400825  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 61338.5us
I20260709 12:15:19.322283 14156 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:19.327805 14082 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:19.373965 13998 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:19.308873 13898 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.387486 14005 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:19.372573 14086 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.374631 13921 raft_consensus.cc:2764] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:15:19.403292 13970 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.329366 14126 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.400377 14014 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:19.411128 13975 consensus_queue.cc:1243] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:15:19.416332 14150 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:15:19.407979 14156 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:19.402552 14106 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.398061 13896 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.402185 13861 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.322256 14149 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.415086 13998 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.406198 14136 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:19.485271 14137 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:19.542872 14126 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:19.548911 13919 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
W20260709 12:15:19.525971 13999 consensus_meta.cc:287] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.007s
I20260709 12:15:19.296799  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:19.636690  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 342034us
I20260709 12:15:19.590621 14137 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:19.336781  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:19.641848  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 479013us
I20260709 12:15:19.653669  9623 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:19.641839  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 333429us
I20260709 12:15:19.659106  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.661226  8924 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:19.663668  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2137) took 1095 ms. Trace:
I20260709 12:15:19.666604 13885 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.525048 13966 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.589504 13998 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.422396 14142 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:19.730990  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.731583 14142 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:19.732041  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.733170  9623 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:19.733309 14142 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.734722  9616 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:19.530145 14146 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.419689 13848 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.674345 13919 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.551179 14092 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.594482 14097 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.734841 14142 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.586908 14156 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.426046 14005 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.767962  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1801) took 1343 ms. Trace:
I20260709 12:15:19.768455  8991 rpcz_store.cc:276] 0709 12:15:18.424371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.761060 (+336689us) service_pool.cc:224] Handling call
0709 12:15:19.177287 (+416227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.177990 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.767522 (+589532us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000f5ad0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.767745 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956606208}
I20260709 12:15:19.769127 14005 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.640352  8916 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:15:19.589845 14136 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.770784 14136 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.772629  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2565) took 1154 ms. Trace:
I20260709 12:15:19.773048  8916 rpcz_store.cc:276] 0709 12:15:18.618194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.920893 (+302699us) service_pool.cc:224] Handling call
0709 12:15:18.930508 (+  9615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:19.770475 (+839967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.772243 (+  1768us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400331154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.772533 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630038784}
I20260709 12:15:19.701023 14126 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:19.776003  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:19.598291 14131 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.776496 14126 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.595316 14106 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.635437  8919 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:19.670993 13950 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:15:19.418041 13898 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.496397 14083 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.600180 14149 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.796820  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.797857 14085 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.798122  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.798667 14085 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.800658 13848 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.801194 14085 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.415042 14082 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.802446  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:19.803993 13996 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:19.804418  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.805119 14082 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.806228  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:19.497120 14100 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:19.676319 13999 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.808295  9071 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:19.449928 13987 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
I20260709 12:15:19.809187 13898 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.809506 13999 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.809330 13987 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.810310  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3324) took 1056 ms. Trace:
I20260709 12:15:19.810447 13999 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:19.488497 14099 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:19.696633  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 359738us
I20260709 12:15:19.702695  8924 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:19.677917  8920 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:19.693789  9072 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:19.718423 13885 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:19.684746  9068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2677) took 1975 ms (client timeout 1604 ms). Trace:
I20260709 12:15:19.697266 14137 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.718700 14105 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:15:19.723773 13847 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.000s
I20260709 12:15:19.675173 13975 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.724028 14014 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.725520  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46402 (request call id 0) took 1505 ms. Trace:
W20260709 12:15:19.835543  9068 rpcz_store.cc:269] 0709 12:15:17.709543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.709742 (+   199us) service_pool.cc:224] Handling call
0709 12:15:19.684272 (+1974530us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003ee9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.684481 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683033472}
I20260709 12:15:19.749866 14097 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.500042 14101 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.752408  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.848349  8922 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:19.848649  8925 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:19.699090  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:19.849855 14085 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:19.850108  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 151287us
I20260709 12:15:19.850483 14101 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.753450 13861 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.697995 14168 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:15:19.852020 14168 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:19.852164  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.852617 14168 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:19.699836 14143 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:19.685165 14166 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:19.853264 14143 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.853725 14143 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.853798 14166 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.758066  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2556) took 1602 ms. Trace:
W20260709 12:15:19.741935  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.746376  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.738056 14146 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.742030 13919 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:19.780421  8995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 3060) took 2089 ms (client timeout 2015 ms). Trace:
I20260709 12:15:19.855576  8923 rpcz_store.cc:276] 0709 12:15:18.155914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.156069 (+   155us) service_pool.cc:224] Handling call
0709 12:15:18.156410 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:18.572317 (+415907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.757356 (+1185039us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001e55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.757852 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934023040}
I20260709 12:15:19.793063  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:19.793632 14174 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.079s	user 0.001s	sys 0.002s
I20260709 12:15:19.807255 14100 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:19.808460 13844 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:19.538245 14123 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.861865 14100 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.862429  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.746735 13966 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.863336  9073 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:19.810724  9071 rpcz_store.cc:276] 0709 12:15:18.753612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.754656 (+  1044us) service_pool.cc:224] Handling call
0709 12:15:18.770476 (+ 15820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.808705 (+1038229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.809955 (+  1250us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000e7ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.810235 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385885952}
I20260709 12:15:19.795290 14084 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.819228  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.819614  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.779212 14131 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:19.828969  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.832149  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:19.688270 13896 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.866353  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:19.867726  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.868048  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.869206  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.869374  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.869868 14149 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.870434  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.870743 14148 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:19.871110  9620 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.871613 14148 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.872263  8919 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:19.839993  9622 rpcz_store.cc:276] 0709 12:15:18.219773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.219892 (+   119us) service_pool.cc:224] Handling call
0709 12:15:19.724743 (+1504851us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54007611d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c41735 00007f3985c399fa 00007f398ac014c9 00007f398417dc54 00007f398417dbe2 00007f398417db11 00007f398417da8c 00007f398417cd42 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.725254 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403169152}
I20260709 12:15:19.841647 13847 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.874549 14148 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.843734 13975 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:19.847363  8918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.007s
I20260709 12:15:19.866487  9623 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:19.676334 14154 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.854347 14137 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:19.743135  9067 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:19.852065  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 45980.1us
I20260709 12:15:19.702821  8917 rpcz_store.cc:276] 0709 12:15:18.568362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.568508 (+   146us) service_pool.cc:224] Handling call
0709 12:15:18.568839 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:18.618893 (+ 50054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:18.618923 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:18.618962 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:18.618999 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.662969 (+1043970us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b540008c0d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.663082 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:19.663420 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114658048}
I20260709 12:15:19.783034 14136 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.859788  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.859886 13844 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:19.866451 13996 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.841663 14126 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.840996 13985 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.838027 13950 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.863075 14100 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.850270 14085 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:19.857712  8995 rpcz_store.cc:269] 0709 12:15:17.690516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.692276 (+  1760us) service_pool.cc:224] Handling call
0709 12:15:19.779896 (+2087620us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540039b7d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:19.780114 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3591886592}
I20260709 12:15:19.875707 13847 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.882323 13844 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:19.884512  9070 raft_consensus.cc:1217] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[9.9-15.12]   Dedup: 9.9->[11.10-15.12]
I20260709 12:15:19.890673 13998 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.906343  9070 pending_rounds.cc:85] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 9
I20260709 12:15:19.906689  9070 pending_rounds.cc:107] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:15:19.906992  9070 raft_consensus.cc:2889] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:19.884931 13975 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.885718 13987 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.886049  8918 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:19.887627  9040 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.839779 14005 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:15:19.888839  8917 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:19.889258  8921 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:19.870455 14149 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.882349  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:19.877085 13861 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:19.893949  9071 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
W20260709 12:15:19.903369  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.881758  9074 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:19.917793  8920 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:19.903680  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:19.878085 13885 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.908030 13919 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:19.894675 13996 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.887038 13970 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.908339 13950 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.907068 13985 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.882333 14154 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.921490  8889 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.922442  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:19.912348  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:19.889616  9615 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:19.905356  8924 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.915427  9068 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:19.915886  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.920333  9066 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 18. Ops: []
I20260709 12:15:19.916150 14005 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:19.905695 14085 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:19.924155  9073 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.922439 13861 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:19.919941 14126 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.933034  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:19.925119 14005 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.937371 14146 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:19.937927 14146 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.938318 14146 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.939607 14126 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:19.939813 13861 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:19.925855 14097 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:15:19.942423 14126 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:19.942925 14005 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.945917 14099 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:19.946592 14091 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:19.948408 13885 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:19.947714 14158 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:19.959496 13950 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:19.960616  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:19.961922  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2563) took 1374 ms. Trace:
I20260709 12:15:19.960795  9615 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:19.956187  9073 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:19.962309  8921 rpcz_store.cc:276] 0709 12:15:18.597189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.867629 (+270440us) service_pool.cc:224] Handling call
0709 12:15:18.886528 (+ 18899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.918605 (+1032077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.961628 (+ 43023us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000cb7d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:19.961865 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275356032}
I20260709 12:15:19.965485  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:19.966840  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46899.7us
I20260709 12:15:19.968658  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:19.967944 14126 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:19.971158 14126 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.971650 14126 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.955835 13885 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:19.976166  9074 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:15:19.949440 14084 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:19.968003 14097 consensus_queue.cc:1243] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:19.955502 14149 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:19.962927 14158 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:19.985435  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 94064.8us
I20260709 12:15:19.978731 13885 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.000402 13996 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:20.003759 14156 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.004634  8924 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.007993 14158 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.009577 14158 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.010409 13985 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:20.021021 14131 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:20.022022 14055 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:20.022496 14055 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:19.980201 14084 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:20.029507  9620 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:19.985209 14101 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:20.030715  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:20.035876 14084 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:20.059252  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:20.044090 14101 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:20.052969 14136 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.095646  9066 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:15:20.093591  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 137877us
W20260709 12:15:20.102041  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.103434  9615 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.104048  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:20.105063  9072 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:20.113334  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 74577us
I20260709 12:15:20.114444  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:20.115530 13999 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:20.115702 13985 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:20.115971 13999 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.116284 13985 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.116544 13999 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.116746 13985 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.084029  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.082906 14156 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.121572 14101 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.123631  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.124709  9615 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:20.063473 13970 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.081960 14154 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:20.092150 14175 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 12:15:20.092708  8999 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:20.127945  9068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:20.129400 13898 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.130259  9069 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:20.130678  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 64265.6us
W20260709 12:15:20.130198  8999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 3098) took 1997 ms (client timeout 2158 ms). Trace:
W20260709 12:15:20.136297  8999 rpcz_store.cc:269] 0709 12:15:18.132828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.187150 (+ 54322us) service_pool.cc:224] Handling call
0709 12:15:20.129946 (+1942796us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54001a1dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:20.130145 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379286912}
I20260709 12:15:20.137075  8818 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:20.083830 13998 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.141785  9069 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:20.142505 14149 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:20.144388 14148 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:20.144830 14148 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:20.145787 14148 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.071869 14168 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.149372 14156 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:15:20.162103 14168 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.162446 14156 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:20.155936  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.093961 14069 raft_consensus.cc:2764] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:20.167176 14055 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.168574 14055 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.174876  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.175490  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.175796  8999 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:20.084784 13917 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:20.176493  8992 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:20.176648 13917 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:20.177752 13917 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:20.179456  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.180207  9615 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:20.087735 14166 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.157693 14097 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:15:20.158710  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:20.189581  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:20.198757  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.194701 13996 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:20.159526  9068 raft_consensus.cc:606] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:15:20.201829  9068 raft_consensus.cc:614] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:20.194012 14136 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:20.196587  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.205849  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.162966 14156 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:20.179090 13917 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:20.209437  9072 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:20.144136  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:20.210477  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.203680  9619 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:20.213867  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.213311  8992 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:20.147202 14148 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.218353 14097 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:20.234251  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.139019  8818 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 7 to 9, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 9 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.238152  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.237838  8818 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 7, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 7 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:20.238812  8923 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:20.239279  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.219132 14166 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:20.239604  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.239867  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.240237 14166 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:20.218341  8919 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:20.221681 13970 consensus_queue.cc:1059] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:20.241289 14166 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.242329 13970 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:20.242782 13970 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.219837 13996 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:20.223507  9066 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:20.222127 13998 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:20.218549  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.238988  8921 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.240408  8917 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:20.239923  8918 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:15:20.224891 14156 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.246033  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.246912  8925 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.244166  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:20.247182 14154 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.250455  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.252019 13970 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:20.253100  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.253309 13970 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.257253  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:20.288978  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.082646 14005 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:20.297540  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52179us
I20260709 12:15:20.246970 13996 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.305084  9619 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:20.292093 14142 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.004s
I20260709 12:15:20.247388 13998 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.187067 14084 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.325397  8923 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:20.325912  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 181905us
I20260709 12:15:20.310640 13996 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.332314  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:20.312525 14131 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:15:20.354921  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:20.333954 14091 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.359202 14083 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.362555  8923 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:20.359292 13844 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.367045  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.367600  9065 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.367703  9616 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.369344  9074 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:20.369249  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.343673 14156 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.373042  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.339382 14149 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:20.375324  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:20.377192  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.311475 14143 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.359915 14142 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:15:20.379153  8999 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:15:20.378072  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 161035us
I20260709 12:15:20.351797 13966 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:20.375404  9066 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:20.336735 14136 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:15:20.359882 13861 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:20.353242 13985 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.422904  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.379273 14137 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:20.442102  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.441807  8818 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 7 to 10, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.442830  9074 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:20.443905 14121 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:20.444711 14121 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:20.448876 14161 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:15:20.368546 14091 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.454138 14091 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.455325  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.456151  9621 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:20.431511  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.478500  9619 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:20.482520  9622 pending_rounds.cc:85] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 10
I20260709 12:15:20.482920  8992 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:20.482992  9622 pending_rounds.cc:107] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:15:20.483886  9622 raft_consensus.cc:2889] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:20.485111  9065 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:15:20.497962  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:20.477355 14146 consensus_meta.cc:287] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.002s
W20260709 12:15:20.508045  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:20.508731  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.510178  8991 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:20.459157 13844 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.512898  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.519132  9074 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:20.516443  8924 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:20.525417 14063 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.503159 14092 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.540280  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.541062  8920 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:20.541379  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2151) took 1327 ms. Trace:
I20260709 12:15:20.541805  8924 rpcz_store.cc:276] 0709 12:15:19.214018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.368284 (+154266us) service_pool.cc:224] Handling call
0709 12:15:19.368696 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.660821 (+292125us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540009cf20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb2dc0 00007f3985c3d1c0 00007f3985c3e231 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c
0709 12:15:20.004423 (+343602us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540009cf20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb0a1d 00007f3985b971a4 00007f3985c19447 00007f3985c31fe7 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419
0709 12:15:20.520293 (+515870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.541310 (+ 21017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722284288}
I20260709 12:15:20.499184 14097 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:15:20.568302  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:20.497159 14154 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:15:20.523522 14083 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:20.572553  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.504015 14137 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.503412 13861 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.576365  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:20.516839 14146 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.577777 13874 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:15:20.578078 14123 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.002s
I20260709 12:15:20.580659  9000 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:15:20.514079 13919 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:20.575726  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.483493 14149 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.551505 14014 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.609522  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.610555  9074 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:20.611344  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 201312us
I20260709 12:15:20.574426  8925 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
W20260709 12:15:20.594668 13885 consensus_meta.cc:287] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
W20260709 12:15:20.595568  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 215384us
I20260709 12:15:20.526198 14063 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.604547  9000 pending_rounds.cc:85] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 6
I20260709 12:15:20.613232  9000 pending_rounds.cc:107] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:15:20.613502  9000 raft_consensus.cc:2889] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:20.571816 14100 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.594044  9621 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:20.608825  8999 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:20.446130 14121 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.640841  8995 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:20.594696 13898 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 12:15:20.641646  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.592790 14005 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:20.644506  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:20.573460 14092 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.647181  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.608378 14083 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.683918  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:20.699852  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53695.3us
I20260709 12:15:20.632292 13885 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.706990 14179 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:15:20.707957 13885 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.708532  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.710139 13919 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.712527 13919 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.714807  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.704344 13751 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260709 12:15:20.716302  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.717612  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.719965  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.720808  8998 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:20.721951  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:20.723796 14181 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:15:20.724742 14178 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 12:15:20.727193 14182 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:15:20.731004 14083 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:20.732597 14085 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 12:15:20.733168  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.733003 14085 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.734362  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.736356 13861 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.704663 14100 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.739208 14100 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:20.739992 14189 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:15:20.740801 14063 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.742084 14137 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.742204  9616 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:20.743033  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:20.743760  8994 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.746680 14084 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.747439 14143 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.749652 14101 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:20.750169 14101 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:20.752008  9071 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
W20260709 12:15:20.752084 14168 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
I20260709 12:15:20.752712 14149 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.753808  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:20.708606  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.736443 14092 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.755640  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:20.763430  8995 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 9.
I20260709 12:15:20.757663  8920 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:20.718920  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:20.765002  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 117936us
W20260709 12:15:20.788995  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.789949  8991 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:20.791631  8918 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:20.794077  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.794822  8918 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.788164  8999 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:20.771715  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.755354  8993 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:20.806367  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.735100 14085 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.818616  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.753935 14146 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:20.772045 14055 consensus_meta.cc:287] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.005s
I20260709 12:15:20.822666  9066 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:20.827492  9000 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:15:20.827814  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63185.3us
I20260709 12:15:20.790314 13844 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:20.801189 13999 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.002s
I20260709 12:15:20.834149  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:20.841266  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.800520 13985 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.845484  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.852869  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:20.853783  8999 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:20.832618 14126 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.860s	user 0.005s	sys 0.008s
W20260709 12:15:20.839112 13970 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.585s	user 0.014s	sys 0.000s
I20260709 12:15:20.860957  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.861891  8994 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:20.862257 14085 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:20.863365  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.885437  9617 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.867424  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:20.868811  9000 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:20.869410  8998 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:20.869794  8996 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:20.843719 13999 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.852213 14131 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.889715  8918 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:20.875833  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.876597  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:20.876756  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:20.852317 14083 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:20.765686 14101 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.896543 14101 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.860049  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:20.900403  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:20.901667  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:20.901907  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:20.902580 13751 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:20.902901 14200 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:20.903363 14200 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:20.903777 14200 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.895046  9615 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.904894 14198 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.905436 14198 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.846304 13844 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.907452 13751 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.907816  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.908226 13844 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.909456 13607 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:20.911738 13607 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:20.913142 14092 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:20.913678 14092 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:20.913416 14085 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.914662  8998 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:15:20.914485 14092 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.915789 14085 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:20.915911 14092 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.916810 14131 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.909744  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:20.919899 13970 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.884055 14193 consensus_queue.cc:1059] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:15:20.895583  9619 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:20.895401 14083 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.896414  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.933759  9069 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 9: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:20.889595  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.908761 14146 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:20.816146 13966 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:20.841856 14137 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.921280  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1080) took 1044 ms. Trace:
W20260709 12:15:20.921484  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 43543.5us
I20260709 12:15:20.921916  9071 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:20.894939  9621 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.918998 14131 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.928310  8999 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:20.932915  9074 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15.
I20260709 12:15:20.935310  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:20.940470  9615 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
W20260709 12:15:20.943599  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.908306 13751 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:20.948889  9040 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.950305  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.951460  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.942090 14146 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.957355  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.891043 14126 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.960862  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.961651  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:20.979666  8925 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.979956  8924 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.959807  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:20.962993  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:20.959648 14137 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.934163 14097 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:15:20.965677  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:20.967597 14162 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:15:20.968398 13896 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:20.984671 13896 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.986060 14137 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:20.985683 13896 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:20.969436  9040 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.989652  9040 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:20.991570 14055 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:20.992128 14055 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.979228 14146 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:20.993232 14055 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:20.995427 14207 raft_consensus.cc:2804] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:20.971176  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:20.952356 13751 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.996654 13751 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.996711 14126 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.999191  9620 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:15:20.999560 14207 raft_consensus.cc:697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:20.953483 13950 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.000818 14198 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.944658 14166 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:21.001698 14166 consensus_queue.cc:1243] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:21.000948 14207 consensus_queue.cc:237] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:20.975869 14158 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.003s
I20260709 12:15:20.974161 13966 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:21.005191 14148 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.003s
I20260709 12:15:20.924077 14154 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:15:20.977227 14156 raft_consensus.cc:3055] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:21.007767 14156 raft_consensus.cc:740] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:21.008386 13917 consensus_meta.cc:287] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.001s
I20260709 12:15:21.008821 14156 consensus_queue.cc:260] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.009570  8918 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:21.010162 14156 raft_consensus.cc:3060] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.953822 13999 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:21.010910  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 371132us
I20260709 12:15:20.976233 14083 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:20.980894  8917 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:20.936779  9073 rpcz_store.cc:276] 0709 12:15:19.877199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.964395 (+ 87196us) service_pool.cc:224] Handling call
0709 12:15:19.988034 (+ 23639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.119844 (+131810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.119876 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:20.296468 (+176592us) log.cc:844] Serialized 26 byte log entry
0709 12:15:20.540401 (+243933us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:20.540439 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.540513 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:20.921074 (+380561us) raft_consensus.cc:1685] finished
0709 12:15:20.921094 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:20.921222 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2122,"raft.queue_time_us":9011,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":206044,"threads_started":1,"wal-append.queue_time_us":594502}
I20260709 12:15:21.001366 13950 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.003721 14085 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:20.977545 14205 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:21.012918  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:20.964670  8916 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:21.012279 13999 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.042253 13999 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.044342 13999 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:21.016763  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.012749  8923 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:20.987042  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.019955 14142 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:15:21.045650  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.046072 14142 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:21.046445 14142 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:21.046334  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.047382 14085 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:21.047573  9065 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
W20260709 12:15:21.023510  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88328.3us
I20260709 12:15:21.049723  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:21.050945  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.051836  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.020854  8924 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:21.021642  9617 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:21.031209  9621 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:21.034813  9067 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.036929  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.039637 13950 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.040206  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:21.040752 14184 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.430s	user 0.001s	sys 0.003s
I20260709 12:15:21.041419  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:21.055796  8997 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:21.055965  9073 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.056618  8917 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:21.048444 14085 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.057838  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.059301  8992 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:15:21.037400 13996 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.001s
I20260709 12:15:21.062047  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.063067  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.067979  8888 leader_election.cc:400] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:21.067215  8924 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 10.
I20260709 12:15:21.090351  8888 leader_election.cc:403] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:21.098193  8925 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:21.099690  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.100669  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.055032 14097 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:21.020130 14005 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:15:21.109036  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.109634  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.111220  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.111780  9000 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:21.064248 14205 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:21.119663  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:21.122562  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65209.3us
I20260709 12:15:21.118075  9040 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.110837 14198 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.129029  8999 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:21.132736  9073 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:21.130209  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:21.130851  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.135411 14198 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.136646 14200 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.139294  8918 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:15:21.144537  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.144469  9065 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:21.087996 13996 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:21.147101  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47909.2us
I20260709 12:15:21.147333  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.148348  9067 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:21.149233  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.150303  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.151258  9065 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:15:21.151298  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 106343us
I20260709 12:15:21.124930 14097 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:21.125206 13917 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:21.156842  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.162762  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:21.169589  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.177927 14205 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:21.178954 14204 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:21.179782 13996 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:21.144392 13999 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:21.180604 13999 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.181030 13999 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:21.181780  9624 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:21.184641  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.185160  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.192389  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2574) took 1037 ms. Trace:
I20260709 12:15:21.169020  8966 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.202209  9070 raft_consensus.cc:2368] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:21.156284 13966 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:21.214897  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45992.5us
I20260709 12:15:21.217168  8916 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.192818  8922 rpcz_store.cc:276] 0709 12:15:20.155069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.156026 (+   957us) service_pool.cc:224] Handling call
0709 12:15:20.156435 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.157026 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.157067 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:20.157722 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:15:20.329245 (+171523us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:20.329282 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.329343 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.010681 (+681338us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:21.165667 (+154986us) raft_consensus.cc:1685] finished
0709 12:15:21.165686 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.192322 (+ 26636us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2076,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":6848896,"thread_start_us":171097,"threads_started":1,"wal-append.queue_time_us":356377}
I20260709 12:15:21.215770  8966 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.114014 14142 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.229951  8922 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 18. Ops: []
I20260709 12:15:21.233146  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.234062  8924 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.251893  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.202327 14005 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:21.222829 14121 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.231532 14083 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:21.279593  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.286471  8924 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:21.289017  8918 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:21.292933  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77370.7us
I20260709 12:15:21.289182  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.291272  8966 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.282898 14083 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.298605 14083 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.294950 14149 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:15:21.300988 14149 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:21.301433 14149 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:21.302323 14149 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.259181 14200 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.258085 13607 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.305492  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 140087us
W20260709 12:15:21.308650  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.287875 14091 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:21.315421  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.307113 13985 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:21.281471 14005 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.282502 14121 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.310027 14142 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:21.366189  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:21.367350 14212 log.cc:927] Time spent T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:15:21.350620 14200 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.375566  8964 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.604s (SENT)
I20260709 12:15:21.377007 13898 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:21.378679 14217 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:15:21.379961 14209 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:15:21.380848 14214 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:15:21.384424  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2696) took 1001 ms. Trace:
I20260709 12:15:21.349071 14091 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:21.388250  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:21.345603 13607 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.392982 14146 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.445966 14131 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.409454  9068 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:15:21.411857 14226 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:15:21.435541 13844 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.413578 14123 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:21.421525 14121 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.309186 14097 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.423666 14005 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:21.425577  8923 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:21.532666  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.536023  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2700) took 1028 ms. Trace:
I20260709 12:15:21.426198  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.426311  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.426901  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.428512  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:21.527336 13751 consensus_meta.cc:287] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.010s
I20260709 12:15:21.431464  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.439934  8921 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
W20260709 12:15:21.541733  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.434660  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71486.9us
W20260709 12:15:21.445559  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 154491us
I20260709 12:15:21.417773  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:21.542785  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 125112us
I20260709 12:15:21.543462  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.450187  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.478583  8964 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:21.479923  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.544481  8924 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:15:21.404476 14198 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.413254 13985 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:21.448199 13966 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.555697 13966 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.556129 13966 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.556244  9073 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:15:21.532102 14083 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.557293 14091 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.558282 14083 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.524519 14197 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:21.525524 13607 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:21.527048 14146 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.452569 13898 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:21.559679 14197 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.527580 13844 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.562119 14197 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.527786 14131 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.529213  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:21.562906  9622 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:21.516223 14148 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.563488 14148 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.564210 14131 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:21.565626 14148 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.521806 14123 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:21.567684  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.567972  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.538689  8916 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.530014 14200 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.429955 14099 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:21.569681 14099 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:21.518208 13885 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.536428  9074 rpcz_store.cc:276] 0709 12:15:20.507867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.635531 (+127664us) service_pool.cc:224] Handling call
0709 12:15:21.535854 (+900323us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003eeed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:21.535970 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630718720}
I20260709 12:15:21.541033  9621 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:21.449172  8919 raft_consensus.cc:1240] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:21.486910  9066 rpcz_store.cc:276] 0709 12:15:20.383040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.424324 (+ 41284us) service_pool.cc:224] Handling call
0709 12:15:20.820707 (+396383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:20.834322 (+ 13615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.384219 (+549897us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54000e88d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:21.384365 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802600704}
I20260709 12:15:21.545243  8920 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:21.479254 13999 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.549393 14156 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:21.551254 14121 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:21.527676  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 139577us
I20260709 12:15:21.578305  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.579910  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.586681  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.587302  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.587776  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.588613  9617 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:21.566733 14123 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.597143  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.600103  9615 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:21.578169 14156 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.602140  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.602761  8918 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:21.604359  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.605441  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.550045 14162 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:15:21.546756 13751 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.624465  9069 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.625701 13751 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:21.610270  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 234756us
I20260709 12:15:21.612010  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:21.626962  9073 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.612314  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.627521  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.612629  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.628371  8999 raft_consensus.cc:2410] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:15:21.628438  9074 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:21.613298  8920 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:21.613224  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.630296  8998 raft_consensus.cc:2393] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.613744  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.549906 14063 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:15:21.632325 13985 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.634270  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.613968  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.635327 13970 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.635671  8995 raft_consensus.cc:2368] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:21.601810 14146 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.636027 13970 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.636260 14146 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.606660 14156 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:21.638417 14146 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:21.612048  9066 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:21.593968 14197 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:15:21.647053  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.648451  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.649210  8998 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.649978  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.650383  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.651176  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.651918  9615 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.652222  9000 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:21.614524 13999 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:21.600209 14148 raft_consensus.cc:2764] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:15:21.615561 14101 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:21.618186 13607 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.586979 14005 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:21.623378  8993 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.655454  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.655591  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.660038  8994 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
W20260709 12:15:21.656437  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57527.7us
W20260709 12:15:21.660586  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 116970us
I20260709 12:15:21.661473  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:21.664439  8995 pending_rounds.cc:85] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 5
I20260709 12:15:21.570629 14099 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.667223  8995 pending_rounds.cc:107] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:15:21.667518  8995 raft_consensus.cc:2889] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.667557 14099 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:21.654969  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.656234  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.665397 13874 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.670425 13874 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:21.666071  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:21.670768 14205 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:21.671115  9074 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:21.666891  9073 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:15:21.668488 14146 consensus_queue.cc:1175] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4993160378a142a1bc21648120cbaebc" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:21.658238  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.673424  9615 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:21.675747  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:21.676381  9000 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:21.679382  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.680323  8999 raft_consensus.cc:2368] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:21.681305  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:21.657064 14235 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.684523  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:21.688189  9616 raft_consensus.cc:2410] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:15:21.683138  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 134122us
I20260709 12:15:21.690472  8994 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:15:21.659019 14101 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:21.690860  8994 pending_rounds.cc:85] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 7
I20260709 12:15:21.692701  8994 pending_rounds.cc:107] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:15:21.693028  8994 raft_consensus.cc:2889] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.656854 14126 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 12:15:21.693931  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.670805 13874 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:21.698022  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.657394 13751 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:15:21.687552 14131 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:21.708105  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.711548  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55315.5us
I20260709 12:15:21.685010 14158 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:21.716634  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:21.718816  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.721725  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.723699 13885 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:21.724153 13885 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:21.724632 13885 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:21.724192  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.731792 13985 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.732607 14207 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:21.734278  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.676884 13966 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.678551 13607 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.682832 14005 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.737757  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:21.738462  8994 pending_rounds.cc:85] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 9
I20260709 12:15:21.735811 13919 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.703281 13874 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:21.741073  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.739312  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.682613 14083 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:15:21.788345  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.787456  9587 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:21.789191  8924 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:21.753324  8994 pending_rounds.cc:107] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:15:21.791530  8994 raft_consensus.cc:2889] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:21.791723  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.756301  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.712328 14236 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:21.743816 14205 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:21.792951  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.793643  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.693133 14235 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.790288  8996 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:21.794399  9624 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:21.753558 14162 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:21.803550  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 100486us
I20260709 12:15:21.735754 14158 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:21.811290  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 72083.7us
I20260709 12:15:21.812052  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.792532 14236 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:21.742079 14063 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:15:21.800571 14205 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:21.789873 14084 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:15:21.817121 13919 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:21.754915 14237 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:15:21.808943 14244 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:15:21.823005 14231 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:15:21.824043 14244 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:21.819370 14243 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.824631 14244 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:21.836820  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:21.847991  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 59592.6us
I20260709 12:15:21.850701  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.819612 14205 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:21.791858 14101 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.865844  8991 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:15:21.817584 14236 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:21.819639 14121 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.860805  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:21.872725  8992 raft_consensus.cc:2410] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:15:21.862977  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.866946  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:21.868439  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.875617  9622 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:21.878298  9623 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:21.880369  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.880723  8919 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.825722 14244 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:21.890725  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:21.886716  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.864562 14207 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:21.820598 13919 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.903053  8920 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:21.898568  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.865022 13999 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.917500  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.880291 14142 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.880791 14241 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:21.856958 14156 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:21.914086 14238 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:15:21.870404 14162 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 12:15:21.945374  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.961659  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 63201.1us
I20260709 12:15:21.966228  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.966908  8916 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:21.915066 14207 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:21.970521  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 91682.3us
I20260709 12:15:21.985849  9624 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:15:21.988960  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 122095us
I20260709 12:15:21.971478  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:21.990238  8993 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:21.939077 14142 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:21.998212  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:21.965168 14083 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.965672 13966 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:21.979036 14207 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:21.969887 14241 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:21.985328 14085 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:22.007009  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:21.994484 14092 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.006415 13607 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.009627 14158 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.009433 14005 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:22.034192  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.013995 13874 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.043550  8920 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:22.043397  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:22.010600 14099 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:15:22.028537 13966 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.047582  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:22.049348  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 48880.1us
I20260709 12:15:22.049707 13874 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.045202 14131 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:22.051221 14241 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.052623 14156 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:22.053087 14246 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:15:22.057034  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60046.5us
I20260709 12:15:22.128225  8888 leader_election.cc:400] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
W20260709 12:15:22.129041  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 341652us
I20260709 12:15:22.086561  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:22.121646  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 74128.5us
I20260709 12:15:22.131958  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.132448  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:22.133136  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:22.134405  8998 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:22.018574 14092 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:22.132043  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45580.4us
I20260709 12:15:22.138873  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.135866  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:22.140640  9074 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.134349  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:22.145870  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:22.147346  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:22.134218 14083 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.144610 14148 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.128567 14158 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:22.029294 14085 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.043963 13885 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.155385  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:22.170857  8888 leader_election.cc:400] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:22.171345  8888 leader_election.cc:403] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:22.148490 14156 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.170024 13874 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:22.162454 14229 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:22.236176 14257 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:15:22.236927 14253 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:22.237512 14245 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.236366 14248 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:22.235416 14250 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:22.238327 14148 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:15:22.170697 13919 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.242103  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:22.175587 13966 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:22.144606 14131 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.244411 14229 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.243700 14268 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:22.259419 13966 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.295709 13966 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.300259  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:22.260123 14245 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.256345 13874 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:22.304584 14245 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:22.307752  8818 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:22.310782 14085 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:22.282925 14229 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:22.312004  8820 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 333) took 23232 ms (client timeout 15000 ms). Trace:
I20260709 12:15:22.316541 13885 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:22.324908 14228 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.762s	user 0.004s	sys 0.000s
W20260709 12:15:22.325307  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.329726 14224 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:22.330207 14224 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:22.348806  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.365022  9074 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:22.367656  8922 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
W20260709 12:15:22.288080  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 149255us
I20260709 12:15:22.376174  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.255930 13998 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.385227  8919 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:22.395201  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:22.396554  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3365) took 1438 ms. Trace:
I20260709 12:15:22.286413 14142 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.410841  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:22.403651 14258 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:22.403750 13998 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.407691 14254 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.234s
W20260709 12:15:22.409034 14267 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:15:22.290588 14248 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.291181 14268 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.457243 14268 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.460024 14235 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:22.462580  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:22.463323  9616 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:22.396966  9065 rpcz_store.cc:276] 0709 12:15:20.958583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.155641 (+197058us) service_pool.cc:224] Handling call
0709 12:15:21.162156 (+  6515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.162476 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.162501 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.192855 (+ 30354us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.487405 (+294550us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:21.487445 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.487514 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.324414 (+836900us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b240020f738. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8d09d 00007f39857bf10e 00007f39857d688c 00007f39857d5bb6 00007f39857d57d8 00007f39857df221
0709 12:15:22.347458 (+ 23044us) raft_consensus.cc:1685] finished
0709 12:15:22.347521 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.396495 (+ 48974us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":26486,"spinlock_wait_cycles":27376512,"thread_start_us":233580,"threads_started":1,"wal-append.queue_time_us":300467}
I20260709 12:15:22.466889  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:22.467789  9624 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:22.423977  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47931.9us
I20260709 12:15:22.472203  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.399832 13985 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:15:22.475342 14240 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:15:22.478612  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:22.482304 14259 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:22.482867 14236 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.000s
I20260709 12:15:22.486271 14126 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:15:22.441589 14247 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.624s	user 0.003s	sys 0.000s
I20260709 12:15:22.444413 14270 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.445394 14249 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.203s
W20260709 12:15:22.446816 14262 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:15:22.431684 14156 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.557243  9070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 3363) took 1612 ms (client timeout 1876 ms). Trace:
W20260709 12:15:22.447798 14264 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:15:22.447970  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3359) took 2210 ms. Trace:
I20260709 12:15:22.399792 14207 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.441732 14254 consensus_queue.cc:1243] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:15:22.416338 14258 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.415699 13885 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:15:22.452572  8997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 1057) took 1735 ms (client timeout 2200 ms). Trace:
I20260709 12:15:22.556461 14085 consensus_queue.cc:1059] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:15:22.577605  8997 rpcz_store.cc:269] 0709 12:15:20.717082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.735176 (+ 18094us) service_pool.cc:224] Handling call
0709 12:15:22.452345 (+1717169us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54002f5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:22.452496 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554815232}
I20260709 12:15:22.587791  9074 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
W20260709 12:15:22.591907  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 434757us
I20260709 12:15:22.565452 13985 consensus_queue.cc:1243] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:15:22.453359 14243 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.001s
I20260709 12:15:22.453703 14248 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.456655 13844 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:22.434439  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:22.486658  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:22.609866  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 123271us
I20260709 12:15:22.488231  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:22.489602  8991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 1068) took 1427 ms (client timeout 1560 ms). Trace:
I20260709 12:15:22.391012 14229 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.438444  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:22.312434  8820 rpcz_store.cc:269] 0709 12:14:59.080073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.080466 (+   393us) service_pool.cc:224] Handling call
0709 12:15:22.311759 (+23231293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:09.984416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:10.005447 (+ 21031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:10.005503 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:15:10.005544 (+    41us) tablet.cc:662] Decoding operations
0709 12:15:10.028035 (+ 22491us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:10.029797 (+  1762us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:10.029837 (+    40us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:15:10.107691 (+ 77854us) tablet.cc:701] Row locks acquired
0709 12:15:10.107744 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:15:10.107906 (+   162us) write_op.cc:270] Start()
0709 12:15:10.108064 (+   158us) write_op.cc:276] Timestamp: P: 1783599310107843 usec, L: 0
0709 12:15:10.108102 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:15:10.116108 (+  8006us) log.cc:844] Serialized 11993 byte log entry
0709 12:15:10.546290 (+430182us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:11.077326 (+531036us) op_driver.cc:464] REPLICATION: finished
0709 12:15:11.424741 (+347415us) write_op.cc:301] APPLY: starting
0709 12:15:11.435740 (+ 10999us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:12.220034 (+784294us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b180025ea00. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f398597a0ec 00007f398597caf7 00007f398597dfb0 00007f39896921bb 00007f3989692532 00007f39896d9b93 00007f3989586de3 00007f39895866ab 00007f3989587e77
0709 12:15:12.454806 (+234772us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:12.454849 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:13.975753 (+1520904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:13.976256 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:15:13.976309 (+    53us) write_op.cc:312] APPLY: finished
0709 12:15:13.976961 (+   652us) log.cc:844] Serialized 268 byte log entry
0709 12:15:14.191886 (+214925us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:14.270552 (+ 78666us) write_op.cc:454] Released schema lock
0709 12:15:14.309866 (+ 39314us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:14.412934 (+103068us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:14.424171 (+ 11237us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1402828,"reported_tablets":41,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":310366,"apply.run_cpu_time_us":102035,"apply.run_wall_time_us":2953669,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":263160,"prepare.run_cpu_time_us":30502,"prepare.run_wall_time_us":233527,"raft.queue_time_us":410015,"raft.run_cpu_time_us":45499,"raft.run_wall_time_us":155884,"replication_time_us":969047,"spinlock_wait_cycles":13979776,"thread_start_us":722015,"threads_started":5,"wal-append.queue_time_us":474469,"wal-append.run_cpu_time_us":23407,"wal-append.run_wall_time_us":2766975}]]}
I20260709 12:15:22.534116  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:22.578714 14258 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:22.551918  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 48561.5us
I20260709 12:15:22.552634  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.558938  8921 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:15:22.557848  9070 rpcz_store.cc:269] 0709 12:15:20.944652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.965430 (+ 20778us) service_pool.cc:224] Handling call
0709 12:15:22.556951 (+1591521us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001b6a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:22.557164 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458566912}
I20260709 12:15:22.563206  9072 rpcz_store.cc:276] 0709 12:15:20.237801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.397475 (+159674us) service_pool.cc:224] Handling call
0709 12:15:20.424536 (+ 27061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.467922 (+ 43386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.467973 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.381430 (+913457us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b1800460c60. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a
0709 12:15:21.382358 (+   928us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b2c00078738. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:21.382866 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.529063 (+146197us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:21.529097 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.529222 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.826718 (+297496us) raft_consensus.cc:1685] finished
0709 12:15:21.826739 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.447774 (+621035us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b540026cad0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:22.447906 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2355,"raft.queue_time_us":32347,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":12731,"spinlock_wait_cycles":76172928,"thread_start_us":145842,"threads_started":1,"wal-append.queue_time_us":214049}
I20260709 12:15:22.568333  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:22.532585 14236 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:22.605371  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 434652us
W20260709 12:15:22.611554  8991 rpcz_store.cc:269] 0709 12:15:21.061842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.062717 (+   875us) service_pool.cc:224] Handling call
0709 12:15:22.489354 (+1426637us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000f55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:22.489521 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838179712}
W20260709 12:15:22.611714  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123564us
I20260709 12:15:22.610939  9590 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.606710  8925 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:22.615183  9069 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.548308  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:22.617106  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 448121us
I20260709 12:15:22.567361 14156 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.620846  8918 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:22.625269  8924 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:22.643203  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:22.643567  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:22.615746 14091 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:22.647418  8916 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:22.655809  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3134) took 1006 ms. Trace:
I20260709 12:15:22.619433 14244 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.656289  8994 rpcz_store.cc:276] 0709 12:15:21.649841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.712894 (+ 63053us) service_pool.cc:224] Handling call
0709 12:15:21.738224 (+ 25330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.810531 (+ 72307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.810561 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.810964 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.141937 (+330973us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:22.141975 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.142048 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.655508 (+513460us) raft_consensus.cc:1685] finished
0709 12:15:22.655551 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.655737 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277404,"threads_started":1,"wal-append.queue_time_us":425611}
I20260709 12:15:22.470609  8818 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 9 to 10, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:22.615065 14243 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.658774  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3131) took 1009 ms. Trace:
I20260709 12:15:22.672132  9071 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:22.651152  9587 connection.cc:256] RPC call timeout handler was delayed by -1.0131117839998751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 12:15:22.640404 14092 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:22.658478 14205 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.003s
I20260709 12:15:22.702167  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.639173 14206 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:15:22.674544 13874 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:15:22.676817  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.677723  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:22.668618  9000 rpcz_store.cc:276] 0709 12:15:21.649117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.684242 (+ 35125us) service_pool.cc:224] Handling call
0709 12:15:21.684584 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.694227 (+  9643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.694255 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.720423 (+ 26168us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.136834 (+416411us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:22.136873 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.136936 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.658513 (+521577us) raft_consensus.cc:1685] finished
0709 12:15:22.658551 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.658718 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21416,"raft.queue_time_us":8732,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10060,"thread_start_us":331356,"threads_started":1,"wal-append.queue_time_us":483520}
I20260709 12:15:22.641283 13844 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:15:22.655560 14091 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:22.648178 13885 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:15:22.700896  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.667805 14131 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.788455  8991 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:22.700980  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.618933 13966 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.705206  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.705281  8994 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:22.707501 14126 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:22.701632 14005 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.708658  9068 raft_consensus.cc:2368] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:22.672762 14241 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:22.710829 14055 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.715534 14273 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:22.655323 14254 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.733300  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.761845  9069 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:22.775750  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.776651  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:22.794945  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.789244  8997 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:15:22.795672  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:22.791980  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3129) took 1127 ms. Trace:
I20260709 12:15:22.790836  8993 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:22.796598  9071 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:22.797760  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.799682  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:22.807514  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.808308  8998 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:22.809423  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:22.809994  8993 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.797019  8995 rpcz_store.cc:276] 0709 12:15:21.648579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.663919 (+ 15340us) service_pool.cc:224] Handling call
0709 12:15:21.664250 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:21.668264 (+  4014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.668293 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:21.674371 (+  6078us) log.cc:844] Serialized 52 byte log entry
0709 12:15:22.409971 (+735600us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:22.450579 (+ 40608us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b18002dc760. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1
0709 12:15:22.450753 (+   174us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:22.451082 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:15:22.775558 (+324476us) log.cc:844] Serialized 14 byte log entry
0709 12:15:22.775840 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.775926 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.775972 (+    46us) raft_consensus.cc:1685] finished
0709 12:15:22.775985 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.776132 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27692,"prepare.queue_time_us":78030,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":18543,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":5042,"spinlock_wait_cycles":42279936,"thread_start_us":307028,"threads_started":2,"wal-append.queue_time_us":65621}
I20260709 12:15:22.816779  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.788162 14121 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.818413  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.822995  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.824158  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:22.825577  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 147939us
I20260709 12:15:22.830777  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.734068 14205 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.866535  9068 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:22.873936  8993 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:22.807664 14241 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:22.830183 14131 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:22.834173 14091 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.823933 14273 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:22.801208 14055 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.803769 14254 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:22.807587 14005 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:22.934396  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 310383us
W20260709 12:15:22.934850  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 317490us
I20260709 12:15:22.944936 14229 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.919772 14206 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.946201  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.947854 14248 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:22.962280  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:22.968020  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 357153us
I20260709 12:15:22.969321  8889 leader_election.cc:400] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13.
I20260709 12:15:22.969574  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:22.932363  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 285854us
I20260709 12:15:22.926241 14276 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.971982  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.953141 14236 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.971086  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:22.956377 14156 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:22.959587 14131 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:22.984442  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:22.985654  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:22.986301  8993 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:22.986567  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:22.988685  8995 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:15:22.985877  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:22.990880  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:22.993376  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.972972 14091 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:22.999905  8994 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:22.979744  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:22.875872  8818 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 4 to 10, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 10 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.973292 14206 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.019564 14005 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.023568 14273 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:23.025578  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 199073us
I20260709 12:15:22.983613 14235 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:22.987772 14156 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.994046 14097 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:22.991369 14063 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:23.040153  9622 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:15:23.047622  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78022us
I20260709 12:15:23.012176 13917 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:23.054647  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.004554 14236 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.081364  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.082383  8995 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:23.056865 13917 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:23.088825 13917 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:23.053956 14097 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:23.051352 14235 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:22.987929 14276 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.075870 14205 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.076486 13966 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.105618  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:23.049307 14156 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.136327  8995 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:23.142307  9070 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:23.012494 14241 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.148592  8996 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:23.099344 14162 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.162427  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.130504 14063 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:23.181497  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.184387  9624 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:23.184903  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.185637  9616 raft_consensus.cc:2393] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:23.187201  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.129711 14092 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:15:23.190745  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.192724  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.195343  9620 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:23.202747  9622 raft_consensus.cc:2468] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:23.098043 14131 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.162221 14237 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:15:23.212380  9624 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:23.177783 14162 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.194419 14254 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.204043 14298 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.212445 14287 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.188426  8818 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 4 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.242643  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.243413  9624 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:23.208506 14303 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.248292 14206 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:23.249531 14156 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.231011 14298 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.254658 14235 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.196393 14097 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.255633  9622 raft_consensus.cc:1275] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:15:23.292353 14200 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.292816 13898 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.293972 13898 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:23.265264 14303 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.297302 14303 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.343060 14276 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:23.324355 14268 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.001s
I20260709 12:15:23.346361 14268 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.247922 14287 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:23.324044 14258 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.008s
I20260709 12:15:23.359504 14317 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.320583 14200 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:23.379153  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.381070  8924 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:23.369149 14253 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:23.369385 14149 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.369338 13917 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.390105  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.263757 14063 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.367987 14162 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.386839  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.392807  9621 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:23.387277  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.395838  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.395866  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.396677  9615 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:23.398054  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.399035  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:23.407379 14268 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:23.411015 13917 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.396639  8918 raft_consensus.cc:2376] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14. Re-sending same reply.
I20260709 12:15:23.418478 14287 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.392067 14149 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.421082 14149 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.418931 13607 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.427031  8924 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:23.430162  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.459745  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.464696  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.389032 14317 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.391479 14200 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.454792  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.381229 14258 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.433686  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:23.466282  8924 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:23.468197  9620 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:23.473493  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.474387  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.475611 14156 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:23.476346 14156 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.476951 14287 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:23.477419 14287 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.477763 14287 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:23.467180 13607 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.494999  8923 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:15:23.493673  9590 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:23.498061  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.500558  9065 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:23.514242 14317 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.515043  8924 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:23.515690 14101 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.517194 13898 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.517727 13898 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.501384 14198 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:23.522650  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.504431 14270 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:23.507349 14251 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:23.541607 14251 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.539732  9621 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
W20260709 12:15:23.556228  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.556629  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3378) took 1055 ms. Trace:
I20260709 12:15:23.557034  9065 rpcz_store.cc:276] 0709 12:15:22.501089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.501425 (+   336us) service_pool.cc:224] Handling call
0709 12:15:22.501845 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:23.501100 (+999255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:23.556395 (+ 55295us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400140fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:23.556575 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287287680}
I20260709 12:15:23.543421 13898 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:23.559976 14281 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.598s	user 0.000s	sys 0.002s
I20260709 12:15:23.560250  8921 raft_consensus.cc:2410] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:15:23.560823 14279 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.685s	user 0.000s	sys 0.001s
I20260709 12:15:23.565589 14237 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.566308 14237 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:23.568241 14280 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.624s	user 0.002s	sys 0.000s
I20260709 12:15:23.569847  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1109) took 1108 ms. Trace:
I20260709 12:15:23.570329  9617 rpcz_store.cc:276] 0709 12:15:22.461528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.464885 (+  3357us) service_pool.cc:224] Handling call
0709 12:15:22.465232 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.465586 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:22.465614 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:22.466118 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.610495 (+144377us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:22.610583 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.610676 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:23.567590 (+956914us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:23.569436 (+  1846us) raft_consensus.cc:1685] finished
0709 12:15:23.569466 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.569738 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20425,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":89685248,"thread_start_us":143972,"threads_started":1,"wal-append.queue_time_us":452844}
I20260709 12:15:23.580518 14207 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:23.583788 13607 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:23.574900 14211 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.018s	sys 0.014s
W20260709 12:15:23.586263 14211 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.018s	sys 0.017s
W20260709 12:15:23.594408 14291 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.642s	user 0.000s	sys 0.002s
I20260709 12:15:23.597015  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2199) took 1014 ms. Trace:
I20260709 12:15:23.598305 14200 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.597384  8919 rpcz_store.cc:276] 0709 12:15:22.582815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.582990 (+   175us) service_pool.cc:224] Handling call
0709 12:15:22.594921 (+ 11931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.627826 (+ 32905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:22.627879 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:22.643925 (+ 16046us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.954047 (+310122us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:22.954103 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.954191 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:23.593821 (+639630us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:23.596728 (+  2907us) raft_consensus.cc:1685] finished
0709 12:15:23.596753 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.596951 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18204,"raft.queue_time_us":26694,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10413,"spinlock_wait_cycles":59362560,"thread_start_us":273629,"threads_started":1,"wal-append.queue_time_us":290700}
I20260709 12:15:23.594393 14251 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.546415 14270 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:23.592813 14237 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.611559 14224 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.611009 14270 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:23.615862 14323 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:15:23.617653 14298 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:23.627496  8964 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.515s (SENT)
I20260709 12:15:23.628309  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.636266 14322 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:23.651352  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.651465 14251 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:23.652690  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:23.654703  8964 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.865s (SENT)
I20260709 12:15:23.655187  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.659969  8924 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:23.661065  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.661840  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.662985  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:23.663424  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.663699  8923 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:23.656188 14200 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.664638 14200 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.662039 14322 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:23.655807 14207 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:23.658284 14211 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.671478 14200 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.637349 14287 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.659211 14251 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.667853 14207 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.675321 14207 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:23.680814  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.681438 14322 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.677903 13985 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:15:23.681929 14322 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.676684 14211 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.684311 14322 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:23.685161 14290 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.727s	user 0.000s	sys 0.002s
I20260709 12:15:23.686482  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2202) took 1101 ms. Trace:
I20260709 12:15:23.686616 14211 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.687897 14251 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.686843  8922 rpcz_store.cc:276] 0709 12:15:22.585520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.586254 (+   734us) service_pool.cc:224] Handling call
0709 12:15:22.586660 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.607514 (+ 20854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:22.607537 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:22.620297 (+ 12760us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.948294 (+327997us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:22.948355 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.948455 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:23.684573 (+736118us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:23.686197 (+  1624us) raft_consensus.cc:1685] finished
0709 12:15:23.686218 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.686420 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28567,"raft.queue_time_us":21552,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6383,"spinlock_wait_cycles":23814016,"thread_start_us":280557,"threads_started":1,"wal-append.queue_time_us":312053}
I20260709 12:15:23.693879 14271 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.694649 14271 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.696346 13885 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:23.696571 13998 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.696890 13885 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.697162 13998 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.704237  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.704733 13885 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.704864  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:23.705488  9615 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:23.702592  8924 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:23.706804  8916 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:15:23.707101 14276 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:23.708652  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.711328 14158 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.711958 14158 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.710487 14005 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:23.713068 14005 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.714471 14158 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.715207 14055 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:23.710358 13607 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.717128 13607 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.718020 13898 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:23.718544 13898 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.716346 14005 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.724380  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.725086  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.725291 14121 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.725862  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.726857  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.727919  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.727473  8922 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:23.731109  8993 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:23.732151  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.725956 14121 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.738010  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:23.740413  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.741196  8993 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
I20260709 12:15:23.697121 14271 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.709124 14287 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.737582  8994 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:23.743094  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.753379  8993 raft_consensus.cc:2368] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:23.744865  8966 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:23.734314 14092 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.746713  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.757246  8998 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:23.756631  8991 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:23.760285  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.732532 13898 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.735461 14158 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:23.766189  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:23.768561  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.756100 14317 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:15:23.764537  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:23.764935  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.765426  9000 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:23.774242  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:15:23.738452 14142 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:23.775435  8994 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:23.780058  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.780857  8991 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:15:23.781348  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.781615  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.779035  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.782395  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.782517  8994 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:23.782943  8993 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:23.789564  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.790699 13998 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.771507 14091 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:23.790930 14092 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:23.791385 14091 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.791849 14091 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.791921 14092 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:23.792421 14092 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:23.795184 13607 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.746068 14005 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:15:23.791034  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.778323 14142 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:23.796286  8991 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:23.796882 14142 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.798143 14142 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:23.793205 14092 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.799811 14092 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:23.799860 14207 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:23.802639 14334 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:15:23.802546 14149 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:23.803493  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.771190 14271 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.756840 14055 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:15:23.771561 14099 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:23.814429  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.814915  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.815883  8998 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:23.784118 14158 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.825358  8993 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:23.829118  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:23.830277  8993 raft_consensus.cc:2410] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:15:23.838343  8994 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:23.811002 14099 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.858628  8991 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:23.859652  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.861214  8993 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:23.863586 14099 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:23.834368 14149 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:23.912030  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.912768  9073 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:23.907094 14149 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.891229 14121 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.917035 14149 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.909646 14257 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:23.918077 14257 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:23.921442 14257 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:23.908703  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.926487  9074 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:23.929566  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.930631  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.931972  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:23.933597  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:23.936157  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:23.937033  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.939011  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:23.939952  9065 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:23.916924 14207 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:23.950961  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.952824  9067 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:23.953112 14099 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.955694 14123 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.958515  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:23.960934 14091 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:23.964004 14099 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:23.941546 14268 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:23.966245  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.969702  9000 raft_consensus.cc:2410] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:15:23.941830 14270 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:23.987624  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:23.988453  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.948761 14273 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.967906  9065 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:23.973402 14276 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.940692 14197 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:15:23.997391  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.022977  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:24.004197  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.027294  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:24.009281  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:23.949764 14257 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.025878  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:24.040467  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:24.035945  9065 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:24.043816  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.044529  8924 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:24.041383  9000 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.048589  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.053767  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.054563  8924 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:24.050755  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:24.056284  8923 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.051514  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.059691 14005 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:24.059546 13885 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:15:24.061565  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 95662.8us
I20260709 12:15:24.054482  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:24.067216  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:24.021423 14308 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.074676  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:24.030494 14207 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:24.042212 14206 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:24.110224  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.111779  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:24.113533  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.233544  8922 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:24.154520  9074 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:24.108254 13996 consensus_queue.cc:1048] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:15:24.152128 14099 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:24.156064  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1834) took 1196 ms. Trace:
I20260709 12:15:24.158670  9623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1125) took 1156 ms. Trace:
I20260709 12:15:24.162846  8995 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:24.052050 14162 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:24.164050  8997 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:24.077309 14275 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:15:24.173847  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.189476  8993 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:24.081106 14273 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.108979 14242 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:24.108614 14308 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.194633  9624 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:24.112634 14091 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:24.154127 13898 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:15:24.050984 14257 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:24.200892  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:24.208288  8889 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:24.269269  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68433.2us
W20260709 12:15:24.269426  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61228.8us
I20260709 12:15:24.223991 14224 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:24.202931  9000 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:24.153964  8918 raft_consensus.cc:2410] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:15:24.241969  8923 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:24.275749  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:24.245894  8996 rpcz_store.cc:276] 0709 12:15:22.960176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.960379 (+   203us) service_pool.cc:224] Handling call
0709 12:15:22.972090 (+ 11711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:23.156535 (+184445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.155787 (+999252us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000f5fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:24.155999 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399214336}
I20260709 12:15:24.276355  8923 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.255111 14276 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.255393 14055 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.293419  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.246663  9623 rpcz_store.cc:276] 0709 12:15:23.002746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.002960 (+   214us) service_pool.cc:224] Handling call
0709 12:15:23.026802 (+ 23842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:23.491653 (+464851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:23.491689 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:23.492224 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:15:23.653157 (+160933us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:23.653216 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.158207 (+504991us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540067fa54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:24.158262 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:24.158320 (+    58us) raft_consensus.cc:1685] finished
0709 12:15:24.158336 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:24.158599 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4685,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3620,"spinlock_wait_cycles":1068111232,"thread_start_us":160524,"threads_started":1,"wal-append.queue_time_us":180576}
I20260709 12:15:24.242859 14206 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.307966  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:24.308117 14206 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.265941  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:24.256976  9074 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:24.263561 14242 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.297410  9065 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:24.281150 14255 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:24.260118 14099 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.263813 14244 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.280833 14273 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:15:24.267580 14162 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.314477  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.300225  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:24.317217  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.276341 14275 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:24.336472  9616 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:24.340529  9621 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:24.325322  8922 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:24.296896 14322 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:15:24.345156  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:24.323577  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:24.350374  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.299010 14276 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.335559 14255 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:24.362716  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:24.355788  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.326965 14099 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.365201  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.328176 14308 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.327128 14250 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.358768  8922 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:24.346863 14271 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:24.370013  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:24.373272  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:24.258210  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 134118us
I20260709 12:15:24.315968 14242 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:24.326823 14206 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.375357  8923 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:24.379842  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:24.363802  9000 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:24.354558  9621 raft_consensus.cc:2410] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:15:24.367090  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:24.417416  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.417817  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:24.419469  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:24.361315 14091 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:24.422164  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52410.4us
I20260709 12:15:24.325683 14244 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.426367  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:24.429214  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:24.429890  8999 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:24.429999  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.430565  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.368501 14299 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:24.371960 14271 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.380844 14198 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:15:24.432920  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60816.9us
I20260709 12:15:24.434093 14255 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.466090  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:24.438748  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:24.438170  8963 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:24.466450  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:24.472036  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:24.472472  8999 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:24.433441 14308 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.381155 14249 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:15:24.481518  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 862) took 1229 ms. Trace:
I20260709 12:15:24.481719  9066 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:24.375833 14250 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.435194 14206 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.474238  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:24.435384 14211 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:24.478099 13998 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:24.491640 14211 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:24.492488 14346 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:24.471107 14198 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:24.492951 14211 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.493814 14198 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.478104 14099 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:24.496555 14099 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.481920  9624 rpcz_store.cc:276] 0709 12:15:23.252554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.252706 (+   152us) service_pool.cc:224] Handling call
0709 12:15:23.253029 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.263646 (+1010617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.481302 (+217656us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54004cf754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:24.481463 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164706176}
I20260709 12:15:24.497282 13998 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:24.496867 13996 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:24.497952 13996 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:24.498476 13996 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.498302 13998 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.498710 14099 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:24.504848 14276 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:24.506043 14348 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:24.508221 13885 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:15:24.511716 14343 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:15:24.514082 13844 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:24.514696 13844 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.515791 13996 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.516974 13844 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:24.473443 14241 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:24.519610 14241 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.521056  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.521612 14241 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.523094 14241 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:24.523564 14257 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:24.428718 14091 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.439258  8993 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:15:24.545859  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.556886  9066 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:24.473663 13898 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:24.568636 13844 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:24.565990 13885 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:24.573207 13885 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.573699 13885 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.577028 13996 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:24.557359 14336 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:24.577060 14250 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:24.583599 14162 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.585027 13985 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.585290 13844 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:24.585625 13985 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.585898 13844 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.586328 13970 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:24.586968 13970 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.587953 13985 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.588200 13844 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.589219 13970 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:24.601250  8925 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:15:24.601763  8925 pending_rounds.cc:85] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 10
I20260709 12:15:24.602010  8925 pending_rounds.cc:107] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:24.602257  8925 raft_consensus.cc:2889] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:24.604218  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.435499 14271 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:24.593323 14350 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.003s
I20260709 12:15:24.585536 14258 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:24.668015  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:24.664116  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69899.5us
I20260709 12:15:24.669729  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:24.668098  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 61851.3us
I20260709 12:15:24.674959  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:24.678102  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 407212us
I20260709 12:15:24.679723  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.697752  9065 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:24.673092  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.699594  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.705410  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.718784  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.697531 13898 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:24.700649 14275 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:24.723553 13844 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:24.729743  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2206) took 1072 ms. Trace:
I20260709 12:15:24.741643 13844 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:24.742748 13844 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.739774  8917 rpcz_store.cc:276] 0709 12:15:23.657272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.657388 (+   116us) service_pool.cc:224] Handling call
0709 12:15:23.662628 (+  5240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:23.676976 (+ 14348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:23.676999 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:23.680295 (+  3296us) log.cc:844] Serialized 26 byte log entry
0709 12:15:24.032830 (+352535us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18001312c0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:24.273890 (+241060us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:24.273933 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.274014 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:24.726795 (+452781us) raft_consensus.cc:1685] finished
0709 12:15:24.726825 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:24.729672 (+  2847us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6469,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2227,"spinlock_wait_cycles":9418496,"thread_start_us":240852,"threads_started":1,"wal-append.queue_time_us":688249}
I20260709 12:15:24.754845 14084 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.720988 14241 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:24.678838 14005 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:15:24.723721 14274 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:24.703399 14273 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:15:24.729807 13985 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:24.722757 14162 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:15:24.721917 14258 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:15:24.755667 14084 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.768158 14274 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.785511 13885 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.785967  8920 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:15:24.786469  8920 pending_rounds.cc:85] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 11
I20260709 12:15:24.786770  8920 pending_rounds.cc:107] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:15:24.786703 14224 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:24.787319  8920 raft_consensus.cc:2889] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:24.779409 13985 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:24.784801 14274 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:24.796932  9589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.018s	sys 0.007s
W20260709 12:15:24.797506  9589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.018s	sys 0.008s
I20260709 12:15:24.795229 13885 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:24.805788 14091 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:24.820520  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 389138us
I20260709 12:15:24.824635  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:24.826607  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.827677  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.829905  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.840389  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1073) took 1070 ms. Trace:
I20260709 12:15:24.844234  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:24.845036  8923 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:24.854176  9624 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:24.866882  8888 leader_election.cc:400] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:24.869176  8888 leader_election.cc:403] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:15:24.870342  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.871913  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:24.872601  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.860015  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.873426  9624 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:24.873505  9623 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:24.841104  8998 rpcz_store.cc:276] 0709 12:15:23.770201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.852280 (+ 82079us) service_pool.cc:224] Handling call
0709 12:15:23.870103 (+ 17823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:23.870575 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:23.870608 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:23.889510 (+ 18902us) log.cc:844] Serialized 26 byte log entry
0709 12:15:24.369497 (+479987us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:24.432242 (+ 62745us) log.cc:844] Serialized 14 byte log entry
0709 12:15:24.839961 (+407719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.840090 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:24.840139 (+    49us) raft_consensus.cc:1685] finished
0709 12:15:24.840152 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:24.840304 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35702,"prepare.queue_time_us":55343,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4840,"raft.queue_time_us":42672,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":5718,"spinlock_wait_cycles":7877504,"thread_start_us":829431,"threads_started":2,"wal-append.queue_time_us":793980}
I20260709 12:15:24.875097  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.877135  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.818221 14273 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:24.859103 14211 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:15:24.812875 14242 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.882052 14322 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:24.882921 14352 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:15:24.883808  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.886336 14256 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:24.890123  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 115063us
I20260709 12:15:24.901242  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.905418  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.907689 14149 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:24.906953  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.908279 14149 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.908763 14149 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.916467  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:24.921612 14229 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.923131 14250 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:24.923807 14250 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:24.924907 14250 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.929857  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:24.895000 14322 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:24.937044  8996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.024s
I20260709 12:15:24.902734 14256 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:24.941479  8996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.024s
I20260709 12:15:25.041890  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2613) took 2396 ms. Trace:
I20260709 12:15:24.963007  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.042524  8920 rpcz_store.cc:276] 0709 12:15:22.550555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.550854 (+   299us) service_pool.cc:224] Handling call
0709 12:15:22.551211 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.790713 (+2239502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.946952 (+156239us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540020f8d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:24.947187 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5138238336}
W20260709 12:15:25.063617  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 100693us
I20260709 12:15:25.061558 14142 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 12:15:25.062985  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.582s (SENT) [suppressed 19 similar messages]
I20260709 12:15:25.072525 14121 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:24.936187 14287 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15.
I20260709 12:15:24.935613 14224 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.084909  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:25.088495  9623 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:24.934377 14091 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:25.094014  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:24.930395 14092 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:25.090325  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 383407us
I20260709 12:15:24.895970 14273 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:24.942518 14322 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:25.081183 14344 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.043s
I20260709 12:15:25.045276 14256 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:25.094880  9624 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 9.
W20260709 12:15:25.107116  8997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.019s	sys 0.043s
W20260709 12:15:25.113056  8997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.020s	sys 0.043s
W20260709 12:15:25.089785 13998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.026s	sys 0.029s
I20260709 12:15:24.823037 13985 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:24.938676 14229 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:25.108214 14158 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.025s	sys 0.038s
I20260709 12:15:25.104924 14092 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:25.125597  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 420251us
W20260709 12:15:25.114238 14344 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.043s
W20260709 12:15:25.118315 13998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.027s	sys 0.029s
I20260709 12:15:25.137611  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.138213  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.138211  9069 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.138980  9070 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:25.139458  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 439813us
W20260709 12:15:25.129757  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:25.130486 14123 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:25.133219  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.157644  9074 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15.
I20260709 12:15:25.158738  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.159364 14268 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:25.159920  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.160534  9074 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:25.161378  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.162137  9074 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:25.102209 14091 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:25.164976  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 293132us
I20260709 12:15:25.132624 14249 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:25.134819  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.162896  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.163988  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.085654 14149 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.140532  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:25.124300 14158 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.025s	sys 0.038s
I20260709 12:15:25.148726  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.151587  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.152114  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.175052  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:25.115163 14251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.036s	sys 0.028s
I20260709 12:15:25.134642  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.183077  8888 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:25.137557 14092 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:25.187387 14251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.036s	sys 0.029s
I20260709 12:15:25.171499  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:25.175184  9068 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:25.154386  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.173866  9070 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:25.179400  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.133293  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.200426  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:25.136157 14241 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:15:25.205323  9065 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:25.196112 14369 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:15:25.196911 14355 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:15:25.197402  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.197835  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:25.198271 14356 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:15:25.166759 14270 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:25.228380 14270 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.230789 14270 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.168603 14005 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.210321 14377 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:25.231637 14005 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.232256 14377 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.232641 14377 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.233795 14005 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:25.212313  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2227) took 1004 ms. Trace:
I20260709 12:15:25.235390  8916 rpcz_store.cc:276] 0709 12:15:24.207749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.342647 (+134898us) service_pool.cc:224] Handling call
0709 12:15:24.356635 (+ 13988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:24.356973 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:24.357000 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:24.367737 (+ 10737us) log.cc:844] Serialized 26 byte log entry
0709 12:15:24.900570 (+532833us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:24.900622 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.900697 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:25.212070 (+311373us) raft_consensus.cc:1685] finished
0709 12:15:25.212090 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.212247 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2526,"raft.queue_time_us":3583,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14052,"thread_start_us":465416,"threads_started":1,"wal-append.queue_time_us":789052}
I20260709 12:15:25.169922 14249 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:25.217114 14084 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.217535 14242 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.219656 14273 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:25.220003 14358 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:25.172228 14123 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.171881 14268 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:15:25.207937 14287 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:25.224671 14271 consensus_meta.cc:287] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
W20260709 12:15:25.241705  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 178748us
W20260709 12:15:25.292752  8964 leader_election.cc:336] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.767s (SENT)
W20260709 12:15:25.293689  8964 leader_election.cc:336] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.849s (SENT)
I20260709 12:15:25.294039  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.294867 14099 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:25.291651 14271 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.243671  9623 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:25.248981  9069 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:25.265246  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.296494 14149 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:25.271363  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 204145us
I20260709 12:15:25.272711  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:25.296888  9065 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:25.297385 14271 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.278769  9624 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:15:25.281090 14363 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:15:25.281776 14123 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:25.278258 14287 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:25.299219 14287 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:25.300236 14271 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:25.284515  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.285435 14224 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:25.267495 14162 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:15:25.201452 14258 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 12:15:25.296247  8964 leader_election.cc:336] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.857s (SENT)
I20260709 12:15:25.301298  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:25.303509  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:25.306636 14091 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.284035 14371 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:25.313390  8918 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:15:25.308164  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:25.313799  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.341483  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.310303  9073 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:25.310798  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.314917  9070 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:25.312244  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.315482  8996 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:15:25.344053  8996 pending_rounds.cc:85] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 10
I20260709 12:15:25.344410  8996 pending_rounds.cc:107] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:25.344745  8996 raft_consensus.cc:2889] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:25.345324  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:25.315709  9069 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:25.346168  9623 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:25.312615  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:25.313166  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.351792  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:25.307214 14364 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 12:15:25.330444  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.319463  8993 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:25.354564  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.356564  8923 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:25.308820 14158 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:25.372423  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52110.5us
W20260709 12:15:25.373088  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76863.6us
I20260709 12:15:25.314234 14142 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.380780  9069 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:25.370620  9065 raft_consensus.cc:1240] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:15:25.316390 14224 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:25.382509  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.329970 14373 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:25.388919  8997 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:25.375732  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:25.377120  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.328132 14268 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:25.390847  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.378466  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.392594  9068 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.379074  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.380774  8996 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:25.364321 14162 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:25.370338  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:25.386134  8993 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:25.394891  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.396710  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.401216 14224 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.401822  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.402684  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.403931  8991 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:25.404871  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.405967  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.406433  8889 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:25.385957 14099 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.414180 14250 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:25.414884 14383 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:25.382277 14158 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.383615 14270 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:15:25.384729 14091 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:25.385550 14142 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.418851  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.419878 14162 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:25.420912  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.421519 14387 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:25.422365  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.422375 14268 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.428303  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.466115 14241 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:25.430907  9068 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:25.541571  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.542531  9068 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:25.446424 14274 consensus_meta.cc:287] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:15:25.357347 14371 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.408447 14373 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:25.448844  8964 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.552s (SENT)
I20260709 12:15:25.452004 14377 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.456679 14249 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.461782  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:25.607275  8999 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:25.465106  9069 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:25.609011  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:25.466465  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60143.9us
I20260709 12:15:25.484695  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.486966  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.487577 14383 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.487028  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.438690 14092 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:25.510865  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 134161us
I20260709 12:15:25.434898 14256 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.524415  8993 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:25.478017 14258 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:25.527948  9065 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.430397 14287 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.442932 14322 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.521401 14091 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.538337  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.540009  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:25.653671  9615 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:25.563265  8994 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:25.604784  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.521956 14224 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.612357  9067 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:15:25.655251  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 206409us
I20260709 12:15:25.523253 14123 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:25.621306  9066 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:25.483949 14084 consensus_queue.cc:1175] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "491a1127924f43d4a369f7d09c3a68db" responder_term: 14 status { last_received { term: 13 index: 9 } last_committed_idx: 9 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:25.483757 14250 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.638334  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.642307  8925 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:25.488451 14244 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.650964  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.657425  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.681824  8919 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:15:25.629578 14229 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.564170 14241 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:25.642671 14359 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:25.678659  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:25.563508 14283 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:15:25.684725  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.602835 14274 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.690037  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:25.685034  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:25.641793 14351 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:25.628582 13970 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 12:15:25.717650  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60304.7us
I20260709 12:15:25.693625  9067 raft_consensus.cc:2376] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15. Re-sending same reply.
I20260709 12:15:25.718504  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.709918  9068 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:25.719491  8999 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:25.669392 14249 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:25.668179 14099 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:25.686287 14350 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:25.636735 14211 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:15:25.725574  9000 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:25.727150  8993 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:15:25.754971 14274 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.756364 14256 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.766394  8921 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:25.768913  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 50484.1us
I20260709 12:15:25.664912 14255 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:15:25.765571  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 153971us
I20260709 12:15:25.721714 14235 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.787437  9615 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:25.684718 14123 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.726140 14372 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:25.829248  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 204747us
I20260709 12:15:25.680509 14162 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:25.837462  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 45546.9us
I20260709 12:15:25.707075 14351 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.698036 14229 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.686952 14258 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:15:25.787168 14271 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.770748 14388 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.842655  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:25.867216  8964 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:25.875532 14258 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:25.887934  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:25.864809 14142 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.877250 14258 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:25.857730 14271 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:25.895895 14268 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.896198 14383 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.896538 14268 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.896669 14322 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.851131 14274 consensus_queue.cc:1059] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:25.894938  8963 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:25.859737 14387 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.860324 14158 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.909508  9065 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
W20260709 12:15:25.911824 14399 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:15:25.902544 14383 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:25.923831 14401 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:15:25.924351 14123 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.907024 14387 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.925743 14271 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.906288 14411 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:25.897130 14268 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.932838  9066 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:25.860280 14388 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:25.905845 14241 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:25.905905 14322 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:25.942031  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:25.910570 14092 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.912197 14158 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:25.931914 14274 raft_consensus.cc:3055] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:25.957032  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:25.957489  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114987us
I20260709 12:15:25.957808  9615 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:25.958734  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:25.961742  9622 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:25.959128  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:25.932514 14091 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.960723  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:25.940299 14287 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.943674 14322 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.984591  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:25.947185 14371 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:25.960178 14377 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:25.959632 14274 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:25.988878  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:26.010339  9622 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
W20260709 12:15:26.011168  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 123350us
I20260709 12:15:25.961421 14250 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:25.995123 14322 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:26.005867 14287 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:26.006377 14411 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:25.990440 14387 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.030052  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:26.035321  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:26.032521 14287 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:26.037204  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:26.062362  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 83915.1us
I20260709 12:15:26.065090  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:26.065327  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:26.065752  8999 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 10.
I20260709 12:15:26.065876  8993 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:26.015043 14158 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:26.072540  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46809.9us
I20260709 12:15:26.074292  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:26.073089  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:26.077623  8993 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
W20260709 12:15:26.047943 14392 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:15:26.077244  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:26.048852 14097 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:26.033388 14411 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:26.053793 14268 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:26.059706 14287 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:26.074702 14211 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:26.114753 14211 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:26.093974  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:26.095614 14405 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:15:26.096462  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:26.117218 14398 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:15:26.098021  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:26.079444 14274 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.123719 14274 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:26.124434 14414 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:26.124929 14414 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.125322 14414 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:26.123900  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:26.115339 14211 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:26.128258 14406 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:26.128729 14406 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:26.129174 14406 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:26.131812  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:26.133248 14198 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:26.133692 14198 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.134083 14198 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:26.035699 14409 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:26.081641 14410 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
I20260709 12:15:26.072295 14377 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:26.133280 14373 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.093533 14362 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:26.139631 14362 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.139490 14287 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.140054 14362 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.141672 14287 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.088392 14097 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:26.100507 14158 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.101998  8963 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:26.103535 14422 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:26.231496  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.231710  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.232473  8922 raft_consensus.cc:2410] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:26.108522 14388 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:26.109499  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:26.110255 14360 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:26.110992 14229 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.094457 14411 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:26.145056 14415 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:15:25.996978 14258 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.147226 14211 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.151611  9623 raft_consensus.cc:2410] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:15:26.152427  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:26.153196  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:26.236297 14099 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.156836  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:26.160202  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:26.164388  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:26.252161  9067 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:26.252395  9616 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:26.238664 14092 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:26.172852  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:26.173708  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:26.257774  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:26.176354  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:26.178318  8992 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:26.174357 14373 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:26.194424  8921 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:26.196266  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.201352  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:26.243562 14229 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:26.233987  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:26.238211  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 128795us
I20260709 12:15:26.266561  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:26.240274  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.231859 13985 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.269654  8918 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:26.249933  9068 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:26.156824  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:26.273806  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:26.254638  9616 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:26.172490  9070 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:26.255559  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:26.281720  9074 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 11: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:26.261269  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:26.230387  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 128506us
I20260709 12:15:26.263152  8920 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:15:26.267876  9065 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:26.237862 14422 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.292760 14391 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:26.239846 14406 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.293354 14391 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.250629 14274 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:15:26.265762 14229 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:26.270452 14092 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:26.356909 14229 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:26.276080 13985 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.268648 14373 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.265357 14387 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:15:26.258951 14099 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.327303 14391 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.310338 14413 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:26.253552 14097 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.407656 14322 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:26.621507 14430 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:15:26.628080 14361 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:26.628718 14361 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:26.629629 14361 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.632969 14198 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.556789 14092 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.649873 14198 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:26.652267 14362 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 12:15:26.652912 14362 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:26.655864 14429 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:15:26.667011  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.492507 14414 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.684846 14414 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.730922  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1853) took 1312 ms. Trace:
I20260709 12:15:26.731717  8991 rpcz_store.cc:276] 0709 12:15:25.418489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.706413 (+287924us) service_pool.cc:224] Handling call
0709 12:15:26.125374 (+418961us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800002d98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:15:26.125603 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:26.126028 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.126064 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:26.126589 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.238760 (+112171us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:26.238804 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.238877 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.677257 (+438380us) raft_consensus.cc:1685] finished
0709 12:15:26.677289 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.730828 (+ 53539us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1039,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":23681408,"thread_start_us":110427,"threads_started":1,"wal-append.queue_time_us":129609}
I20260709 12:15:26.734880 14283 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.737815 14283 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:26.745905  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 479430us
I20260709 12:15:26.746858  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:26.753302  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1128) took 1582 ms. Trace:
I20260709 12:15:26.755348  9617 rpcz_store.cc:276] 0709 12:15:25.170689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.170817 (+   128us) service_pool.cc:224] Handling call
0709 12:15:25.192709 (+ 21892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.192863 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:25.243354 (+ 50491us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.752730 (+1509376us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b180040fd20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f3985c33060 00007f3985c45716 00007f3985c56287
0709 12:15:26.752862 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.752929 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:26.753003 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.753119 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.753248 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122020,"prepare.queue_time_us":98661,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":155249,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":30990,"spinlock_wait_cycles":7569792,"thread_start_us":472056,"threads_started":3,"wal-append.queue_time_us":668904}
I20260709 12:15:26.765997  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:26.766788  8920 raft_consensus.cc:606] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:26.767189 14274 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:26.767792 14274 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.768921  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:26.769531  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.769953 14274 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:26.771421 14419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.005s	sys 0.004s
I20260709 12:15:26.761718 14361 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:26.784533  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:26.785231  8997 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:26.795549  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.808151  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:26.808795  8999 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:26.810981  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64219us
I20260709 12:15:26.816147  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:26.885552  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:26.886423  9000 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:26.775458 14097 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:26.897274  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.898633  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:26.753170 14299 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:26.912732  9619 raft_consensus.cc:2393] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:26.775913 14406 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.910574  8917 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:26.806684 14207 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:26.776312 14322 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:26.823382 14412 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:15:26.892711 14274 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:26.927416 14207 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.927925 14417 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:26.823115 14409 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:26.893850 14158 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:26.954337 14373 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.967782 14373 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.968292 14373 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.970427 14373 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.971516 13985 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.929795 14299 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.951833 14274 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.978770 14274 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.947095 14425 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:26.981491 14425 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.922392 14283 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:26.987711 14207 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.988725 14158 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:26.992660 14362 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.993221 14362 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:26.993696 14362 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.996004  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:26.996784  8917 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:26.933288 14406 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:26.823923 14360 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:27.005565  9000 raft_consensus.cc:2468] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:26.941088  8997 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:27.000661 14409 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:26.944353  8999 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:27.011740 14425 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.971099 14373 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.953454 14211 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:26.975092 14299 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:27.002223 14158 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:27.038986  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.008213 14406 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:27.048743 14229 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:15:27.095710 14229 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:27.102718 14391 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 12:15:27.104600 14406 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.103227 14391 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.018066 14373 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.107722  8993 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:27.102954 14229 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:27.148689  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.149468  8991 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:27.156883 14207 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.157639 14207 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.163885 14270 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:27.164479 14270 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:27.165535 14270 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.174420  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1140) took 2033 ms. Trace:
I20260709 12:15:27.174983  9624 rpcz_store.cc:276] 0709 12:15:25.140964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.141101 (+   137us) service_pool.cc:224] Handling call
0709 12:15:25.141410 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.298150 (+156740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.167093 (+1868943us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54006103d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:27.174354 (+  7261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314987776}
I20260709 12:15:27.178213 14207 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:27.178467  9623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 1143) took 1825 ms (client timeout 1549 ms). Trace:
W20260709 12:15:27.179886  9623 rpcz_store.cc:269] 0709 12:15:25.353195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.353360 (+   165us) service_pool.cc:224] Handling call
0709 12:15:27.178131 (+1824771us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400770e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:27.178328 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706467072}
I20260709 12:15:27.181111  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.182246  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 870) took 1024 ms. Trace:
I20260709 12:15:27.182642  9621 rpcz_store.cc:276] 0709 12:15:26.157485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.157638 (+   153us) service_pool.cc:224] Handling call
0709 12:15:27.180917 (+1023279us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16e9c 00007f3982b16a5b 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac010a0 00007f398ac00984 00007f398417b6d4 00007f398417b662
0709 12:15:27.182160 (+  1243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4552064}
W20260709 12:15:27.193100  8994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 1091) took 1882 ms (client timeout 1660 ms). Trace:
W20260709 12:15:27.193693  8994 rpcz_store.cc:269] 0709 12:15:25.311131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.311957 (+   826us) service_pool.cc:224] Handling call
0709 12:15:27.192875 (+1880918us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002d7b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:27.193009 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504601984}
I20260709 12:15:27.203871  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.206526  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.208384  9623 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:27.116830 14393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.015s	sys 0.044s
I20260709 12:15:27.109517 14362 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:27.117029 14411 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.000s
I20260709 12:15:27.217491  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.225410  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2244) took 2077 ms. Trace:
I20260709 12:15:27.225883  8919 rpcz_store.cc:276] 0709 12:15:25.148044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.154310 (+  6266us) service_pool.cc:224] Handling call
0709 12:15:25.154707 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.682385 (+527678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.225178 (+1542793us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540020eed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:27.225355 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179603328}
W20260709 12:15:27.226697  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.222260  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.221130  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.225448  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1134) took 1043 ms. Trace:
I20260709 12:15:27.230786  9073 rpcz_store.cc:276] 0709 12:15:26.181835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.183024 (+  1189us) service_pool.cc:224] Handling call
0709 12:15:26.202298 (+ 19274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:26.202483 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:26.745019 (+542536us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.223707 (+478688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.223779 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:27.225242 (+  1463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.225313 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.225401 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56220,"prepare.queue_time_us":47255,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":224003,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":657331,"threads_started":2}
W20260709 12:15:27.227843 14393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.015s	sys 0.045s
W20260709 12:15:27.240927 14440 log.cc:927] Time spent T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:15:27.243613 14438 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:15:27.247886 14373 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:27.249406 14409 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.250113 14409 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.250692 14409 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.258337 14409 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.259768  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.260555  9621 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:27.230984 14411 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.266623 14411 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:27.231812 14391 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.268121 13885 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:27.268854 13885 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.280432  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.288175  9619 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:27.294526  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.295507  9619 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:27.308319  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:27.309952  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.310510  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.310854  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.312191  9621 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:27.312458  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.313256  9623 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:15:27.315078  8923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.012s	sys 0.016s
W20260709 12:15:27.315495  8923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.013s	sys 0.016s
I20260709 12:15:27.315526  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.337888 14270 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.340561 14258 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:27.336122  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2642) took 1141 ms. Trace:
I20260709 12:15:27.312000 13885 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:27.350839  9621 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:27.348932  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:27.357489  9623 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:27.345124  8923 rpcz_store.cc:276] 0709 12:15:26.195211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.195399 (+   188us) service_pool.cc:224] Handling call
0709 12:15:26.195728 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:26.197593 (+  1865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.197635 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:26.198193 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.527563 (+329370us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:27.316048 (+788485us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.335772 (+ 19724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.335854 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.335894 (+    40us) raft_consensus.cc:1685] finished
0709 12:15:27.335909 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.336045 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1454,"raft.queue_time_us":2264,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":13770,"thread_start_us":1021163,"threads_started":2,"wal-append.queue_time_us":802249}
I20260709 12:15:27.327390 14360 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:27.365301  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.367774  8994 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:27.369911  9618 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:27.317723 14158 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:15:27.376081  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.376807  8994 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:27.356901 14229 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:27.395005  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.401454  8994 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 10: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:27.368387 14360 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:27.402025  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.401084 14229 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.408361  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.409108  8991 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:27.407866 14229 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.419643  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.420922  9616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 878) took 1119 ms. Trace:
I20260709 12:15:27.434460  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.366129 14092 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:15:27.432438  9616 rpcz_store.cc:276] 0709 12:15:26.301207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.419329 (+1118122us) service_pool.cc:224] Handling call
0709 12:15:27.420845 (+  1516us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:27.435885  9622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.002s	sys 0.022s
I20260709 12:15:27.395908 13885 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:27.403211 14360 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:27.446645  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:27.440009  9622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.002s	sys 0.022s
I20260709 12:15:27.450882  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 876) took 1201 ms. Trace:
W20260709 12:15:27.445196  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.013s	sys 0.011s
W20260709 12:15:27.454941  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.013s	sys 0.011s
W20260709 12:15:27.455763  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 639706us
I20260709 12:15:27.456936  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.457425  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.451503  9622 rpcz_store.cc:276] 0709 12:15:26.249195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.260240 (+ 11045us) service_pool.cc:224] Handling call
0709 12:15:26.260606 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:26.272299 (+ 11693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.272340 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:26.293774 (+ 21434us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.824549 (+530775us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:15:26.908325 (+ 83776us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.450433 (+542108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.450552 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.450616 (+    64us) raft_consensus.cc:1685] finished
0709 12:15:27.450639 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.450811 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11237,"prepare.queue_time_us":83806,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":8547,"raft.queue_time_us":96498,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":17008,"thread_start_us":933471,"threads_started":2,"wal-append.queue_time_us":725750}
I20260709 12:15:27.396245 14362 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:15:27.462833  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.436254 14448 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.473084  8991 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:15:27.473621  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 243391us
I20260709 12:15:27.463512 14362 consensus_queue.cc:1243] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:27.487561  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.456612 14229 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.488489  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:27.450999 13885 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.496870  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.493682  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.502213  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.502336  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:27.503994  9624 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
W20260709 12:15:27.502485  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 45690.5us
I20260709 12:15:27.489638 14351 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:27.520938  8996 raft_consensus.cc:2368] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:27.484349 14448 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.527417  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.505386 14158 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.505164 14449 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:27.551846  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44431.2us
W20260709 12:15:27.556545  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.566823  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.570477  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.575687  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:27.558363  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.558790 14149 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:27.557011 14255 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.539611 14158 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:27.597062  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 470636us
I20260709 12:15:27.598477  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.600464  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.603710  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.606745  9587 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.608796  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:27.609591  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 290167us
I20260709 12:15:27.594888 14361 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.612478  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:27.610864  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.614902  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:27.615643  9618 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:27.615911  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.616438  9624 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:27.617251  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.618736  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.618985 14447 raft_consensus.cc:2804] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:27.619753 14447 raft_consensus.cc:697] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:27.619904  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.621325 14362 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:27.620954 14447 consensus_queue.cc:237] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:27.621743 14455 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:15:27.620982  9618 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:27.596598 14425 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.621892 14443 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.615547  9072 raft_consensus.cc:606] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:27.621744 14362 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:27.626579 14445 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:27.628201 14411 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:27.623328 14351 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:27.595750 14255 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.651955  9617 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:27.632072  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.633579  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.652983  9618 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:27.654511  9618 pending_rounds.cc:85] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 9
I20260709 12:15:27.654889  9618 pending_rounds.cc:107] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:15:27.655176  9618 raft_consensus.cc:2889] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:27.628366 14361 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.623977  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.604954 14409 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:27.642110 14358 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.635917  8918 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:27.603196 14378 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.640125  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.609221 14084 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:15:27.603834 14450 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.608284 14149 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:27.643904  8920 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:27.610124 14452 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.702450  8923 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:27.601794 14465 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:15:27.637220 14322 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:27.659509  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:27.704766  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 45362.5us
I20260709 12:15:27.705480  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.705864  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.642499 14422 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.644212 14443 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.644331 14362 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:27.658371 14414 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:27.635429  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.688488 14426 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:27.664247  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.664686  8994 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:27.695753  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 83364.6us
I20260709 12:15:27.713557  8922 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:27.713853  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:27.662971 14409 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:27.716012  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 80673.7us
I20260709 12:15:27.717461  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.641745 14425 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.623900 14251 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:15:27.710706  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:27.711192  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.710301 14299 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:27.694864 14197 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.712401 14149 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:27.721544 14322 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.719033 14409 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:27.696081 14207 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:15:27.726565  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.663028 14273 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:15:27.710232  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.760424  8917 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:27.731726  8916 raft_consensus.cc:2410] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:27.728950  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.711900 14351 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:27.735179  8922 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:27.693964 14378 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.710680 13885 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:27.736444  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:27.714852 14451 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.721238  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.739688  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 905) took 2471 ms. Trace:
I20260709 12:15:27.741650 14197 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.745273  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:27.720309 14450 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:27.748152  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:27.750913 14443 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:27.753506 14255 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.727526 14448 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.728911 14358 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.730423 14426 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:27.756618  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.778925  9072 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:27.761281  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:27.779877  9068 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:27.755090 14299 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:27.763388  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:27.787016  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50661.9us
I20260709 12:15:27.771374  8925 rpcz_store.cc:276] 0709 12:15:25.267998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.268843 (+   845us) service_pool.cc:224] Handling call
0709 12:15:25.269229 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.686295 (+417066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.739354 (+2053059us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400244354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:27.739611 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857528704}
I20260709 12:15:27.773908  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3422) took 1535 ms. Trace:
I20260709 12:15:27.775025 14449 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:15:27.775642  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54482.3us
I20260709 12:15:27.776211  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.786466  8889 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:27.795315  9616 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:27.793313  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:27.795915  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 79640.9us
I20260709 12:15:27.790052  9074 rpcz_store.cc:276] 0709 12:15:26.238824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.282468 (+ 43644us) service_pool.cc:224] Handling call
0709 12:15:26.282945 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:26.283487 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.283531 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:26.807544 (+524013us) log.cc:844] Serialized 52 byte log entry
0709 12:15:27.304341 (+496797us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:27.317210 (+ 12869us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.321258 (+  4048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.321359 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.773703 (+452344us) raft_consensus.cc:1685] finished
0709 12:15:27.773723 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.773851 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3741,"prepare.queue_time_us":12620,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":8830,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":9297,"thread_start_us":408232,"threads_started":1,"wal-append.queue_time_us":608481}
I20260709 12:15:27.778594 14360 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.764076 14351 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:27.815032  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51994.2us
I20260709 12:15:27.815830 14449 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:27.816847 14449 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.818994  9068 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:27.821929  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.828723 14360 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:27.829771  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 100875us
I20260709 12:15:27.769886 14411 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:27.831571  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.812462  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:27.832640  8994 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:27.832973  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46621.4us
I20260709 12:15:27.832182  8997 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.773330 14158 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.847417  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.772801 14283 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:27.757439 14005 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:15:27.841637  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:27.843928  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.786458 14450 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:27.848646  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.860152  9622 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:27.784112 14299 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.848742  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.850571  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:27.851081 14207 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.803112 14443 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:27.798216 14414 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:27.848454  8992 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:27.875990  8994 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:27.877312  8994 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:27.860024  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:27.849339  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:27.877825  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 61324.2us
I20260709 12:15:27.864989  8997 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:15:27.822973 14351 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:27.865934  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.848495 14211 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:27.800587 14472 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:27.879657  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.880541  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.887967  9622 raft_consensus.cc:2368] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:27.889130  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:27.813475 14465 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:27.880693  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.892930  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.881887  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:27.785367 14451 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:27.891214  8888 connection.cc:256] RPC call timeout handler was delayed by -1.1404904119999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 12:15:27.893795  8995 raft_consensus.cc:2410] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:15:27.894438  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.898572  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.861418 14361 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.902503  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:27.872634 14462 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.861634 14450 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:27.880970 14443 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.904872  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:27.885042 14444 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:27.885596 14448 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.915879 14446 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:27.916358 14446 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:27.916524 14467 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:15:27.916790 14446 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.918402 14451 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.910892 14358 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.919281 14358 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.921824  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1110) took 1137 ms. Trace:
I20260709 12:15:27.922201  8993 rpcz_store.cc:276] 0709 12:15:26.784403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.784534 (+   131us) service_pool.cc:224] Handling call
0709 12:15:26.784812 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:27.109653 (+324841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.921590 (+811937us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002f5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:27.921762 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742035712}
I20260709 12:15:27.923313 14005 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.913098 14479 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:15:27.931604 14099 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:27.932502 14422 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:27.893183 14472 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:27.935138  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.892441 14211 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.908278  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
W20260709 12:15:27.904495 14474 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:15:27.778597 14426 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.944222  8996 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:27.948591  8991 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 12:15:27.912914  9037 leader_election.cc:400] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:27.938895  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.852732 14411 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.948736  9040 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:27.895627 14473 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:27.899093 14273 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:15:27.899943 14084 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.866286 14283 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.949347  9037 leader_election.cc:403] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:27.880154 14207 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.949651  8999 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:27.940761 14462 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:27.950222  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.915032 14444 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:27.976752  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.940140 14274 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.952097  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.980110  8995 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:27.953903  8996 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:27.898445 14465 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.930999 14451 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:15:27.914186 14443 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:27.970152  8991 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:27.911012 14477 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:15:27.970270  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.906922  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:27.941651  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 111549us
I20260709 12:15:27.969359 14005 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:27.952745 14211 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:27.988915  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.959209 14479 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:27.884794 14149 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:27.959091 14473 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:28.001448  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 102967us
W20260709 12:15:28.023986  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 111250us
I20260709 12:15:27.983175  8996 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:27.941546 14448 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.014007  8993 raft_consensus.cc:2368] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:27.927989 14446 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.005885  8999 raft_consensus.cc:2393] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:28.009596  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.029907  9073 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:28.015304  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:28.015579  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52761.1us
I20260709 12:15:27.946681 14422 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:27.970758 14373 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:15:28.024121  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.024341  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.051438  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.025676  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.011116  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:28.052649  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.052946  9617 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:28.053722  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:28.010119 14005 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.975124 14084 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.055133 14005 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.047014  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.055867  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:28.056950 14084 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.057209  8995 raft_consensus.cc:1240] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:28.057513 14084 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:28.058293 14084 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:28.058744 14084 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:28.049913  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.025187  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.021749  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.059859  8999 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:28.060657  8996 raft_consensus.cc:2410] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:15:28.012264 14425 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.061924  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:27.997551 14274 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.063709  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:28.072703  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.073890  8917 raft_consensus.cc:2410] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:15:28.027442 14473 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:28.024039 14258 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.683s	user 0.014s	sys 0.000s
I20260709 12:15:28.020808 14479 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:28.021797 14378 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:28.068789 14437 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 1.020s	user 0.006s	sys 0.000s
I20260709 12:15:28.095137 14411 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.005116 14472 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.096657 14472 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.098423 14446 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.099422 14446 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:28.100068 14207 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.100225 14377 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.100864 14377 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.076596  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.104101  8999 raft_consensus.cc:2376] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12. Re-sending same reply.
I20260709 12:15:28.104911 14448 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.105317  9615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 871) took 1947 ms. Trace:
I20260709 12:15:28.107750 14084 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:28.108419  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44825us
I20260709 12:15:28.047567 14255 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:15:28.111419  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.111792 14255 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:28.112057  8925 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:28.112275 14255 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:28.112941  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.113169 14255 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.114024  8924 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:28.115209  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.116671  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.118459 14476 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:28.069195  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.080638  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.061170 14451 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:15:28.063804 14452 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:28.092979 14422 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:28.093475 14270 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.755s	user 0.006s	sys 0.006s
I20260709 12:15:28.074640 14197 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.064517 14251 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:28.089035 14274 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:28.123250  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 122586us
I20260709 12:15:28.124378  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.179901  8991 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:28.114043  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.105831  9615 rpcz_store.cc:276] 0709 12:15:26.157832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.157949 (+   117us) service_pool.cc:224] Handling call
0709 12:15:26.158255 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:26.169686 (+ 11431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.169731 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:26.176329 (+  6598us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.527935 (+351606us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:26.597248 (+ 69313us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.281654 (+684406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.281762 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.911455 (+629693us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:28.104978 (+193523us) raft_consensus.cc:1685] finished
0709 12:15:28.105099 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:28.105250 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84168,"prepare.queue_time_us":30422,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":212809,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"spinlock_wait_cycles":6980480,"thread_start_us":724712,"threads_started":2,"wal-append.queue_time_us":826305}
I20260709 12:15:28.182168  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.126950  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.183718  8924 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:28.184756  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.185914  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.134258  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.135670  9000 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:28.136447  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:28.112960 14460 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
I20260709 12:15:28.140664 14005 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:28.141238 14461 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.514s	user 0.000s	sys 0.002s
I20260709 12:15:28.113198 14287 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:28.144420  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.146232  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.210661  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.148175 14465 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.150732  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.160467  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.082052 14479 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.125839 14273 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:28.198185  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.060047 14444 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.199811  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.239758  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.215945  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.220655  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.240413  8925 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
W20260709 12:15:28.231068  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.232975  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.241257  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.241994  8925 raft_consensus.cc:2393] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:28.199128  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.242111  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.236403  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.244321  8923 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:28.244490  9619 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:28.240784  8999 raft_consensus.cc:2376] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12. Re-sending same reply.
I20260709 12:15:28.245182  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.245437  9621 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:28.196309 14422 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:28.246539  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 221399us
I20260709 12:15:28.247444  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.247071  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.268252  8917 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.250192  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.256861  9587 leader_election.cc:400] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:28.261030  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.270044  9587 leader_election.cc:403] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:28.273845  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.210069 14287 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:28.279246  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 226596us
I20260709 12:15:28.255841  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.280927 14444 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:28.261493 14464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.003s	sys 0.010s
I20260709 12:15:28.258016 14273 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:28.297358  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.306766  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:28.291302 14409 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:15:28.310737  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:28.303831  8923 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:28.304754  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1096) took 2236 ms. Trace:
I20260709 12:15:28.311654  8998 rpcz_store.cc:276] 0709 12:15:26.063076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.063491 (+   415us) service_pool.cc:224] Handling call
0709 12:15:26.063982 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:26.092553 (+ 28571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.092602 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:26.094593 (+  1991us) log.cc:844] Serialized 52 byte log entry
0709 12:15:27.206834 (+1112241us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b18001ffa80. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:27.539075 (+332241us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:27.539423 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.539531 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:28.112299 (+572768us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:28.299579 (+187280us) raft_consensus.cc:1685] finished
0709 12:15:28.299601 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:28.299757 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18855,"raft.queue_time_us":29161,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":8525,"spinlock_wait_cycles":175060608,"thread_start_us":332019,"threads_started":1,"wal-append.queue_time_us":1461433}
I20260709 12:15:28.308439  8916 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:28.293265  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.316084  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.317245  9040 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:28.309516  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 154525us
I20260709 12:15:28.285916 14465 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:28.283157  8966 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:28.279366 14123 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:15:28.300140 14249 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
W20260709 12:15:28.322777 14362 consensus_meta.cc:287] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.003s
I20260709 12:15:28.327706 14362 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.328830  8992 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:15:28.326881 14273 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:28.332427 14486 log.cc:927] Time spent T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:28.302309 14373 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:15:28.318928  8888 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:28.277788 14422 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.341162 14499 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:28.341702 14499 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:28.316730 14409 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.342082 14499 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.342483 14422 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.276081 14477 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:15:28.323223 14497 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:28.343789 14497 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.343931 14409 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.344203 14497 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:28.322722 14251 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:28.338871 14465 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.347538  8922 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
W20260709 12:15:28.323489 14485 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:28.347671 14465 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.348075  8918 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:28.348454  8918 raft_consensus.cc:614] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:28.280578 14443 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.338239 14092 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:28.349422  8922 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:28.349541 14005 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.349756 14092 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:28.350260 14092 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.350996 14283 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.352351  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34344 (request call id 1131) took 3177 ms. Trace:
W20260709 12:15:28.309105 14464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.003s	sys 0.011s
I20260709 12:15:28.352710  9620 rpcz_store.cc:276] 0709 12:15:25.175489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.175702 (+   213us) service_pool.cc:224] Handling call
0709 12:15:27.167289 (+1991587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:27.167522 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:27.167853 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.530993 (+363140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.531063 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:27.531125 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.531214 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:28.351629 (+820415us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b18003d67e0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4
0709 12:15:28.352170 (+   541us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54006103d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:28.352275 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":435,"prepare.queue_time_us":2765,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":6066,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":14895,"spinlock_wait_cycles":4704015232,"thread_start_us":356876,"threads_started":1,"wal-append.queue_time_us":439764}
I20260709 12:15:28.317996 14351 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.358985 13885 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:28.373634 13885 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.374922 14351 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.375756 13885 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.359513  9074 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:28.377055  9624 raft_consensus.cc:2368] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:28.359700  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.377872  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.378201  8918 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.359894 14443 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.360091 14490 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:28.360388 14358 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.361029 14450 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.326956 14377 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.362515 14287 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.363648  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.364583  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.365252  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.366415  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.402420  8923 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:28.366640 14499 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.405663 14499 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.368498  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.406773 14450 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.408958  8916 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:28.369496  8999 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:28.370136  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:28.372888  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.353597 14211 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.392791 13885 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:15:28.398669  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.402701  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:28.403364  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.461002  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:28.393563 14501 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:15:28.388684  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.424623  8993 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:28.467340  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:28.424331 14358 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:15:28.438081 14005 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:28.439908 14473 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:28.448836 14457 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.804s	user 0.002s	sys 0.000s
I20260709 12:15:28.452761 14211 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.453579 14362 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:28.469129  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66575.5us
I20260709 12:15:28.479578  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:28.480350  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.477394 14268 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:28.482091 14464 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.469604 14283 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:28.470892  8991 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:28.428390  8919 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:28.474018  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.483220 14255 consensus_queue.cc:1059] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:28.629408  8918 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:28.636158  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.458429 13885 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:28.394675 14417 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:15:28.645020  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:28.648080  8923 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:28.564601 14287 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.655735  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.657348  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.658265  9040 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:28.658874  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.660461  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:28.493036 14448 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.168s
I20260709 12:15:28.660663  8923 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:28.661775  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.666466  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:28.667572 14495 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:28.673902  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.680066  8919 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:28.651888 14499 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:28.669323  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:28.688534  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:28.674834  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.669341  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:28.690635  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:28.695984  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:28.705943 14472 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
I20260709 12:15:28.708094 14351 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:28.708142  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 45726.8us
I20260709 12:15:28.813979  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.661100 14362 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.672611 14496 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:28.712262 14419 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:28.662794 14417 consensus_queue.cc:1243] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:15:28.668160 14493 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:15:28.715981 14494 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:15:28.718183 14504 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:15:28.839188 14493 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:28.839603 14493 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:28.720500 14229 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:28.840489 14493 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:28.725380 14502 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:15:28.841670 14493 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.726260 14495 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:28.672081 14451 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:28.842551 14207 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:28.843176 14207 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:28.845407 14469 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.126s	user 0.003s	sys 0.000s
I20260709 12:15:28.846626  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2655) took 1871 ms. Trace:
I20260709 12:15:28.846999  8921 rpcz_store.cc:276] 0709 12:15:26.975739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.975906 (+   167us) service_pool.cc:224] Handling call
0709 12:15:26.976415 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:27.422055 (+445640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:27.422085 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:27.422542 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:15:27.602595 (+180053us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:27.602660 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.602750 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:28.844830 (+1242080us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:28.846327 (+  1497us) raft_consensus.cc:1685] finished
0709 12:15:28.846353 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:28.846569 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2498,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":29505,"spinlock_wait_cycles":18677632,"thread_start_us":593086,"threads_started":2,"wal-append.queue_time_us":243770}
I20260709 12:15:28.732010 14092 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.734328 14479 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.740418  8919 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:28.744801 14097 raft_consensus.cc:993] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
W20260709 12:15:28.745942 14466 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.015s	user 0.011s	sys 0.000s
W20260709 12:15:28.747642 14459 log.cc:927] Time spent T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.119s	user 0.008s	sys 0.004s
I20260709 12:15:28.749091 14480 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:28.765354 14211 raft_consensus.cc:3055] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:28.784092  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42094 (request call id 879) took 1366 ms. Trace:
I20260709 12:15:28.864208  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.864495  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.865103  9000 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:28.785760 14373 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.876495  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.793229 13885 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:28.799624  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 103748us
I20260709 12:15:28.877355  8997 raft_consensus.cc:2368] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:28.877803  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:28.802824  8917 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:15:28.816339  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.812165 14268 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:28.826524 14409 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:28.817034 14362 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.884105  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:28.884341  8993 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:28.837049 14496 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:28.621148 14283 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:28.862437  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 442067us
I20260709 12:15:28.896817  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.864002  9621 rpcz_store.cc:276] 0709 12:15:27.417424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.421901 (+  4477us) service_pool.cc:224] Handling call
0709 12:15:28.783842 (+1361941us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54005929d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:28.783998 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621675776}
I20260709 12:15:28.747119 14497 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.637562 14446 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:28.882736  8917 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
W20260709 12:15:28.883884  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67630us
I20260709 12:15:28.914582  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.887297  9000 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:28.891513  8991 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:28.901521  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.916512  9068 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:15:28.900910  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.900292  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.917601  9065 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:28.899590  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.904609  8925 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:28.919166  8923 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:28.862099 14377 raft_consensus.cc:1081] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:28.903589  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.904862  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3439) took 1050 ms. Trace:
I20260709 12:15:28.904228  9617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 885) took 1351 ms. Trace:
I20260709 12:15:28.925925  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:28.926517  8991 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.928874  9623 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:28.844271 14207 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.908675  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.902223  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.909713  9618 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:28.911386  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:28.925309  9074 rpcz_store.cc:276] 0709 12:15:27.854801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.854952 (+   151us) service_pool.cc:224] Handling call
0709 12:15:27.855380 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:28.376636 (+521256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:28.904639 (+528003us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54002099d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:28.904807 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158961408}
I20260709 12:15:28.919374  9072 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:28.866776 14480 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:28.932989  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.920256  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.934391  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.863812 14211 raft_consensus.cc:740] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:28.900171  9066 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:28.918138  9073 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:28.934916  9065 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:28.941545  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.942204  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.892329 14097 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:28.948737  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.950590 14092 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.950197 14496 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:28.950978 14473 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.952437 14283 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.914278 14446 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:28.886267 14373 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.957118 14497 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:28.941605  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.957497 14373 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:28.958424  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.959582  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.887488 14495 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:28.925632  9617 rpcz_store.cc:276] 0709 12:15:27.552660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.652751 (+100091us) service_pool.cc:224] Handling call
0709 12:15:27.665408 (+ 12657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:28.053452 (+388044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:28.903920 (+850468us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400477a54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:28.904151 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890746624}
I20260709 12:15:28.925470  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.910034 13885 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:28.964051  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.952592 14473 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:28.964522  8991 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:28.964655  9073 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.947026  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.967767  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.947211  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:28.960860  9065 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.959714  9070 raft_consensus.cc:2376] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16. Re-sending same reply.
I20260709 12:15:28.943835  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:28.969205  9074 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.969571  9066 raft_consensus.cc:2376] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15. Re-sending same reply.
I20260709 12:15:28.970448  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:28.970890  9066 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:28.973111  9066 raft_consensus.cc:3055] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:28.973486  9066 raft_consensus.cc:740] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:28.974409  9066 consensus_queue.cc:260] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:28.979179  9066 raft_consensus.cc:3060] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.982798  9065 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:28.984760  9071 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:28.986219  9072 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:28.996434  9074 raft_consensus.cc:2410] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:15:29.002454  9073 raft_consensus.cc:2410] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:15:28.981822 14121 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:29.006259  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3425) took 1805 ms. Trace:
I20260709 12:15:28.980924 14473 consensus_queue.cc:1243] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:15:28.959061 14211 consensus_queue.cc:260] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.006646  9069 rpcz_store.cc:276] 0709 12:15:27.201224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.202561 (+  1337us) service_pool.cc:224] Handling call
0709 12:15:27.203017 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:27.203538 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:27.203591 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:27.204339 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 12:15:27.552201 (+347862us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:27.552249 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.552314 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:28.746992 (+1194678us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:28.999307 (+252315us) raft_consensus.cc:1685] finished
0709 12:15:28.999333 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:29.006193 (+  6860us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2236,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"spinlock_wait_cycles":158586624,"thread_start_us":347366,"threads_started":1,"wal-append.queue_time_us":423712}
I20260709 12:15:28.998207 14495 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:28.971560 14497 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:15:29.023357  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.028237  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:29.034865  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.009591 14477 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.005801 14121 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:29.042472  9069 raft_consensus.cc:1240] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:29.049419  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 79071.9us
I20260709 12:15:29.050639  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.036439 14211 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.037979 14495 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.056998 14495 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.051687 14444 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:29.059671 14444 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:29.060232 14444 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.064013  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.072463 14084 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:29.072922 14084 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.071985 14121 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.073964 14121 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:29.073725 14084 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.074748 14084 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.074010  9073 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:29.079664  9068 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:15:29.081331  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.082223  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:29.083396  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 168891us
I20260709 12:15:29.083482 14452 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:29.083956 14452 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.084313 14452 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:29.084669  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.085088 14479 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.049314 14443 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:29.086306 14443 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:29.087419 14377 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.087210 14443 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.088119 14377 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:29.088724 14443 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.089586 14377 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.044728 14497 raft_consensus.cc:993] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:29.091157 14497 raft_consensus.cc:1081] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:29.092878  9616 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.093140 14452 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.052541 14362 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.095311 14452 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.097877  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.098950  9073 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:29.087137  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.100023  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.100522  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:29.102173 14255 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:29.103190  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:29.105268  9074 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:29.105729  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:29.106381  9073 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.109845 14499 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:29.110380 14499 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.113373  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:29.116794  9070 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
W20260709 12:15:29.119479  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 68946.2us
I20260709 12:15:29.120970  8924 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:29.139599 14493 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:29.140684 14287 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:29.142017  8963 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:29.142696 14475 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:29.142994 14417 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:29.143746 14417 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:29.144680 14417 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.145308  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:29.145459  8888 leader_election.cc:400] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:29.145831  8888 leader_election.cc:403] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:29.145897  9074 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:29.147189 14287 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12.
I20260709 12:15:29.143075 14475 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.148355  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.148411 14475 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.149672 14475 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.151543 14287 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.152731  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:29.154630  9074 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:29.155701 14287 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:29.156262 14287 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.157187 14287 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.158663  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.159657 14490 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.121892 14444 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:29.162637  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.164692  8993 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 12:15:29.161319  8888 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:29.177331  8993 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:29.196671  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.198304  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.200381  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.201757  9073 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:29.202327  9069 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:29.171482  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:29.203110  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 126797us
W20260709 12:15:29.244240  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 319928us
W20260709 12:15:29.247793  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 86527.5us
W20260709 12:15:29.248086  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 160998us
I20260709 12:15:29.249198  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.250317  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:29.250936  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:29.252121  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:29.252254  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:29.253086  8922 raft_consensus.cc:2376] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16. Re-sending same reply.
W20260709 12:15:29.254104  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53804.7us
W20260709 12:15:29.254276  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 66847.1us
I20260709 12:15:29.255066  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.256858  8889 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:29.260448  8963 leader_election.cc:400] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:29.261053  8963 leader_election.cc:403] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:15:29.268107  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:29.268821  8923 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:15:29.270797  9066 raft_consensus.cc:1275] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:29.272073  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:29.272946  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 105738us
I20260709 12:15:29.273290  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.294586  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:29.300371  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51279.7us
I20260709 12:15:29.301442  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.304770  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:29.271602 14211 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:29.275573  8993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:29.319607  8993 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.320089  8993 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:29.273030 14283 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:29.271467 14497 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:29.267431 14479 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.298906 14498 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:29.293098 14512 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.296986 14481 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:29.299782 14448 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:29.275600 14472 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.310300 14092 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:29.310711 14447 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.256251 14005 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:15:29.271361 14377 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:15:29.327157 14497 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:29.310612 14451 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:29.311125 14477 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.275983 14197 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:15:29.355490  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:29.306263 14492 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:15:29.410015 14492 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:29.410527 14492 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:29.411635 14492 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.368050 14149 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:29.369827 14377 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:29.337071 14476 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.331359 14495 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:29.357856  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 124102us
I20260709 12:15:29.349802 14409 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:29.383549  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 114236us
I20260709 12:15:29.378564  8993 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.316814 14351 consensus_queue.cc:1048] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:15:29.334297 14522 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.346959 14158 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
W20260709 12:15:29.376828  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:29.432646  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 77249.6us
I20260709 12:15:29.347673 14481 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:29.424336  8993 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:29.436152  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.371969 14497 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:29.371042 14092 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:29.459089  9068 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:29.418150 14377 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.420064 14450 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:29.435470 14351 consensus_queue.cc:1243] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:15:29.420351 14211 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.465795 14211 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:29.467798 14525 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:15:29.468333  9067 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:29.447021 14452 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.469660 14481 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.469975 14452 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.471781 14528 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.446637 14464 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:29.481297  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 172460us
I20260709 12:15:29.486187  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.488547  9068 pending_rounds.cc:85] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 12
I20260709 12:15:29.488898  9068 pending_rounds.cc:107] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:15:29.489140  9068 raft_consensus.cc:2889] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:29.499778  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 51488.3us
I20260709 12:15:29.501137  9069 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:29.471081 14481 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:29.434064 14495 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.459035 14158 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:29.358177 14512 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.506393  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:29.511615  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:29.432082 14149 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.515133  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:29.485633 14464 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:29.563623  9616 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:15:29.538142  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52015.6us
I20260709 12:15:29.473201 14426 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 12:15:29.566761  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 264430us
W20260709 12:15:29.574409  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 152051us
W20260709 12:15:29.567807  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 292918us
I20260709 12:15:29.481848 14450 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.518181 14448 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:29.517553 14444 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:29.585237  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 290721us
I20260709 12:15:29.472368 14528 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.567795 14464 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.525741 14477 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.520183 14529 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:29.563388 14351 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.598220  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.600893  8996 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:15:29.595862 14521 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:15:29.577333 14534 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:29.610237  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:29.635831  8991 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:29.649430  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.527220 14158 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.579465 14358 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 12:15:29.655084  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57056.2us
I20260709 12:15:29.633304 14452 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.659762  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.661361  9618 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:29.664039  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:29.666325  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.576198 14092 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:29.656903 14518 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.001s
I20260709 12:15:29.678632  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:29.681747  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.682152  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.683172  9073 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:29.587332 14377 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.658345 14479 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.686690  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:29.687393  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.693058  9073 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:29.665555 14472 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:29.668280 14452 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:15:29.698953  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:29.699594  8996 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.700419  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:29.701560  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.692565  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.671927 14476 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:29.709667  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:29.663498 14409 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:15:29.694564  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:29.713374  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:29.720841  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:29.632431 14477 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.687778 14489 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:29.689338 14530 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:29.733608  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.731434  9073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f24528c4e0f24715985149f6366da832"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:29.688020 14287 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:29.738765  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.732137  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:29.737676  9073 raft_consensus.cc:606] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:29.710400 13885 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:29.751420  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:29.652583 14529 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.725963 14472 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.671559 14538 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:15:29.659355 14534 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:29.751709 14499 consensus_meta.cc:287] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 12:15:29.734462 14489 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:29.782794  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.783058  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:29.784489  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 82369.4us
W20260709 12:15:29.798475  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:29.799965  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 12:15:29.801559  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:29.777135 14358 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:29.698199 14448 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.757846 14422 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.791652 14495 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.754063 14287 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.815775  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:29.874692  8917 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:29.875159  8917 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.876168  8917 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.750277 14426 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:15:29.789865 14489 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:29.789064 14536 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.806952 14452 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:15:29.767616 14537 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:29.880162 14537 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.882158 14452 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:29.882424 14537 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.792342 13885 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:29.883281 14535 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:15:29.883762 13885 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.888373 14534 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.888800 14512 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.889024 14534 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:29.889691 14528 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.889577 14534 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:29.890275 14533 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:15:29.842646  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 109102us
I20260709 12:15:29.802752 14538 consensus_queue.cc:1243] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:29.756219 14540 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:15:29.804999 14149 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.820274 14358 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.892422 14358 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.819761 14417 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:29.894841 14489 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.822801 14450 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:29.816119 14547 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.896334 14477 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:29.896739 14158 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.896857  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:29.897919 14529 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:29.899202 14545 log.cc:927] Time spent T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:15:29.872316 14539 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:29.900269 14539 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:29.900693 14544 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:15:29.900905 14489 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.901274 14539 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.902387 14358 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.874735 14472 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.908962 14287 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:29.796703 14499 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.796376 14451 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.882689 14452 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:29.916651  9065 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:29.930610  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:29.931545  9065 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:15:29.918072  8996 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
W20260709 12:15:29.944811  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 246896us
W20260709 12:15:29.911895 14443 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.002s
I20260709 12:15:29.972594  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:29.980125  9070 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:15:29.946506 14498 consensus_meta.cc:287] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.003s
W20260709 12:15:29.972594 14497 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:15:29.986572  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:29.987396 14452 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:29.983070 14528 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:15:29.988967 14475 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.000s
I20260709 12:15:30.010648  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:30.017081  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.017755  8997 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:30.023211 14566 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.994108 14559 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:15:30.027673 14358 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:30.028417 14558 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:15:30.028695 14452 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.030062 14534 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.033776 14499 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:30.034761 14084 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.960s	user 0.019s	sys 0.007s
I20260709 12:15:29.993175 14498 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:30.027135 14566 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.996049 14092 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:30.039537 14447 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.006s
I20260709 12:15:30.040753 14447 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:30.014850 14443 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.041567 14443 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.043818 14443 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:30.048851 14092 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:29.996829 14497 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:30.057353 14481 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.002s
I20260709 12:15:30.057461 14566 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.058039 14497 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:29.997525  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 296007us
I20260709 12:15:30.132711  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.138108  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.137948  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.139810  8922 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:30.147188  9074 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:30.149725  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.150432  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.150741  8997 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:30.151424  8925 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:30.152542  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:30.153352  8998 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.156095  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:30.157130  8999 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.160054  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.160202  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.161041  9000 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:30.163761  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:30.166276  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.169461 14092 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:30.170892  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:30.171947  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.141474  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.174877 14084 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.175077  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.176299  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:30.176790  9621 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:30.176201 14084 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.177479  9072 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.173794 14092 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:30.180071 14092 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:30.146782  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.138326  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.181438  8994 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:30.183492 14092 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.184078 14092 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:30.199744  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.060557 14464 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.214537 14464 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.216344  8917 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:30.190284 14358 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.233717  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.233976 14559 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:30.234668  8923 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:30.235384 14542 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:30.236258  8921 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:30.236383 14358 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.242079 14443 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.252494  8998 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:30.257441  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46008.9us
I20260709 12:15:30.263965  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:30.265841 14211 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:30.266425  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 125303us
I20260709 12:15:30.269109  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:30.270985 14299 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:30.271576 14299 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:30.273331 14299 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.257341 14358 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.275923  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.276765  9617 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:30.277513  9617 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:15:30.279047  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.279933  9620 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:30.281482  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.283517  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.266726 14211 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:30.283537  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:30.287812 14358 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:30.288288 14358 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.288693 14358 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.288857 14564 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:30.288518 14211 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.290872 14211 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:30.291155  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.296516  8888 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:30.297261  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.297518  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.297466 14559 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:30.298991 14554 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:30.248039 14528 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:30.305249 14528 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.305804 14528 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.308423  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2786) took 1368 ms. Trace:
I20260709 12:15:30.309000  9067 rpcz_store.cc:276] 0709 12:15:28.947653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:28.963468 (+ 15815us) service_pool.cc:224] Handling call
0709 12:15:30.307894 (+1344426us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540028b9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:30.308171 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149893504}
I20260709 12:15:30.309769 14564 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.312623  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.313913  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.314209 14158 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:30.314670  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.315387 14555 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:30.315599 14409 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:30.316331 14409 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:30.317799 14409 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.317735 14446 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.314922  8994 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:30.318502  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:15:30.315719  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46811.1us
I20260709 12:15:30.314702 14158 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.321858  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.306392  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:30.352207  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:30.352823  8999 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:30.341938 14158 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.243197 14443 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.340770 14446 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.358659  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.355315  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.359361  8888 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.348948 14084 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.310796 14564 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.383816 14564 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.384269  8923 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:30.386426  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.362347  9067 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:30.388607 14559 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:30.389325 14559 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:30.366704  9618 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:30.369488 14443 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.380230 14207 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.396037  9072 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:30.406642  9069 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:30.403416  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:30.409142  8917 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:30.418619 14084 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:30.420912  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.412598 14564 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:30.434437  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:30.436883  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 81786.9us
I20260709 12:15:30.438146  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.439321 14529 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:30.420339 14092 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.445871 14092 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.446822  9000 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:30.390630 14559 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.454324 14084 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.460251 14084 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.462352  9071 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:30.436712 14542 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.463822 14542 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.467219  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.468089  8993 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:30.470089  9037 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.471522  9618 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:30.473671  8916 pending_rounds.cc:85] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 8
I20260709 12:15:30.473990  8916 pending_rounds.cc:107] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:15:30.474287  8916 raft_consensus.cc:2889] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:30.475740  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.476257 14528 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.477284 14444 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.487890 14444 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.490834  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.486727  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3458) took 1363 ms. Trace:
I20260709 12:15:30.495517  9071 rpcz_store.cc:276] 0709 12:15:29.122844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.123340 (+   496us) service_pool.cc:224] Handling call
0709 12:15:29.137223 (+ 13883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:30.462782 (+1325559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.486405 (+ 23623us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003f02d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:30.486651 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3046089600}
I20260709 12:15:30.477205 14443 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:30.505142  8923 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:15:30.524647  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 118682us
I20260709 12:15:30.495428 14084 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.492890 14464 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:30.535481 14464 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.538280 14528 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:30.538998  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 101082us
I20260709 12:15:30.543192  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.545451 14564 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:30.547560  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.489429 14480 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.549460 14464 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:30.567550  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 97811.4us
I20260709 12:15:30.548323 14542 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.569196 14450 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:30.572044  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:30.573293  8993 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:30.575435  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.579059  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:30.579697  8917 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.557905 14358 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.588851 14492 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.590191 14499 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.603348 14158 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.607947  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:30.609795  8921 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:30.591087 14499 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.609797  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.614202  8922 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:30.612825  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:30.646287  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.649700 14444 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.644860 14207 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.651608 14409 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:30.652097 14207 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.652460 14409 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.655439 14498 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:30.655990 14207 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:30.657524  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 112435us
I20260709 12:15:30.658629  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:30.659837  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 50173.1us
I20260709 12:15:30.660109 14092 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:30.655211 14409 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.660902  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:30.661955 14092 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:30.609063 14158 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.612867 14287 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.668284 14287 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:30.663543  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.670921 14287 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.618541 14480 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:30.665897 14499 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:30.671200  8818 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 305) took 50006 ms (client timeout 15000 ms). Trace:
I20260709 12:15:30.665133  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.680191  8889 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:30.699226 14255 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:30.699841 14255 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:30.692602  8917 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:30.689288  8963 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.684167 14358 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:30.694787 14472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.005s	sys 0.020s
I20260709 12:15:30.616832 14473 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:30.703259 14499 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.709649  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.688107 14464 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:30.710207 14472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.006s	sys 0.020s
I20260709 12:15:30.730055  8993 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:30.713400 14444 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.712291 14473 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.718914 14158 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:30.726562 14287 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.743281 14444 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.744514 14553 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:30.744967 14553 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:30.747686 14444 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:30.752095  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50252us
I20260709 12:15:30.753114  8999 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:15:30.737531 14358 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.736066 14092 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:30.770996  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.777693  8993 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:30.781636  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:30.771744 14255 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.784122  8996 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:30.784768 14255 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:30.787569  8925 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:15:30.776192 14287 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.793301 14287 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.794287 14299 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.795506 14473 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:30.684902  8818 rpcz_store.cc:269] 0709 12:14:40.666244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.666998 (+   754us) service_pool.cc:224] Handling call
0709 12:15:30.670923 (+50003925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:23.637223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:23.638221 (+   998us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:23.638284 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:15:23.638312 (+    28us) tablet.cc:662] Decoding operations
0709 12:15:23.639632 (+  1320us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:23.639765 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:23.639814 (+    49us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:15:23.640900 (+  1086us) tablet.cc:701] Row locks acquired
0709 12:15:23.640961 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:15:23.641184 (+   223us) write_op.cc:270] Start()
0709 12:15:23.641363 (+   179us) write_op.cc:276] Timestamp: P: 1783599323641108 usec, L: 0
0709 12:15:23.641411 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:15:23.642322 (+   911us) log.cc:844] Serialized 3175 byte log entry
0709 12:15:24.479189 (+836867us) op_driver.cc:464] REPLICATION: finished
0709 12:15:25.269998 (+790809us) write_op.cc:301] APPLY: starting
0709 12:15:25.276639 (+  6641us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:25.450306 (+173667us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:25.450443 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:26.111775 (+661332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:26.112163 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:15:26.112232 (+    69us) write_op.cc:312] APPLY: finished
0709 12:15:26.112714 (+   482us) log.cc:844] Serialized 81 byte log entry
0709 12:15:26.253813 (+141099us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:26.264530 (+ 10717us) write_op.cc:454] Released schema lock
0709 12:15:26.272211 (+  7681us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:26.292571 (+ 20360us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:26.292610 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2387875,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":697567,"apply.run_cpu_time_us":35558,"apply.run_wall_time_us":1078710,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":13191,"prepare.run_cpu_time_us":21382,"prepare.run_wall_time_us":31400,"raft.queue_time_us":468966,"raft.run_cpu_time_us":49080,"raft.run_wall_time_us":721292,"replication_time_us":793676,"thread_start_us":1116938,"threads_started":5,"wal-append.queue_time_us":201806,"wal-append.run_cpu_time_us":29282,"wal-append.run_wall_time_us":2611742}]]}
I20260709 12:15:30.797304  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.776964  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.814868  9067 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:30.810163 14542 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:30.824422 14444 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.824774 14542 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.825018 14444 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.827306 14444 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:30.828343 14574 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.567s	user 0.004s	sys 0.000s
W20260709 12:15:30.830751  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70968.3us
I20260709 12:15:30.832551 14554 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:30.834352 14554 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:30.834197  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62903.3us
I20260709 12:15:30.834836 14554 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:30.835352 14554 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.835151  9040 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.832639  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.772639 14358 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.830827  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2792) took 1048 ms. Trace:
I20260709 12:15:30.846755  9070 rpcz_store.cc:276] 0709 12:15:29.782237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.782444 (+   207us) service_pool.cc:224] Handling call
0709 12:15:30.830401 (+1047957us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400422cd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:30.830632 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441271680}
I20260709 12:15:30.846158  8991 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:30.851179 14452 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:30.851465  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.810542 14484 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.137s
I20260709 12:15:30.860000  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.861510  8917 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:30.863463  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:30.851938 14452 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.868489  8916 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:30.855717 14528 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.872531 14351 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:30.873927 14481 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:30.874068 14452 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.874377 14481 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:30.874913  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.875691  8922 raft_consensus.cc:2410] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:30.875574 14481 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:30.866870 14546 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 1.075s	user 0.003s	sys 0.000s
I20260709 12:15:30.879142  8917 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:30.849807 14529 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 12:15:30.880986  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46037.4us
I20260709 12:15:30.886270  9623 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:30.870518 14464 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.890671 14493 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:30.894088  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:30.887182 14481 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.895254  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.899816 14158 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:30.894855 14540 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:15:30.902660  8922 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:30.889390 14351 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:15:30.884305 14528 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:30.902954  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:30.904742 14446 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:30.903916 14362 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:15:30.911875  8916 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:30.912865 14446 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.918779 14446 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.918882 14542 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:30.928085  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1164) took 1440 ms. Trace:
I20260709 12:15:30.928629  9068 rpcz_store.cc:276] 0709 12:15:29.487610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.487986 (+   376us) service_pool.cc:224] Handling call
0709 12:15:29.488328 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:29.516883 (+ 28555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:29.516917 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:29.517482 (+   565us) log.cc:844] Serialized 52 byte log entry
0709 12:15:29.675381 (+157899us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:29.675438 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.675543 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:30.864282 (+1188739us) spinlock_profiling.cc:243] Waited 929 us on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:30.927593 (+ 63311us) raft_consensus.cc:1685] finished
0709 12:15:30.927616 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:30.927881 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60235,"raft.queue_time_us":27417,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":43980,"spinlock_wait_cycles":2135808,"thread_start_us":157513,"threads_started":1,"wal-append.queue_time_us":217911}
I20260709 12:15:30.931466  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:30.931859  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 905) took 1229 ms. Trace:
I20260709 12:15:30.932708  9624 rpcz_store.cc:276] 0709 12:15:29.702152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.703326 (+  1174us) service_pool.cc:224] Handling call
0709 12:15:30.930593 (+1227267us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800162f98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b16a22 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac530ab 00007f398ac53131 00007f398ac14fc0 00007f398abff929 00007f398abff3d2 00007f3984176bd4
0709 12:15:30.930929 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:30.931323 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:30.931352 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:30.931398 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:30.931464 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.931530 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:30.931654 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319104}
I20260709 12:15:30.933920  8922 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:30.932703  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44276.5us
I20260709 12:15:30.924865 14528 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.940467  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:30.940949 14446 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.934372 14540 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:30.942209 14540 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.942622 14540 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:30.943622 14446 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:30.944193 14377 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:30.949146  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:30.949924  9623 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.951376 14441 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:30.957015  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.957648  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.957854  9074 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:30.958418  9072 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:30.959885  9070 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:30.961179  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.962760  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.962915  9623 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:30.964643  9037 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:30.966617  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:30.967630 14358 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:30.945053  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:30.968022 14562 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:30.968891 14562 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:30.969826 14562 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.970204 14158 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:30.970656  8966 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.968287 14207 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:30.971642 14207 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:30.972788 14207 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:30.973316  9068 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:30.975886 14562 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:30.967726  9069 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.984896  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.986519  8889 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.985030  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.989784  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:30.990769 14358 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:30.985790  8920 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:30.992728  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:30.993500 14092 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:30.993716  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77915.3us
I20260709 12:15:31.007921  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:31.009831  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.003046  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:30.996029  9074 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:31.014499  9074 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:31.013397  8966 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:31.020568  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:31.025774  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.026935 14528 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:31.027631 14528 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.030067 14528 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.031663 14229 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:31.033731 14554 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.010752 14553 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.041251  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:31.042317 14449 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:31.044121 14092 raft_consensus.cc:2764] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:15:31.046240  9074 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.047544  9065 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:31.047943  9074 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.000007 14287 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:31.051589 14287 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:31.052037 14287 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:31.052974 14480 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:31.058691  9069 raft_consensus.cc:2410] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:15:31.060541  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.068091  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.038931 14553 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:31.070489  8889 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.068835  9620 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:31.000535 14358 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.071978  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.069634  8966 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.073907  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:31.082024  9623 raft_consensus.cc:2410] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 12:15:31.082798  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:31.092960  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 73451.3us
I20260709 12:15:31.096030  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:31.072165 14158 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:31.102301  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.069823 14229 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:31.088367  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.092007 14362 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:31.101629  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.100594  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.097885  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.105006  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.107259  8994 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:31.106166  8993 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:31.104102 14409 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:31.091284 14358 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.113655  9624 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:31.114415  9069 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:31.118248  9071 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:15:31.120240  8925 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:31.116075  8996 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:31.093318 14441 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:31.130252 14121 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:31.130126  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.134958  8998 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:31.069953 14446 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:15:31.138548  8999 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:30.977492  8817 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 9 to 10, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:31.119477 14084 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:31.134690 14207 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.132225 14158 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:31.134178 14499 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:31.170425  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 100049us
I20260709 12:15:31.183483  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.186446  8998 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:31.187887  8920 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:31.195976  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.179430 14211 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:31.144922 14409 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.199257  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:31.162267 14481 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:15:31.206189  8991 raft_consensus.cc:2393] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:31.208480  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:31.211123  8996 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:31.187269 14528 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.153862 14441 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.167470 14084 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.168953 14207 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.217329 14255 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.225804 14255 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:31.226905 14255 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:31.231516 14590 log.cc:927] Time spent T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:15:31.232038  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.220511  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.197903 14554 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.201274 14211 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.231424  9068 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:31.224753  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.212340 14492 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:31.218590  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:31.223706  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.251209  8992 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:31.223438 14299 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:31.235458 14499 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:31.249578  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.241680 14211 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.256856  8922 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:15:31.261917  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.233528 14528 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.252336 14472 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:31.270478  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.277027  8992 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 12: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:31.255502 14539 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:31.283730  8922 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:31.267823 14493 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:31.303910 14409 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.305598  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.284313  9073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33456 (request call id 39) took 1455 ms. Trace:
I20260709 12:15:31.294516  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:31.268013 14566 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:31.366227  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.367331  8916 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:31.265699 14492 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.373507  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.279156 14532 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.382s
W20260709 12:15:31.288067 14589 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:15:31.367224  9073 rpcz_store.cc:276] 0709 12:15:29.731151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.731311 (+   160us) service_pool.cc:224] Handling call
0709 12:15:31.133118 (+1401807us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b5400382fa0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb8520 00007f3985c35652 00007f398ac0360a 00007f39841897d4 00007f3984189762 00007f3984189691 00007f398418960c 00007f39841888c2 00007f3983f7648c 00007f3983f758c6
0709 12:15:31.186352 (+ 53234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14454016}
I20260709 12:15:31.269012 14550 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 12:15:31.379842  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.260066 14299 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.276257 14472 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:31.391294 14472 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.247217 14158 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.293159 14207 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:31.390851 14588 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:15:31.379194 14598 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:15:31.406147  9037 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.675s (SENT) [suppressed 32 similar messages]
I20260709 12:15:31.411515 14528 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.410037 14362 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:31.415418 14362 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.257728  8817 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 8 to 11, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.421979  9074 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:31.428555  8993 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:15:31.423836  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:31.411568 14591 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 12:15:31.436123 14599 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:15:31.399776 14566 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.443437  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.447896  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.448917  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.401898  8992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:15:31.414191 14358 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.456748  8997 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:31.460425  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.461660  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:31.406057 14539 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.431423 14207 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:15:31.467847  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.468098 14084 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.468634  9074 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:31.469676  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.473677  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.474453  8993 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:15:31.475418  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.418938  8817 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 5 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 8 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:31.475945 14211 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.476526  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.477144  8993 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:31.477975  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.478668  8993 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:31.463438  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.462949 14444 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:31.494411  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.497968  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.499184  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.425295 14493 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.498558  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.477205  8817 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 11, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.478201 14211 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:31.498521  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 99602.9us
I20260709 12:15:31.446237 14498 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:15:31.506981  9073 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:15:31.510727  8994 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
W20260709 12:15:31.511267 14597 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:15:31.514894  9000 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:15:31.556757  9000 pending_rounds.cc:85] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 9
I20260709 12:15:31.557091  9000 pending_rounds.cc:107] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:15:31.557399  9000 raft_consensus.cc:2889] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:31.516709 14539 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.506647 14084 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:15:31.523734 14532 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:31.508129 14473 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 12:15:31.527691 14574 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260709 12:15:31.541672  8999 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:31.543689 14550 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:31.545284  8817 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 5 to 11, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.548707 14446 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:31.553622  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.555301  8996 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:31.499320 14444 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:31.457283 14287 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.562752  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.569669  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:31.568766  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73593.1us
I20260709 12:15:31.570472  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.568511 14211 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.580606  8999 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:31.577972  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.572834 14499 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:31.576974 14532 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.569561 14446 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:31.584170 14358 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.585464 14207 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:31.575652 14539 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.588279 14566 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.589694 14441 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.571929 14444 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:31.594470  9068 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:31.569778 14550 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:31.602476  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:31.575975 14492 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.614940  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.618541  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.566542 14472 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.620016  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.617858  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.623744  8999 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:31.599429 14499 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:31.652961  9070 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:31.633023  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.653697  9065 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:31.606806 14540 consensus_meta.cc:287] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 12:15:31.657804  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.670096  8994 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.670368  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.659572  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.603822 14207 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:31.660997  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:31.624563 14550 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.663779  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.602633 14084 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:31.659116 14528 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:31.667472  9065 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:31.621645 14211 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.686760  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:31.668190  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 88769.9us
I20260709 12:15:31.652632 14358 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:31.669502  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.687816  8999 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.671391  9616 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:31.674111  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:31.677075  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.670962  9066 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:31.667569  9073 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:31.690688  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.692265  9070 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:31.669888 14499 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.656008 14409 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:15:31.732760 14207 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:31.733150 14607 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:15:31.689105 14358 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.656265 14606 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 12:15:31.753960  8999 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:31.755882 14084 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:31.676645 14540 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.759388 14542 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.760784  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.838775  9622 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:15:31.760720 14492 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:15:31.762050 14610 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:15:31.762413  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.766016 14499 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.843734 14409 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.844449 14499 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.771340  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.679706 14493 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.785137 14211 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.845422 14542 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.847767 14542 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.689461 14446 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.849086 14446 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:31.849169 14414 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:31.849818 14414 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:31.788800 14601 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:15:31.790544 14608 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:15:31.791927 14532 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.792708  8817 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.812881 14472 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.815665  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:31.734162 14612 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:31.816251 14539 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:31.808220 14444 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.868628  9618 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:31.826989  8994 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:31.834962  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.839964 14616 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.844352 14409 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.787029 14287 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.829617 14358 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:31.860155  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 199315us
I20260709 12:15:31.874878  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:31.861338  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 102232us
W20260709 12:15:31.866961  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 176650us
I20260709 12:15:31.877874  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.877795  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.855751 14084 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:31.887312  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.889273  8916 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:31.887476  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.890025  8994 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:31.892771  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.884855 14472 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:31.894258  8888 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.894742 14472 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:31.895383 14472 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:31.896492 14472 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.900259  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:31.901629  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.884759 14616 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.904793 14616 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.906991 14299 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.907655 14373 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:31.908365 14373 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.908533 14606 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.908845 14373 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:31.909108 14606 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.910782  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.911665 14499 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:31.907747 14532 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:31.912045  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.912689 14532 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:31.912884 14616 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:31.913295 14616 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:31.913977  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:31.914855 14499 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:31.869343 14492 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:31.916349  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.916646  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:31.916953  9624 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:31.918052 14444 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.920528  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.921375 14287 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:31.921711 14287 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.922056 14287 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.923722  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.924352  8994 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:31.924872 14540 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.925239  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.926798  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.925304  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.928329  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:31.928738 14611 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.929425 14611 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.930845  9000 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:15:31.900805  8817 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.932462  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:31.932575 14287 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.934926 14287 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.935335  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.935596  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.936177  8920 raft_consensus.cc:2368] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:31.936458 14606 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:31.913628 14532 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.936364  8916 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:31.934532  8817 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 11 to 12, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 12 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.875567 14207 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:31.941269  8916 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:31.913650 14616 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:31.851095 14414 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.944270 14414 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.948030 14084 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:31.949653  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:31.950212 14616 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.950245  8997 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:31.951896  8994 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:31.954056  8994 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:31.940407  8817 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 1 to 11. New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.960672  8997 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
W20260709 12:15:31.963972  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:31.963584 14283 consensus_queue.cc:1175] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2fec7bba20864beea35ba1b33132e47d" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 13 } }
I20260709 12:15:31.932133  9000 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:31.966907  9000 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:31.884217 14448 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.963743  8817 catalog_manager.cc:5697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 2 to 11, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.967804 14448 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:31.968920  8817 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 10 to 13, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 13 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:31.970647 14448 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:31.970942  8817 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 10 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 12 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:31.973665  9622 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
W20260709 12:15:31.975211  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 54778.5us
W20260709 12:15:31.979184  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.976593  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:31.997923  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:32.002140  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:32.002827  8917 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:32.003983  9000 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.004070  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:32.005191  8922 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:32.005230  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:32.006419  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:31.920465 14409 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:32.008097  8925 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:32.011000  9616 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:32.039774  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:32.040585  9619 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.041433  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:31.987761 14283 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:32.041167  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.047061  9069 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:32.048259  9590 leader_election.cc:400] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:32.048676  9590 leader_election.cc:403] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:32.046700  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.049611  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.054860  9068 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:32.005923 14481 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:32.061125  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.061895  9073 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:32.002228 14255 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:15:32.061228  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 60826.5us
I20260709 12:15:32.064396  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.058766  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.065608  9068 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:32.062088  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.048208 14283 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.077787  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:32.078845  9070 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:32.073032  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.074749  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3485) took 1094 ms. Trace:
I20260709 12:15:32.075383  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.100848  9068 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:32.087303  9072 rpcz_store.cc:276] 0709 12:15:30.980060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.989085 (+  9025us) service_pool.cc:224] Handling call
0709 12:15:31.018381 (+ 29296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:31.018875 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:31.018922 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:31.056061 (+ 37139us) log.cc:844] Serialized 26 byte log entry
0709 12:15:31.226047 (+169986us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:31.898748 (+672701us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b1800384b80. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f39857e34bc 00007f3982b3148b 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf
0709 12:15:31.898906 (+   158us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.058985 (+160079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.059086 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:32.059128 (+    42us) raft_consensus.cc:1685] finished
0709 12:15:32.074534 (+ 15406us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:32.074689 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29048,"prepare.queue_time_us":36976,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":167,"raft.queue_time_us":43698,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5108,"spinlock_wait_cycles":16698240,"thread_start_us":269171,"threads_started":3,"wal-append.queue_time_us":154562}
I20260709 12:15:32.062520 14528 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:32.070900 14615 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:32.117126  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44194.8us
I20260709 12:15:32.119882  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:32.120483  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:31.994805  8817 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.057969 14409 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:15:32.098553 14448 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:32.098062 14283 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:32.128913  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.100551 14481 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:32.105232 14499 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:32.129194  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:32.131331  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 69557.5us
I20260709 12:15:32.104655 14255 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:32.115923 14528 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.099305 14287 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:15:32.164206  9069 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
W20260709 12:15:32.200587  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 142291us
I20260709 12:15:32.098287 14377 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:15:32.125141 14540 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:32.205613  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.209743  9074 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:32.215714  9066 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:15:32.219604  9066 pending_rounds.cc:85] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 7
I20260709 12:15:32.219969  9066 pending_rounds.cc:107] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:15:32.076610 14617 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:15:32.153908 14499 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.228204  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.220288  9066 raft_consensus.cc:2889] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:32.229780  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.230592  9069 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:32.133054 14448 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:32.195585 14528 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:32.125658 14529 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:15:32.241178  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.195477 14362 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.266782  9074 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:32.211073 14492 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:32.242987  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.200875 14616 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:32.273713  9069 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:32.223423 14540 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:31.972852 14441 consensus_queue.cc:1175] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "491a1127924f43d4a369f7d09c3a68db" responder_term: 15 status { last_received { term: 14 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:32.223366 14606 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.265825  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:32.242106 14448 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.234910 14499 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:32.290901  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.291746  9066 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:32.293205  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 82041.5us
I20260709 12:15:32.285429 14602 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:32.293963 14606 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.276012 14362 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.297719  8995 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:32.195382 14615 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.304117  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.317991  8992 raft_consensus.cc:476] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:15:32.272629 14492 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:32.317708  9070 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:32.323920  9068 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
W20260709 12:15:32.307991  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 97512.1us
W20260709 12:15:32.335563 14619 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:15:32.351681  9619 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:32.281100 14540 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:32.352831  9000 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:32.395143  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:32.402612  9065 raft_consensus.cc:2393] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:32.363955  9073 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:32.398032  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:32.387817  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:32.410123  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.385051  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:32.412185  9074 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:32.316221 14532 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:32.305903 14606 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:32.295953 14211 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:32.361836 14550 consensus_meta.cc:287] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 12:15:32.417384  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:32.416304  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 184250us
I20260709 12:15:32.379841  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:32.295387 14635 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:32.324097 14562 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.339056 14158 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.415478  8922 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:32.313294 14362 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:32.351742 14492 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:32.355700 14542 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13.
I20260709 12:15:32.461817  8889 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:32.384357 14629 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:32.464908  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1903) took 1043 ms. Trace:
I20260709 12:15:32.351191 14358 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.315583 14618 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.394s
I20260709 12:15:32.425231 14617 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:32.479527  8993 rpcz_store.cc:276] 0709 12:15:31.421410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.577311 (+155901us) service_pool.cc:224] Handling call
0709 12:15:31.577624 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:31.603988 (+ 26364us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:32.005135 (+401147us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.464556 (+459421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:32.464611 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:32.464669 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.464731 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:32.464847 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36417,"prepare.queue_time_us":130189,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":77302,"raft.queue_time_us":206066,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"thread_start_us":703280,"threads_started":3,"wal-append.queue_time_us":258561}
I20260709 12:15:32.297742 14255 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.392485 14351 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:15:32.440820 14566 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:32.536338  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 303212us
W20260709 12:15:32.484090  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 122583us
W20260709 12:15:32.524955  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 186220us
I20260709 12:15:32.389199 14287 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:15:32.544603  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:32.544938  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:32.545504  8993 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.545701  9000 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:32.522411 14452 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:32.548048  8924 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:32.356091 14481 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.519045 14614 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:32.550038  8921 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:15:32.462849 14464 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:15:32.465870 14211 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:32.541944 14414 consensus_meta.cc:287] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.006s
W20260709 12:15:32.594533  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.463178 14635 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.460804 14550 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.611922  8999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1147) took 1073 ms. Trace:
I20260709 12:15:32.613472 14634 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:32.612407  8999 rpcz_store.cc:276] 0709 12:15:31.538543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.874973 (+336430us) service_pool.cc:224] Handling call
0709 12:15:31.875735 (+   762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:31.891729 (+ 15994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:31.891775 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:31.997436 (+105661us) log.cc:844] Serialized 52 byte log entry
0709 12:15:32.202562 (+205126us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:32.519468 (+316906us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.519738 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.519830 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:32.611678 (+ 91848us) raft_consensus.cc:1685] finished
0709 12:15:32.611701 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:32.611853 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47320,"prepare.queue_time_us":108925,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":16490,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":320358,"threads_started":2,"wal-append.queue_time_us":548114}
I20260709 12:15:32.555716 14606 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:32.466734 14562 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.475068 14158 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:32.671386  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.605742 14446 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:15:32.527832 14629 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.700318  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:32.707684  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 122951us
W20260709 12:15:32.709625 14373 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.001s
I20260709 12:15:32.709697 14197 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:32.710249 14197 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:32.711336 14197 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.712731 14197 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:32.716185 14627 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:15:32.621239 14351 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:32.718243 14638 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:15:32.718729 14446 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:32.710255 14373 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.704306  8993 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:32.723045  8995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1899) took 1303 ms. Trace:
W20260709 12:15:32.704651 14610 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:15:32.731002  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:32.541301 14617 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.734035 14553 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.735441 14625 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.749733  9066 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:32.753680  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:32.754347  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.759929  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.730671 14554 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:32.757918  8995 rpcz_store.cc:276] 0709 12:15:31.420131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.444213 (+ 24082us) service_pool.cc:224] Handling call
0709 12:15:31.462687 (+ 18474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:32.317009 (+854322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.722815 (+405806us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54002f6054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:32.722964 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589095168}
I20260709 12:15:32.766258  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:32.766459 14358 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:32.518847  8817 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:15:32.775405  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 299110us
I20260709 12:15:32.630524 14635 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:32.787613  9619 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:32.844069  8888 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:32.762037 14446 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:32.762291 14299 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.764238 14207 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:32.857648  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 236651us
I20260709 12:15:32.751500 14452 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:32.853235  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:32.781286 14553 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.882097  8994 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:32.844163  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:32.767230 14373 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:32.888365  8924 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:32.780067 14641 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:32.781090 14287 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:32.893312  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:32.858014 14448 consensus_meta.cc:287] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
W20260709 12:15:32.858332 14638 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:15:32.839927 14625 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.927572  8995 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:32.888224 14299 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.934015 14625 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:32.927482  8808 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 491a1127924f43d4a369f7d09c3a68db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:32.934448 14299 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:32.934751  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 97059.3us
I20260709 12:15:32.938083 14611 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:32.761898 14351 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:32.930498 14621 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.706s	user 0.004s	sys 0.000s
I20260709 12:15:32.973441  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:32.990053  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:32.990835  8921 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:32.992200 14540 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:15:32.992764 14540 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.952437 14448 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.995939 14448 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:32.997066 14448 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:32.997608 14448 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:32.952502 14373 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:15:33.000183 14625 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:32.999778  8921 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
W20260709 12:15:33.001581  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:33.000883  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 83034.9us
I20260709 12:15:32.987758  8922 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:33.008123  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:32.956445 14409 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:32.866717 14084 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:15:32.952901 14287 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:33.021111  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:33.019526  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.000543 14625 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:33.029320  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:32.963362 14615 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.032399  8922 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:33.033221  8921 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:32.964192 14539 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:33.040850  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.068126  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.164691  9066 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:33.070230 14540 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.071836  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.174481  9074 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:32.931883 14446 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:32.914242 14641 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.031574 14602 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:33.118855 14283 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.000s
I20260709 12:15:33.033654 14634 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.033233 14373 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:33.042207 14539 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:33.143890  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 107917us
I20260709 12:15:33.068948 14635 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.001169 14529 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:33.148721  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 164188us
I20260709 12:15:33.158576  8921 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:33.164101  9624 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:15:33.105516 14638 log.cc:927] Time spent T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:15:33.186718 14158 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:33.096902  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 255756us
I20260709 12:15:33.181468  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49092 (request call id 1894) took 1832 ms. Trace:
I20260709 12:15:33.148943 14562 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:33.197986  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 221226us
I20260709 12:15:33.198235  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 1895) took 1801 ms. Trace:
I20260709 12:15:33.072194 14409 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:33.075651 14452 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.221873  9074 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:33.195346 14448 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.192266 14283 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.194098 14539 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.217417  8992 rpcz_store.cc:276] 0709 12:15:31.379057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.386703 (+  7646us) service_pool.cc:224] Handling call
0709 12:15:33.147742 (+1761039us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54002f6054. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c32a3d 00007f398ac02cd0 00007f3984187254 00007f39841871e2 00007f3984187111 00007f398418708c 00007f3984186342 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:33.147854 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988205824}
I20260709 12:15:33.219514  8998 rpcz_store.cc:276] 0709 12:15:31.396944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.398859 (+  1915us) service_pool.cc:224] Handling call
0709 12:15:31.399197 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:31.401303 (+  2106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:31.401332 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:31.407533 (+  6201us) log.cc:844] Serialized 52 byte log entry
0709 12:15:31.822187 (+414654us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b1800445000. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db0d1 00007f3985bf6a0f
0709 12:15:32.009279 (+187092us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:32.208450 (+199171us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.463651 (+255201us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.463881 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.463980 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:32.733763 (+269783us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b1800445000. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e522 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:32.930113 (+196350us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b24002bc628. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f39829d49c4 00007f39829d2acb 00007f3982b8ddc9 00007f3982b8da55 00007f3982b8d09d 00007f39857bf10e 00007f39857d688c 00007f39857d5bb6 00007f39857d57d8 00007f39857df221
0709 12:15:33.198026 (+267913us) raft_consensus.cc:1685] finished
0709 12:15:33.198048 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.198177 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111457,"prepare.queue_time_us":268520,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":380843,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":20074,"spinlock_wait_cycles":93575424,"thread_start_us":475139,"threads_started":3,"wal-append.queue_time_us":698591}
I20260709 12:15:33.222460  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.147081 14640 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.269891  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:33.244477  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.276867  8997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3250) took 1376 ms. Trace:
I20260709 12:15:33.281802  8997 rpcz_store.cc:276] 0709 12:15:31.900813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.965395 (+ 64582us) service_pool.cc:224] Handling call
0709 12:15:31.965729 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:31.966055 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:32.056345 (+ 90290us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.197789 (+141444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:32.198336 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:15:32.198483 (+   147us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:32.198703 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 12:15:32.198844 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.198920 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.276663 (+1077743us) raft_consensus.cc:1685] finished
0709 12:15:33.276687 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.276810 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104375,"prepare.queue_time_us":274769,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":35478,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":40091,"spinlock_wait_cycles":19840,"thread_start_us":79738,"threads_started":1,"wal-append.queue_time_us":498140}
I20260709 12:15:33.284420  8997 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:15:33.286790 14655 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 12:15:33.190021 14287 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.288273 14553 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:33.288484 14622 log.cc:927] Time spent T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.080s	user 0.013s	sys 0.002s
I20260709 12:15:33.273141 14666 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:33.290572 14654 log.cc:927] Time spent T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:33.291159 14630 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.291477 14605 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:33.292248 14665 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:15:33.291729 14630 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.292111 14605 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.275301 14640 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.294359 14605 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.230971 14629 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.291752  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3504) took 1266 ms. Trace:
I20260709 12:15:33.197564 14373 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.289985 14648 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.290037  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:33.290755 14666 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.297868 14409 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.329097  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.329748  9619 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:33.317607  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:33.331413  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:33.301483 14528 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.024s	user 0.009s	sys 0.000s
W20260709 12:15:33.304149 14667 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:15:33.306399  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3511) took 1187 ms. Trace:
I20260709 12:15:33.272810  9618 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:33.309721  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:33.310428  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66076.9us
I20260709 12:15:33.308034  9067 rpcz_store.cc:276] 0709 12:15:32.025859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.045603 (+ 19744us) service_pool.cc:224] Handling call
0709 12:15:32.067162 (+ 21559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:32.237741 (+170579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.237887 (+   146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:32.281544 (+ 43657us) log.cc:844] Serialized 26 byte log entry
0709 12:15:32.522255 (+240711us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:32.522310 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.528328 (+  6018us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.291565 (+763237us) raft_consensus.cc:1685] finished
0709 12:15:33.291585 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.291699 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65047,"raft.queue_time_us":50645,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2611,"thread_start_us":346254,"threads_started":2,"wal-append.queue_time_us":883093}
I20260709 12:15:33.351634  8998 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.351500  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.195101 14634 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.349613  9072 rpcz_store.cc:276] 0709 12:15:32.119539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.123643 (+  4104us) service_pool.cc:224] Handling call
0709 12:15:32.124166 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:32.195967 (+ 71801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.196001 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:32.227217 (+ 31216us) log.cc:844] Serialized 26 byte log entry
0709 12:15:32.484970 (+257753us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:32.485018 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.485116 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.306160 (+821044us) raft_consensus.cc:1685] finished
0709 12:15:33.306186 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.306337 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31816,"raft.queue_time_us":74048,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":204326,"threads_started":1,"wal-append.queue_time_us":435307}
I20260709 12:15:33.318060  8923 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
I20260709 12:15:33.314726  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:33.318145 14621 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:33.223147 14529 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.275487 14158 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.318275 14632 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:33.352810  8997 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:33.275262 14554 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.355638  8991 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:33.205984 14635 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.224994 14663 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.369s
I20260709 12:15:33.357151  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:33.357194  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.359615  9590 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.233204 14617 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.361500  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:33.339066 14650 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:33.371471 14661 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:33.372275 14672 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.413166 14672 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.369390 14158 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.373080 14662 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:33.376394  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.233605 14625 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.415526 14662 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.416375 14625 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.417683 14662 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.420537 14678 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:33.421120 14678 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.423504 14678 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:33.377449 14492 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.004s
I20260709 12:15:33.424616 14492 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.425937  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:33.426541  8994 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.426859 14492 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:33.431456 14499 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.119s	user 0.006s	sys 0.006s
I20260709 12:15:33.432031 14499 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.434832 14499 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:33.383589 14653 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:15:33.400171  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.401892 14617 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:33.328047 14648 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.377948 14554 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.407836 14373 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.402990 14657 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:33.410882 14666 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.411532 14632 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:33.411823  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59833.3us
I20260709 12:15:33.463410  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.364562 14299 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.413812 14630 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.355132 14528 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.389228  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.440256  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.455416  8997 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:33.456496  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:33.466333  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 77190.1us
I20260709 12:15:33.391220 14650 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:33.440253 14621 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:15:33.461015 14657 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.460041  8992 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:33.390213 14287 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:33.467325  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.435797 14448 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:33.466403  9618 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 9.
I20260709 12:15:33.473989  8998 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:33.474519 14373 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:33.468974 14092 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:33.480616 14373 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.481101 14373 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.481019 14092 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.481709 14528 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.474706 14650 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:33.483259  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.477521 14657 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.479344 14299 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.484336 14632 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:33.484850 14632 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:33.474627 14666 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:33.485235 14632 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:33.485456 14666 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:33.485570 14299 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.462854 14634 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.474817 14362 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:33.487381 14362 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:33.488544 14679 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:15:33.489758 14481 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:33.477511 14670 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:33.491714 14648 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.491302 14670 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:33.492264 14670 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.499224 14529 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.484359 14554 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.506099  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.508129  8993 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:33.435428 14661 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.510959 14661 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.486536 14666 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.511487  9587 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:33.522614  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55428.8us
I20260709 12:15:33.523391  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:33.478125 14448 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.537536  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.536172  8994 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:33.524226 14542 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:33.541342 14362 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.555821  8923 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:33.556759  8921 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:33.540472 14448 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:33.562336  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 185081us
I20260709 12:15:33.542111 14634 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:33.549909 14092 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.565645 14672 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.566876 14158 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.573087 14373 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:33.577042 14652 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 12:15:33.549938 14542 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:33.564276 14197 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.851s	user 0.014s	sys 0.000s
I20260709 12:15:33.581504  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.551162 14625 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:33.581527  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.517663 14287 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.584025 14669 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:33.584683  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.582650 14542 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.567091 14663 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:15:33.593469  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:33.594043  9624 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:33.588075  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.594883  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:33.590548  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.590783  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:33.595814  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.578413 14373 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.591699 14669 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:33.602260 14669 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.601955 14670 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.593894 14634 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:33.605873 14283 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.607055 14640 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.608469 14211 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.588317 14351 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.595762  8999 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:33.596299  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.592811  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.597849 14441 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:33.600641  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.601619  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.611886  8920 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:15:33.617844  9065 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:33.615464  9074 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:15:33.611913  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.597046  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:33.621770  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:33.624404  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.629532  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.633415 14670 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.634438  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:33.636001 14641 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.636224 14287 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.637624 14635 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:33.640879  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:33.642261  8921 raft_consensus.cc:2368] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:33.643030  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.643685  9070 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.644614  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.645416  8994 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:33.647496  9624 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:33.648247  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.648288  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.648669  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.629185 14634 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.649837  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.650522  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.651451  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:33.652004 14668 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.370s	user 0.000s	sys 0.003s
I20260709 12:15:33.652896  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.653438 14441 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:33.654029  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.680188  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:33.648242 14676 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 12:15:33.656702 14446 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:33.684304  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 54781.3us
I20260709 12:15:33.657018  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.658905  9590 leader_election.cc:400] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:33.684984  9590 leader_election.cc:403] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:15:33.685019  9074 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.659220  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.685765  9072 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:33.656702  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.659875 14660 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:33.660913  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:33.666023  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.625629  9040 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.678002  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.674247  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.677515  9071 raft_consensus.cc:2410] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:33.678467  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.682186  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.697049  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:33.698055  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.700364  9070 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:33.701197  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 75659.7us
I20260709 12:15:33.701618  8999 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:33.701910  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.703634  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:33.712522  9074 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:33.684782 14602 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:33.674724 14687 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:33.700618 14617 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:33.696587 14660 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:33.718874 14691 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:15:33.711719 14207 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:33.722149 14373 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:33.750151  9068 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.751633  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.715459 14671 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:33.684304 14634 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.748818  9072 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:33.759085  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.765774 14660 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.716540 14615 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:15:33.767155 14660 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.769557 14539 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.770763  8924 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:33.771970 14650 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.774221 14650 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.775420 14092 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:33.776258 14092 consensus_queue.cc:1243] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:33.777283 14092 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:33.777667 14092 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:33.779834  9000 raft_consensus.cc:2368] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:33.781287 14566 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:33.782013 14566 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.782498 14632 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.728649 14687 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.761325  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:33.703150 14625 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:15:33.778502 14092 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:33.787110  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.806320  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.789515  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:33.827081  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:33.828397  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 67157.5us
I20260709 12:15:33.774832 14650 consensus_queue.cc:1059] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:33.830982  9074 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:33.793126  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:33.837730  9066 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:33.838305  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:33.755293 14617 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:33.794293  9587 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:33.841565  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 139725us
I20260709 12:15:33.757700 14373 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.847566  8917 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 11: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:33.848094  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 53908.6us
I20260709 12:15:33.795059 14207 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:33.851080  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58035.1us
I20260709 12:15:33.851886  9068 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:33.888734  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:33.855360 14635 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:33.860318 14690 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:15:33.866624  8996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3264) took 1128 ms. Trace:
I20260709 12:15:33.817415 14532 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:33.821671 14358 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:15:33.875561  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.917907  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.919361  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:33.920249  8997 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.922176  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:33.894096  8996 rpcz_store.cc:276] 0709 12:15:32.738240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.871326 (+133086us) service_pool.cc:224] Handling call
0709 12:15:32.914856 (+ 43530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:33.001576 (+ 86720us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:33.032813 (+ 31237us) log.cc:844] Serialized 14 byte log entry
0709 12:15:33.267564 (+234751us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:33.269270 (+  1706us) log.cc:844] Serialized 26 byte log entry
0709 12:15:33.269410 (+   140us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:33.269450 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.269522 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.647677 (+378155us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:33.866191 (+218514us) raft_consensus.cc:1685] finished
0709 12:15:33.866349 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.866526 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257777,"prepare.queue_time_us":36898,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":164825,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":15445,"spinlock_wait_cycles":14541696,"thread_start_us":80946,"threads_started":1,"wal-append.queue_time_us":268332}
I20260709 12:15:33.817878 14687 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:33.748622 14657 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.828244 14606 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:33.784878 14566 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:33.944900  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:33.948587  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.881873 14373 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.876205 14663 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:33.871567 14611 raft_consensus.cc:2764] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:15:33.873200 14634 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.961066  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:34.180528  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.185070  8997 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:33.921228  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:15:34.199563  9072 raft_consensus.cc:606] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:33.915863 14092 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:34.187122 14632 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:33.899829 14542 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.791357 14441 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.163642 14617 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:33.871196 14669 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.052289  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:34.050767  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:33.922412 14635 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:34.180351 14362 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:34.221314  8998 raft_consensus.cc:2410] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:15:34.222411 14542 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:34.224205 14657 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:34.231262 14373 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.195608  8993 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:34.199976  9072 raft_consensus.cc:614] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:33.969318 14606 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.201553  8996 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:34.211681 14671 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.218245 14635 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.218911 14687 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:34.233543 14448 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.001s
I20260709 12:15:34.205420 14207 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:34.194461  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 346473us
W20260709 12:15:34.273473  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 683386us
I20260709 12:15:34.283780  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.287761  9071 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:34.290558 14687 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:34.254839 14671 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.295598  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:34.297665  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.256982 14448 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.301571  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:34.302389  9071 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:34.310793  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.310992 14671 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:34.311932 14664 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.936s	user 0.005s	sys 0.009s
W20260709 12:15:34.303165 14683 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.929s	user 0.006s	sys 0.000s
W20260709 12:15:34.315060  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 424675us
I20260709 12:15:34.300072 14351 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:34.323371 14611 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.324169  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.326936  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:34.345652  9065 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:34.318892 14255 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:34.375604  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.372197 14377 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:34.381100 14377 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:34.373636 14666 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.322690 14448 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:34.387917  9065 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:34.393005  9065 raft_consensus.cc:1217] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:15:34.393688  9065 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:15:34.401366  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 84360.7us
I20260709 12:15:34.402518  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:34.405102  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:34.383376 14663 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:34.410558 14616 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:34.477387  9073 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:15:34.384707 14373 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:34.566743 14706 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:15:34.382474 14666 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.382041 14377 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.600311 14377 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:34.601325 14666 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:34.567363 14628 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:34.602403 14628 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.604439 14628 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:34.607280 14351 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:34.589417  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 184414us
I20260709 12:15:34.592885 14472 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:34.326285 14611 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.420783 14663 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.653817 14611 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:34.655318  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:34.656400 14472 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:34.656998 14472 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:34.658027 14472 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:34.804211  9071 consensus_meta.cc:287] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:15:34.804941  9071 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
W20260709 12:15:34.809599  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.840870 14663 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:34.866849 14635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.002s	sys 0.017s
W20260709 12:15:34.867599  9588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.009s
W20260709 12:15:34.867813 14635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.017s
I20260709 12:15:34.882774  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:34.885486  9073 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:34.889081 14358 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:34.889835 14358 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.892930  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:34.867918  9588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.006s	sys 0.009s
W20260709 12:15:34.896735  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 592919us
I20260709 12:15:34.897734  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:34.898736 14670 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:34.900560  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:34.843178 14663 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:34.968489 14715 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.969643 14207 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.969909 14373 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.951401  9072 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:15:34.970400 14373 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.952327  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.971583  9069 raft_consensus.cc:2410] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:34.971526  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.952598  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.972642 14373 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:34.972828  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.973508  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.974072  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.974682  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.975108  8923 raft_consensus.cc:2368] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:34.975057  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.959582  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.970202 14207 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:34.964151 14448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.014s
I20260709 12:15:34.970244 14663 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:34.951594  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.975798  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.982990 14611 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.983284  9067 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:34.983569 14611 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:34.984052  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.984393  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.976071  9072 raft_consensus.cc:2368] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
I20260709 12:15:34.986464 14611 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:34.987375 14207 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:34.987939 14207 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.988507  9070 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
I20260709 12:15:34.976907  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45518 (request call id 975) took 1326 ms. Trace:
I20260709 12:15:34.989647  8923 rpcz_store.cc:276] 0709 12:15:33.650214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.651221 (+  1007us) service_pool.cc:224] Handling call
0709 12:15:34.976642 (+1325421us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400312254. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:34.976809 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2991229184}
I20260709 12:15:34.972671  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:34.991223  9069 raft_consensus.cc:2376] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14. Re-sending same reply.
I20260709 12:15:34.991598  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:34.992415  9069 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:34.992779  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2723) took 1246 ms. Trace:
I20260709 12:15:34.993105  8923 rpcz_store.cc:276] 0709 12:15:33.745921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.991354 (+1245433us) service_pool.cc:224] Handling call
0709 12:15:34.992245 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.985487  9073 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:15:34.979107  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.989686  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:34.994912  9070 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:34.999377  9067 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:34.989768 14207 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:34.967996 14703 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.009s
I20260709 12:15:35.000527  9071 raft_consensus.cc:2368] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16.
I20260709 12:15:35.000403  9072 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:15:35.002692  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 102229us
W20260709 12:15:35.004097 14703 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.006s	sys 0.009s
I20260709 12:15:34.969074 14715 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.004237 14635 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:35.006425  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.009682 14207 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:35.001571 14448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.015s
I20260709 12:15:35.007329  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.013572 14629 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.013787 14670 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:35.014132  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.014797  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:35.014206 14629 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.016516  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.017169  9071 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:35.020957 14629 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.021751 14207 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:35.023699 14602 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:35.024158 14602 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.038828 14554 raft_consensus.cc:3055] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:35.039515 14554 raft_consensus.cc:740] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:35.040740 14554 consensus_queue.cc:260] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.047652 14554 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.053226  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.054692  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:35.055510  9615 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.061532  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.062304  9624 raft_consensus.cc:2368] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16.
I20260709 12:15:35.056252 14670 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:35.068198  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:35.069170  9616 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:35.072536  9615 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:35.066366 14670 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.074935  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.075765  8918 raft_consensus.cc:2393] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:35.076172  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2722) took 1330 ms. Trace:
I20260709 12:15:35.076643 14670 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.058079 14207 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:15:35.077649 14207 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:35.077993 14207 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.079155  9624 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:35.079335  9622 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:35.079779 14709 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:35.080277  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.080333 14709 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.082645 14709 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.086342  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.090878  9619 raft_consensus.cc:2410] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:15:35.083992  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.076575  8918 rpcz_store.cc:276] 0709 12:15:33.745622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.074652 (+1329030us) service_pool.cc:224] Handling call
0709 12:15:35.076098 (+  1446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.091888  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:35.096344  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:35.099396  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:35.099714  9621 raft_consensus.cc:2393] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:35.102417  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.083190 14709 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:35.103192 14709 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.104494  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.105059  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.106670  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:35.105790  9621 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:35.108476  9616 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:35.111752  9615 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:35.115058  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.119498 14709 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.122956  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60214 (request call id 1174) took 1488 ms. Trace:
I20260709 12:15:35.123397  9000 rpcz_store.cc:276] 0709 12:15:33.634070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.634223 (+   153us) service_pool.cc:224] Handling call
0709 12:15:35.122727 (+1488504us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400236ed4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:35.122865 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322688384}
I20260709 12:15:35.134078  9071 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:35.135823  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.139652  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.141867  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.150575  8916 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:35.151343  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2726) took 1380 ms. Trace:
I20260709 12:15:35.151770  8916 rpcz_store.cc:276] 0709 12:15:33.770784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.141556 (+1370772us) service_pool.cc:224] Handling call
0709 12:15:35.151286 (+  9730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.156885 14721 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.157794 14721 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.164129  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:35.165118  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 78467.7us
I20260709 12:15:35.165400  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:35.165900  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62109.8us
W20260709 12:15:35.167065  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.081905 14207 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.168323  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.169615  8963 leader_election.cc:400] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16.
I20260709 12:15:35.170013  8963 leader_election.cc:403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:35.170193  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2721) took 1424 ms. Trace:
I20260709 12:15:35.170569  8916 rpcz_store.cc:276] 0709 12:15:33.745338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.155923 (+1410585us) service_pool.cc:224] Handling call
0709 12:15:35.170112 (+ 14189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.155601 14611 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.163793 14373 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.173341 14722 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.173725 14373 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.173943 14722 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.175417  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49092 (request call id 1916) took 1260 ms. Trace:
I20260709 12:15:35.176064 14373 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.176188 14722 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.176582 14373 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.177093 14373 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.175804  8998 rpcz_store.cc:276] 0709 12:15:33.914831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.921853 (+  7022us) service_pool.cc:224] Handling call
0709 12:15:35.175175 (+1253322us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54002355d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:35.175352 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685476608}
I20260709 12:15:35.176494  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3274) took 1590 ms. Trace:
I20260709 12:15:35.180228  8993 rpcz_store.cc:276] 0709 12:15:33.586223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.586382 (+   159us) service_pool.cc:224] Handling call
0709 12:15:33.586732 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:34.246473 (+659741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.176271 (+929798us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54002350d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:35.176436 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399782272}
I20260709 12:15:35.179747 14611 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.184368 14554 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.184990 14554 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.185734 14611 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.179169 14373 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.186457 14611 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:35.187042 14373 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.187266 14611 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:35.187654 14373 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.188369  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.190940  8916 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:35.191365  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2728) took 1352 ms. Trace:
I20260709 12:15:35.191666  8916 rpcz_store.cc:276] 0709 12:15:33.839369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.171207 (+1331838us) service_pool.cc:224] Handling call
0709 12:15:35.191312 (+ 20105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.189414 14721 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.196363 14550 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.192050 14207 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.201781  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.201658 14725 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:35.215476  8916 raft_consensus.cc:2393] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:35.216120  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2725) took 1469 ms. Trace:
I20260709 12:15:35.216531  8916 rpcz_store.cc:276] 0709 12:15:33.746542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.195071 (+1448529us) service_pool.cc:224] Handling call
0709 12:15:35.216046 (+ 20975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.220759 14721 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.221791 14721 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.224141 14550 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.224476 14721 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.224696 14550 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.218077 14287 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:35.228735 14287 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.229302  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.230441  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2720) took 1485 ms. Trace:
I20260709 12:15:35.230937  8917 rpcz_store.cc:276] 0709 12:15:33.745033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.228943 (+1483910us) service_pool.cc:224] Handling call
0709 12:15:35.230363 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.194051 14373 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.187139 14554 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:35.238217  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 72902.9us
I20260709 12:15:35.239073  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.239714  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.240036  8917 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:35.230969 14287 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.219377 14606 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.243274 14611 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:35.243381 14723 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.247826 14723 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.248087  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.248945  9618 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:35.249218 14732 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.249887 14732 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.252494 14732 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.253010 14732 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.250263 14723 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.248965 14554 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.259508 14554 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.262017 14554 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.253521 14732 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.274417  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:35.275352  9069 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.276062  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.276737  9067 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:35.278604  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.236933 14550 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.281201  9067 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:35.279829  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:35.247829  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 79205us
I20260709 12:15:35.288311  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:35.292881  8917 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:35.293138  9070 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:15:35.290539 14723 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:15:35.299952 14729 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:15:35.281080 14554 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.303994 14554 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.304468  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.309425  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.310458  9072 raft_consensus.cc:2376] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16. Re-sending same reply.
I20260709 12:15:35.306834 14554 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:35.318403  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.292908  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.320514 14730 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.322264 14730 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.324910  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.326934  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.327211  8889 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:35.327948  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.328141  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.330269 14539 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.330858  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.331661  9065 raft_consensus.cc:2393] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:35.332607  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.332815 14669 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.325677  8919 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:15:35.333503  9065 raft_consensus.cc:2393] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:35.334225  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.335570  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.336633  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.337069  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.337742 14723 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:35.340492  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:35.344466  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:35.337780  8922 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:35.337184  8919 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:35.355489  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.356762  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.358405  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.354876  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.360266  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.361606  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.360364  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.363184  9071 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:35.338779 14730 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.364221  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.368638  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.338763 14554 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.338755 14657 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:35.328997  8917 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
W20260709 12:15:35.364542  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 71735.3us
I20260709 12:15:35.370544  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.374027  8922 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.376147  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2729) took 1533 ms. Trace:
I20260709 12:15:35.376540  8917 rpcz_store.cc:276] 0709 12:15:33.842456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.373755 (+1531299us) service_pool.cc:224] Handling call
0709 12:15:35.375409 (+  1654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.375837 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.375862 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:35.375901 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:35.375936 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.375989 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:35.376098 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.360841 14725 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16.
I20260709 12:15:35.378083  9073 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:15:35.378618  9073 pending_rounds.cc:85] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 10
I20260709 12:15:35.379036  9073 pending_rounds.cc:107] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:35.379385  9073 raft_consensus.cc:2889] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:35.365178 14729 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:35.376328  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.365594 14373 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:35.378556  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2730) took 1495 ms. Trace:
I20260709 12:15:35.380188  8966 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:35.371354 14687 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:35.376273 14657 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.383948 14687 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:35.384933 14687 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.385588 14657 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.363458 14728 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:35.375028 14722 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.362859 14550 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:15:35.383296 14528 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:35.371932 14730 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.398474 14738 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:35.399621  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.382099  8917 rpcz_store.cc:276] 0709 12:15:33.883232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.377797 (+1494565us) service_pool.cc:224] Handling call
0709 12:15:35.378067 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.378252 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.378282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:35.378320 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:35.378361 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.378409 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:35.378504 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:35.397464  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.380793 14729 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.403555  9040 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.404400 14728 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:35.405586  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:35.406397 14728 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:35.406610 14550 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:35.407102 14550 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:35.401263  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.408154 14550 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.409363 14550 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:35.409500  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.406992 14728 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.410463 14728 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:35.411027  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.414582  8917 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:35.421006 14743 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:35.421619 14743 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.422116 14743 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:35.424890  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:35.430804 14743 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.381268 14735 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:35.432636 14606 consensus_queue.cc:1059] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:15:35.436980  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 54565.1us
I20260709 12:15:35.388034 14725 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:15:35.437562 14744 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:35.433940 14736 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:15:35.440029  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.398762 14732 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:35.471998  9068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59490 (request call id 1199) took 1806 ms (client timeout 2237 ms). Trace:
W20260709 12:15:35.472483  9068 rpcz_store.cc:269] 0709 12:15:33.665173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.665736 (+   563us) service_pool.cc:224] Handling call
0709 12:15:35.471806 (+1806070us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54001b5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:35.471936 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143706496}
I20260709 12:15:35.402206 14730 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.476114 14732 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.476667 14732 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.477083 14730 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.395499 14373 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.478802 14732 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.375969 14554 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.482285 14554 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:35.435375  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 70770us
I20260709 12:15:35.444173  8997 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:35.448117  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:35.450891  8922 raft_consensus.cc:2468] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
W20260709 12:15:35.451749  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 75483.5us
I20260709 12:15:35.451910  8993 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:35.486215  8998 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:35.451550  8917 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:35.488502 14715 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.453033 14738 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:35.453080 14743 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.454701  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.490641 14738 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.491287 14358 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.432752 14729 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.430526 14728 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.434542 14539 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:15:35.399348 14722 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.470232 14733 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:35.400604 14528 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.480309  9071 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:35.479449 14373 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.483111  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.494199  9040 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:35.495270  8998 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
W20260709 12:15:35.495885  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 94808.1us
I20260709 12:15:35.506058  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:35.501277  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 46663.6us
I20260709 12:15:35.501785 14743 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:35.502311 14554 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:35.512573  8918 raft_consensus.cc:1240] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:35.513726  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.513891  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.514999  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.515328  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.502511  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.515023  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.511349  9069 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:35.520633  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.509932 14528 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:35.521514  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.525658  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:35.524097  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.533108  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:35.503367 14733 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:35.524565  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.528198 14727 raft_consensus.cc:2804] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:35.521710 14743 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:35.538012  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.544191 14744 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:35.548060 14722 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.540421 14746 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.594165  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:35.594763  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.551007 14709 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:35.535526 14730 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:35.540627 14542 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:15:35.523505 14741 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:35.557377 14743 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.539254 14732 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:35.560223 14727 raft_consensus.cc:697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.563337 14733 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.605298  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.606053  9587 leader_election.cc:400] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:35.529433 14625 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:35.574066  8997 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:35.596541  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:35.598697  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:35.606832  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.594045 14725 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.568163  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.606452  9587 leader_election.cc:403] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:15:35.603096 14741 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:35.609153  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 57204.8us
I20260709 12:15:35.611399  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.615201 14741 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.616214  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.616905  8918 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:35.617600 14728 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.617831  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.607306 14732 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.619110  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.619311 14540 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:35.621063 14732 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.621328  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.622411  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.622473  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.612109  8925 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:15:35.633808  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:35.631258  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.605278 14709 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:35.644352  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.645186  8916 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:35.646575  8916 raft_consensus.cc:1240] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:35.648252  8916 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:35.611688 14441 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:35.652535  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.670358  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.671164  8921 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:35.638216 14732 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:35.659782 14733 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:35.735870  8921 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:35.709638 14732 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.773830  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2708) took 2219 ms. Trace:
I20260709 12:15:35.774295  8924 rpcz_store.cc:276] 0709 12:15:33.554358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.554563 (+   205us) service_pool.cc:224] Handling call
0709 12:15:33.564280 (+  9717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:33.771105 (+206825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.773517 (+2002412us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400018454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:35.773742 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474298752}
I20260709 12:15:35.762840 14732 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:35.613874 14725 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.596174 14746 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.616153 14727 consensus_queue.cc:237] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.767462 14709 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.802819 14763 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:35.803339 14763 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.803735 14763 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:35.822451 14755 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:15:35.823189 14752 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:15:35.826520 14763 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.828536 14725 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.830199 14746 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.830765 14763 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.832199 14611 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:35.832765 14611 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.838271 14741 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.842573  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.845955 14741 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.844146 14732 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.848811 14732 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:35.857649  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:35.858834  8924 raft_consensus.cc:2368] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:35.862718  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:35.833786 14611 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.865283 14611 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:35.878032 14756 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 12:15:35.878307 14729 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:35.883213 14729 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:35.891664  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:35.933444  8917 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
W20260709 12:15:35.960954  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 311353us
I20260709 12:15:35.963403 14373 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:35.972018  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 358951us
I20260709 12:15:35.973606  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:35.977942  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.983690 14763 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:35.984323 14763 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:35.985224 14763 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:35.988864  9037 leader_election.cc:336] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.724s (SENT)
I20260709 12:15:35.989084 14373 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:35.989444 14754 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 12:15:35.989498  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.990578 14723 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:35.991328  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:35.962824  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:35.992012 14759 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:35.991540 14373 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.992563 14723 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:35.993084 14723 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:35.993257  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:35.993907 14723 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:35.994870 14373 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:35.995611 14759 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:35.997001 14759 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:35.997373 14759 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:35.997745 14759 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:36.008176 14767 log.cc:927] Time spent T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:15:36.015463 14769 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:36.015612 14759 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.021705  9071 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:15:36.047490  9071 pending_rounds.cc:85] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 8
I20260709 12:15:36.047823  9071 pending_rounds.cc:107] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:15:36.048069  9071 raft_consensus.cc:2889] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:36.030136  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.051560  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:36.052634 14759 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:36.053328 14759 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:36.054206 14759 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:36.054637 14759 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:36.054993 14759 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:36.076507  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.078037  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:36.079811  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:36.079720 14759 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.081984 14759 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.083072  9624 raft_consensus.cc:1240] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: []
W20260709 12:15:36.084580  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.661692 14441 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.040023 14765 consensus_queue.cc:1059] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:36.094120  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:36.092463 14441 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:36.097783 14759 raft_consensus.cc:3055] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:36.096237 14663 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.101898  9071 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:36.101714 14759 raft_consensus.cc:740] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:36.148176  9071 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:15:36.102823 14663 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.156175 14663 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.160861 14732 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:36.161552 14732 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.109808 14759 consensus_queue.cc:260] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.163878 14732 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.164319 14759 raft_consensus.cc:3060] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:36.166994  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:36.170671  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:36.171537 14723 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:36.172097 14723 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.174223 14723 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:36.174759  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:36.177145  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.012s
W20260709 12:15:36.185249  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.005s	sys 0.013s
I20260709 12:15:36.177970  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3527) took 2538 ms. Trace:
I20260709 12:15:36.179026  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:36.180716  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:36.187400  9623 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:36.187424  9622 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:36.182567  8964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.000s
W20260709 12:15:36.188421  8964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.001s
I20260709 12:15:36.186600  9066 rpcz_store.cc:276] 0709 12:15:33.639533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.643811 (+  4278us) service_pool.cc:224] Handling call
0709 12:15:33.644167 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:33.840355 (+196188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.177744 (+2337389us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400368654. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:36.177888 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444048640}
I20260709 12:15:36.192229  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:36.192951  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 668413us
I20260709 12:15:36.193676  8964 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.198343  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.198896  9622 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:36.195032  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.200557  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:36.203759 14725 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.204356 14629 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:36.184773 14615 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.205721  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.205556 14615 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.202489 14746 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.207051  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.212033  8998 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 10.
I20260709 12:15:36.208950  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.209153  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:36.213281  9071 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:36.211308 14629 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:36.224397  9623 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:36.199831 14759 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.201891 14732 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:36.226050  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 174546us
I20260709 12:15:36.227114  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.229653  9590 leader_election.cc:400] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15.
I20260709 12:15:36.230883  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.233330 14759 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.230820  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.235895  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:36.236959  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:36.238296  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.239058  8992 raft_consensus.cc:2368] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:36.240514  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.241312  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:36.241873  8920 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:36.242139  9037 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.244583 14615 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:36.226956 14746 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:36.244943  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.245867 14730 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:36.247161 14729 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:36.247684 14729 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:36.248818  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:36.248517 14729 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.251397  8920 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:36.252347 14629 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:36.256567 14611 consensus_queue.cc:1059] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:36.257022 14730 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.258028  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:36.259508  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.260831  8964 leader_election.cc:400] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
I20260709 12:15:36.262202  9590 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:36.261123  8964 leader_election.cc:403] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:36.266767  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.258047 14611 raft_consensus.cc:3055] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:36.240641 14709 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:36.265230 14746 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:36.276957  8964 leader_election.cc:400] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16.
I20260709 12:15:36.265058 14540 raft_consensus.cc:2804] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:36.282733  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.264539 14730 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:36.268417 14615 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:36.290217  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:36.275215 14725 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:36.275565 14611 raft_consensus.cc:740] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:36.304100  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:36.294384 14743 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.307554  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.293380 14540 raft_consensus.cc:697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:36.308825  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.309767  8995 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:36.312958  9615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.016s	sys 0.020s
I20260709 12:15:36.315532  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.315994  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.316661  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.305070 14730 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:36.298899 14615 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:36.295586 14725 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:36.334060  9588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.049s	sys 0.068s
W20260709 12:15:36.380628  9588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.049s	sys 0.068s
W20260709 12:15:36.381405  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 750219us
W20260709 12:15:36.343325  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.344224 14759 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.344969  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.346827  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.353396  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.355000  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:36.398609  9070 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 20: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:36.320698  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.385110  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:36.398609  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 43704.1us
W20260709 12:15:36.368841  9615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.018s	sys 0.021s
I20260709 12:15:36.406257  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.408962  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.409041  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.409821  8998 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:36.409590  9073 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:36.397806 14725 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:36.412382  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.420372  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.421013  9070 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:36.421907  8889 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:36.425927  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.409135 14736 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:15:36.401067 14662 raft_consensus.cc:2764] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:36.439970  9622 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:36.441320  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:36.442436  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.444705  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:36.445473  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 55253.6us
I20260709 12:15:36.446274  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.447240  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.449141  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.410111 14730 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.457368  9070 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:36.401000 14765 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:15:36.465760  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.387171 14611 consensus_queue.cc:260] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.460234 14539 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:36.440439 14721 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:15:36.477461  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.465075 14662 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:36.419919 14540 consensus_queue.cc:237] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.470196 14785 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:36.471722 14732 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.483166  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:36.406620 14602 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.467059 14615 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.498602  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.499774  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.500336  8993 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:36.501098  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.501874 14611 raft_consensus.cc:3060] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:36.508589 14441 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.511209  9624 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: []
W20260709 12:15:36.511888  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.515734 14602 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:36.521092  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:36.518950  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.521720  8920 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:15:36.521924  8994 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:36.464766 14730 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.524087  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:36.525974  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82866.2us
I20260709 12:15:36.529134  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.529166  8994 raft_consensus.cc:2410] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:36.482276 14662 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:36.534655  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1179) took 1110 ms. Trace:
I20260709 12:15:36.535269  9000 rpcz_store.cc:276] 0709 12:15:35.424226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.424351 (+   125us) service_pool.cc:224] Handling call
0709 12:15:35.424622 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.483843 (+ 59221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.483873 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:35.483916 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:35.483958 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.534332 (+1050374us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b540039add4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:36.534402 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:36.534575 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134809984}
I20260709 12:15:36.547914  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.560070 14441 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.562300 14730 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:36.548218  8920 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:36.578820  9590 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:36.579699 14629 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:36.544167 14662 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:36.581096 14765 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:36.581591 14765 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:36.582428 14765 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.582181 14709 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Committing config change with OpId 14.10: config changed from index 3 to 10, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:15:36.579926  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.589813 14746 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 13. Current term is 14.
W20260709 12:15:36.590611  9072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.037s	sys 0.023s
W20260709 12:15:36.590991  9072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.037s	sys 0.024s
I20260709 12:15:36.590646  8993 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:36.600564  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.602933  8998 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:36.604347  8998 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:15:36.607913  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:36.608652  9071 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:36.609553  8924 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:36.610525 14729 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.611057 14729 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.611675 14772 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:36.613229 14729 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:36.614900  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.615556  9066 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:36.616693  8998 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:36.618109  8998 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:36.640641  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.643383  8991 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:36.645162  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:36.652822 14725 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.653860  8996 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:36.658138 14723 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:36.658739 14723 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.661679  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2832) took 1157 ms. Trace:
I20260709 12:15:36.662067  9068 rpcz_store.cc:276] 0709 12:15:35.504797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.506962 (+  2165us) service_pool.cc:224] Handling call
0709 12:15:35.508214 (+  1252us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:35.935335 (+427121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.935365 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:35.936029 (+   664us) log.cc:844] Serialized 52 byte log entry
0709 12:15:35.953398 (+ 17369us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:36.660848 (+707450us) log.cc:844] Serialized 14 byte log entry
0709 12:15:36.661201 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:15:36.661374 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.661441 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:36.661480 (+    39us) raft_consensus.cc:1685] finished
0709 12:15:36.661492 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:36.661623 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":721607,"raft.queue_time_us":30416,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4646,"thread_start_us":429015,"threads_started":2,"wal-append.queue_time_us":15805}
I20260709 12:15:36.619519  8920 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 3 to 10, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:36.618367  8997 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:36.619355  9071 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
W20260709 12:15:36.668017  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 194700us
I20260709 12:15:36.670994  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.687669  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.650218 14207 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:36.697543  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:36.699287  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:36.699950  9000 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:36.721760  9619 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:15:36.712419  9589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.003s	sys 0.007s
I20260709 12:15:36.724094  9623 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:36.714803  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.700130  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3559) took 1191 ms. Trace:
W20260709 12:15:36.787160  9589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.004s	sys 0.012s
W20260709 12:15:36.708014  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 234900us
I20260709 12:15:36.788169  9072 rpcz_store.cc:276] 0709 12:15:35.508977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.509900 (+   923us) service_pool.cc:224] Handling call
0709 12:15:35.510219 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.510443 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:36.591369 (+1080926us) log.cc:844] Serialized 14 byte log entry
0709 12:15:36.699804 (+108435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:36.699857 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:36.699901 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.699961 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:36.700077 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6893,"prepare.queue_time_us":1139716,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":5736,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":1371,"thread_start_us":1171311,"threads_started":2,"wal-append.queue_time_us":127436}
I20260709 12:15:36.793988  8992 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:36.793671  8994 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:36.811743  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 99652.6us
I20260709 12:15:36.699251 14615 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:36.827145  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.825806 14615 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.829059  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:36.371635  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:36.832566  8918 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:36.834767  8921 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:36.823879  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:36.719446 14789 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.827431 14554 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:36.774897 14539 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:36.838711  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:36.839772  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 190740us
I20260709 12:15:36.752185 14765 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.698906 14723 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:36.733582 14725 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:36.812847 14730 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:36.851424  9623 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:36.824611  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:36.759639  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7e00 after lost signal to thread 7719
W20260709 12:15:36.900796  8946 debug-util.cc:398] Leaking SignalData structure 0x7b0800242fc0 after lost signal to thread 8857
W20260709 12:15:36.902081  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080023cce0 after lost signal to thread 8949
W20260709 12:15:36.902344  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9b20 after lost signal to thread 8950
W20260709 12:15:36.903399  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdb40 after lost signal to thread 9024
I20260709 12:15:36.702916 14207 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.788506 14662 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:36.852533  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 320346us
I20260709 12:15:36.724512 14801 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:36.928942  9623 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:36.683184 14629 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:15:36.862857  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:36.856499 14765 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.863613  9619 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:36.899750  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.941347  9624 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:36.941630  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:36.903659  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdbc0 after lost signal to thread 9025
I20260709 12:15:36.905045  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:36.944342  9072 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:36.919857  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 95312.3us
W20260709 12:15:36.944957  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 88851.9us
I20260709 12:15:36.947991  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:36.931209 14784 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:15:36.927414  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:36.793138 14628 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 12:15:36.793574 14746 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:15:36.852998 14615 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:36.932185  9071 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:36.934703 14785 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.923476  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58655.9us
I20260709 12:15:36.958803  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.934911 14709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46402 (request call id 1) took 8778 ms. Trace:
I20260709 12:15:36.993806  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.968552  9072 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:36.893807 14550 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:15:36.954540 14730 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:36.930459 14725 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:36.953617  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:36.943619  8946 debug-util.cc:398] Leaking SignalData structure 0x7b0800318aa0 after lost signal to thread 9098
I20260709 12:15:36.986867  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:37.017652  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080021bda0 after lost signal to thread 9099
I20260709 12:15:36.985816  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:37.018610  9068 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:36.990321  9619 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:36.933851 14532 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:36.963013  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:36.954756 14790 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:36.995467  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.929968 14727 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:36.998646  9074 raft_consensus.cc:2468] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:36.980460  8994 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:15:37.019346  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1880 after lost signal to thread 9649
I20260709 12:15:36.936390 14540 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:15:37.028164  9619 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:37.036919  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08004072e0 after lost signal to thread 9650
W20260709 12:15:37.037549  8946 debug-util.cc:398] Leaking SignalData structure 0x7b0800339c00 after lost signal to thread 14351
W20260709 12:15:37.037946  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080032a0a0 after lost signal to thread 14448
W20260709 12:15:37.038596  8946 debug-util.cc:398] Leaking SignalData structure 0x7b0800347f20 after lost signal to thread 14635
I20260709 12:15:36.953961 14788 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:15:36.981750 14773 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:15:37.029592 14532 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:36.985270 14736 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:15:37.017303 14730 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:36.992192 14663 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:15:36.992379 14734 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:37.044708 14805 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:15:36.982048 14804 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 12:15:37.017699 14722 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:36.991411 14539 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:36.994582 14721 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:15:37.058043  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 115162us
W20260709 12:15:37.039064  8946 debug-util.cc:398] Leaking SignalData structure 0x7b08000baf40 after lost signal to thread 14666
W20260709 12:15:37.119203  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080036d200 after lost signal to thread 14670
W20260709 12:15:37.119608  8946 debug-util.cc:398] Leaking SignalData structure 0x7b080033d6c0 after lost signal to thread 14682
W20260709 12:15:37.087385  9037 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 1.501s (SENT) [suppressed 17 similar messages]
I20260709 12:15:37.089759  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.090857  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.121356  9624 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:37.091188  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.092231  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:36.993026 14785 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.112970  8992 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:37.051405 14611 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.123003  9619 raft_consensus.cc:2410] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:37.123545  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.125018  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:37.064090 14730 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:15:37.127023  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.127118  8923 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:37.139801  8920 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:15:37.142388  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 299864us
W20260709 12:15:37.145390  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 147358us
I20260709 12:15:37.125324  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.140369  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:37.103857 14769 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:37.153012  8919 raft_consensus.cc:2368] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:37.151281  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.115271 14722 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.158442  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71194.2us
I20260709 12:15:37.151604  8920 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:37.155335  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.163184  8966 leader_election.cc:400] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:37.163554  8966 leader_election.cc:403] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:15:37.163990  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 210516us
I20260709 12:15:37.164742  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:37.165176  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:37.196031 14807 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:15:37.148562 14611 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.248777 14611 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:36.992479 14709 rpcz_store.cc:276] 0709 12:15:28.149784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:28.150310 (+   526us) service_pool.cc:224] Handling call
0709 12:15:29.092001 (+941691us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b58003b99d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985b970aa 00007f3985c19447 00007f3985c3670a 00007f3985c3776a 00007f3985c3691b 00007f3985c4203c 00007f3985c416b3 00007f3985c399fa 00007f398ac014c9 00007f398417dc54
0709 12:15:29.112729 (+ 20728us) log.cc:844] Serialized 487 byte log entry
0709 12:15:30.287302 (+1174573us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b180010c360. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:30.939517 (+652215us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b54007614a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb0dbe 00007f3985bbb930 00007f3985bbb8d8 00007f3985bbb858 00007f3985bbb813 00007f3985bbaa9c 00007f398baa62f6 00007f398baa0aa8 00007f3985bf77cb 00007f3985bfa2c0
0709 12:15:36.907885 (+5968368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13872,"raft.queue_time_us":49055,"raft.run_cpu_time_us":981,"raft.run_wall_time_us":98379,"spinlock_wait_cycles":1671879552,"thread_start_us":183094,"threads_started":1,"wal-append.queue_time_us":203478,"wal-append.run_cpu_time_us":13421,"wal-append.run_wall_time_us":2623687}
I20260709 12:15:37.168067 14207 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:37.160933 14554 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:15:37.159788 14722 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:37.172736 14732 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 11. Current term is 12.
I20260709 12:15:37.128773 14734 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.152036 14602 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:15:37.278141 14662 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:37.285977 14540 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:37.288436  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:37.226646 14816 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.289214  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:37.289446 14816 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.226881 14806 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.291321 14806 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.291824 14743 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:37.292232 14743 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:37.227489 14819 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.292883 14819 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.293046 14743 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.294052 14743 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:37.227859  9069 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:15:37.296415  9069 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:37.228078  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58839.2us
I20260709 12:15:37.228408  9070 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:15:37.228905  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:37.300220  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 71540.4us
I20260709 12:15:37.169397  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:37.300678 14207 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:15:37.301118  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 131798us
I20260709 12:15:37.306661  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.229269 14813 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.232743 14532 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.234476 14785 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:37.157155 14550 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.170373 14772 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:37.237367 14765 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:37.240717 14773 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:37.311267  8919 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:37.312156  8916 raft_consensus.cc:1240] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:37.314026  8925 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:37.312144  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 123584ad57374d41b689f4592fe92d4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:15:37.317950  8918 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:15:37.321036  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 497213us
I20260709 12:15:37.353132  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.352130  8919 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:37.354914  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.352746  8918 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:37.355669  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.359826  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:37.363736  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 51742.5us
I20260709 12:15:37.363849  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:37.364660 14734 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.336645 14813 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.365746 14554 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:37.367276 14813 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.367388 14791 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:37.358748 14788 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:15:37.317171 14732 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:37.383275  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.385325  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:37.345069  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.386698  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:37.344063  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 388910us
I20260709 12:15:37.389256 14788 consensus_queue.cc:1243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:15:37.390563  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:37.392270  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.386734 14554 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:37.393061 14554 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.393453 14554 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:37.393929  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.359622  8919 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.394827 14820 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:15:37.336650  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.353420 14772 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.395613 14822 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:37.393255 14808 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:37.396677 14808 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:37.397194 14772 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:37.398214  9037 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.399765 14819 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:37.400154  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.401245 14819 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:37.401937 14795 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:37.423864 14795 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:37.425221 14818 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:37.424914 14795 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.425861  8888 leader_election.cc:400] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:37.386866 14615 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:37.426251  8888 leader_election.cc:403] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:37.404448 14732 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:37.427314 14662 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:37.427695 14732 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.428851  8918 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.428982 14554 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.429994  8918 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:37.405244 14812 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:37.393057 14373 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:37.411645 14722 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:37.335515  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 189406us
I20260709 12:15:37.443084  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.416023  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.417503  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.345960 14550 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.445933  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.446923 14550 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.425657 14818 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:37.447566 14743 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:37.448141 14743 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.448503 14743 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:37.448302 14818 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.450037 14818 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:37.426138 14821 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:37.408782  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.406764  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.451575 14746 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:37.453034  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:37.358053 14721 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:37.460659  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 87646.4us
I20260709 12:15:37.459318  9588 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:37.464210  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57520.4us
I20260709 12:15:37.465255  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:37.466688  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.469445  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3561) took 1959 ms. Trace:
I20260709 12:15:37.469782 14722 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:37.469842  9065 rpcz_store.cc:276] 0709 12:15:35.509730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.511786 (+  2056us) service_pool.cc:224] Handling call
0709 12:15:35.512177 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:35.526814 (+ 14637us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:36.614674 (+1087860us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18002319a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982ac8c0a 00007f398c208219 00007f3982b50a40 00007f3982b4b4e4 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf 00007f3985c55038
0709 12:15:36.788593 (+173919us) log.cc:844] Serialized 14 byte log entry
0709 12:15:36.908694 (+120101us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:36.934299 (+ 25605us) log.cc:844] Serialized 52 byte log entry
0709 12:15:36.934432 (+   133us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:36.934654 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 12:15:37.062424 (+127770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.062497 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:37.414245 (+351748us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b18002319a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:37.469244 (+ 54999us) raft_consensus.cc:1685] finished
0709 12:15:37.469265 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.469387 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56488,"prepare.queue_time_us":1142325,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":229660,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":84033,"spinlock_wait_cycles":12320768,"thread_start_us":328131,"threads_started":3,"wal-append.queue_time_us":156049}
I20260709 12:15:37.475548 14820 consensus_queue.cc:1243] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:15:37.442950 14808 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:37.479923 14806 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:37.433938 14795 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:37.481655  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.483428  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.462456 14772 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:37.484341 14772 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.484791 14772 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:37.488734 14373 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.489305 14373 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.483345 14825 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:37.480545 14554 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:37.492069  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60683us
I20260709 12:15:37.498535  8918 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 12:15:37.499135  8918 pending_rounds.cc:85] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 13
I20260709 12:15:37.499518  8918 pending_rounds.cc:107] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 12:15:37.499938  8918 raft_consensus.cc:2889] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:37.500182  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:37.511067 14617 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.511220 14806 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:37.503443 14615 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:37.512071 14826 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:37.511654 14617 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:37.519524  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 55212.2us
I20260709 12:15:37.516371  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.522890  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:37.556188  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:37.557145  9065 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:37.565092 14615 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:37.565321  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49213us
I20260709 12:15:37.517423 14373 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.493615 14721 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.577195 14721 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:37.502534 14743 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.519121 14819 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:37.525326 14825 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:37.519915 14729 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:15:37.598098  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77172.9us
I20260709 12:15:37.597615  8922 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:37.599261  8921 raft_consensus.cc:606] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:37.600289  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 77488.9us
I20260709 12:15:37.591719 14819 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.601011  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:37.607343  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.610256  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:37.593470 14824 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.612623  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.612994  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:37.615689  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 443562us
I20260709 12:15:37.547760 14836 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:15:37.595562 14727 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:37.664723  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 64336.2us
W20260709 12:15:37.669072  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.665302  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:37.668316  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.668387  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.670794  8997 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:37.690428  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.691152  9000 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 11.
I20260709 12:15:37.614197 14819 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:37.612465 14822 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:37.522027 14826 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:37.700656  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 99710.9us
I20260709 12:15:37.702863  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.706203  8999 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:37.706436  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:37.664000 14746 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:37.708654  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:37.668895 14730 consensus_meta.cc:287] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.012s
I20260709 12:15:37.664314 14832 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:37.693316 14732 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.601472 14539 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
W20260709 12:15:37.729707  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.710170 14788 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:37.711582 14832 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:37.718115 14615 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.748308  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.693027 14727 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.694308 14824 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:37.753021  9619 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:37.725443 14812 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.752622  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.754817  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.794626  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.795594  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:37.796367  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:37.798094 14617 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:37.804113 14840 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:15:37.716895 14730 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.813843 14808 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:37.793439 14615 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:37.737721 14732 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:37.974928  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 303552us
I20260709 12:15:37.747160 14832 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:37.716282 14721 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:15:37.716452 14736 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:15:38.020871  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:37.741962 14823 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:37.722685 14662 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:15:37.720191 14722 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:15:37.757202 14733 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:37.802657 14848 consensus_queue.cc:1059] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:15:37.708854 14825 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:38.031014  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:38.074977  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:38.039659  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:38.041478  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 336239us
I20260709 12:15:38.075855  9622 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:38.043403  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:38.076861  9616 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:38.043514  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:38.077685  8922 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:38.077955  9615 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:38.048879  9623 raft_consensus.cc:1275] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:15:38.078977  9623 pending_rounds.cc:85] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 10
I20260709 12:15:38.079165  8925 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:38.079349  9623 pending_rounds.cc:107] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:38.079746  9623 raft_consensus.cc:2889] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:38.021390 14554 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.023417 14746 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:38.083583 14746 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.085702 14730 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.028776 14765 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:38.053778 14808 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.083978 14615 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:38.048455 14818 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.012s
I20260709 12:15:38.097528  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:38.098060  8995 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.100627 14826 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:38.072769 14743 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.101794  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.041826 14812 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.096494  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.102429  8998 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:38.102221 14765 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.097350  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.102583  8991 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
W20260709 12:15:38.104822 14809 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.977s	user 0.005s	sys 0.000s
I20260709 12:15:38.106225  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 1002) took 1491 ms. Trace:
I20260709 12:15:38.101929 14743 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.088773  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.109364  8922 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:38.106568  8924 rpcz_store.cc:276] 0709 12:15:36.615346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.615540 (+   194us) service_pool.cc:224] Handling call
0709 12:15:36.651165 (+ 35625us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:36.836119 (+184954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:36.836170 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:36.836907 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 12:15:36.887489 (+ 50582us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:36.887564 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.887670 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.104218 (+1216548us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:38.105914 (+  1696us) raft_consensus.cc:1685] finished
0709 12:15:38.105936 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.106150 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232930,"raft.queue_time_us":188922,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":31749120,"thread_start_us":46747,"threads_started":1,"wal-append.queue_time_us":181310}
I20260709 12:15:38.119478 14743 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:38.122501 14842 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:15:38.123379 14844 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:15:38.123596 14743 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:38.124341 14843 log.cc:927] Time spent T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:15:38.089986 14554 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.129256 14554 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.130765  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.090265 14835 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.096974 14746 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:38.141259 14851 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.118511 14849 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:15:38.160306 14772 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.675s	user 0.018s	sys 0.001s
I20260709 12:15:38.147931 14727 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.163005 14858 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:38.163189  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:38.167464 14824 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.173246  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.173684  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:38.174520 14769 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.134871 14812 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:38.144961 14835 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.200248 14835 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:38.184492 14795 consensus_meta.cc:287] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.703s	user 0.019s	sys 0.000s
W20260709 12:15:38.202314  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:38.185117 14772 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.206123 14772 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.177270 14813 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:38.185595 14819 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.207785  9065 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:15:38.208711 14819 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:38.185772  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109640us
I20260709 12:15:38.186444 14858 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.192011  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:38.236696  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44759.4us
I20260709 12:15:38.194077 14769 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.195305 14826 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:38.195984 14732 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.176106 14851 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.239759  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.196493 14773 raft_consensus.cc:3055] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:38.197438 14554 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.198114 14723 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:38.247051  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.243417  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.244524  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.245641  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.248721  9072 raft_consensus.cc:2393] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 20: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:38.256151  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.260939  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.262784  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.266199  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:38.267810  8997 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:38.272677  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.277912  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.278654  9072 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:15:38.247973 14819 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:38.244037 14773 raft_consensus.cc:740] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:38.284368  8922 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:15:38.285943  8922 pending_rounds.cc:85] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 12
I20260709 12:15:38.286263  8922 pending_rounds.cc:107] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:15:38.286566  8922 raft_consensus.cc:2889] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:38.288030  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:38.288679  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:38.290817  8920 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:15:38.292725  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.213016 14832 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.248595 14835 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:38.295279  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.296741  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.294808  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:38.298626  8995 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:38.297207  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.280583 14824 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:38.305488  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:38.306286  8996 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:38.285318 14819 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.308009  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.249773 14554 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.274545 14795 consensus_queue.cc:1059] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:38.313735  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.315828  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.316336  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.328930  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:38.331099  8996 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:38.331476  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:38.304252 14824 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.336381  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.341312  8920 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
I20260709 12:15:38.280897 14850 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:15:38.346741  9000 raft_consensus.cc:1240] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:38.313593 14819 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.305962 14733 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:38.332273 14845 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.233s	user 0.002s	sys 0.000s
I20260709 12:15:38.334338 14743 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:38.343019 14729 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.306154 14808 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.305256 14835 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.345487 14824 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.390522 14859 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:38.416684 14859 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.355115 14554 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:38.390218 14729 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.425809 14835 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:38.430315  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 347880us
I20260709 12:15:38.442543  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.445334  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:38.449592  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 67505.1us
I20260709 12:15:38.448576  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.360080 14858 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.452414  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.351580  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:38.376910  8917 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:38.378127  8996 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:38.355742 14769 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.376125 14743 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:38.367103 14822 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.364825 14832 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.348953 14611 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:38.349021 14864 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:38.368391 14851 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.348484  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:38.526309  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 206043us
I20260709 12:15:38.423038 14729 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.449262 14550 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:38.536811  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 78128.3us
I20260709 12:15:38.454385 14861 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:38.497925  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:38.498376  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 46071.1us
I20260709 12:15:38.578687  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:38.499636  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.580215  9067 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.500772  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:38.581364  9066 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:38.453100 14863 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:38.450271 14865 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:38.545608  9068 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 12:15:38.458731  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 124045us
W20260709 12:15:38.576189  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 80334us
I20260709 12:15:38.597538  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35278 (request call id 38) took 1147 ms. Trace:
I20260709 12:15:38.581573  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:38.365483 14733 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.536403 14732 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.598240  8921 rpcz_store.cc:276] 0709 12:15:37.359584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.363651 (+  4067us) service_pool.cc:224] Handling call
0709 12:15:38.507016 (+1143365us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400018454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c35853 00007f398ac0360a 00007f39841897d4 00007f3984189762 00007f3984189691 00007f398418960c 00007f39841888c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:38.507128 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539770240}
I20260709 12:15:38.503700 14822 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:38.621264  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:38.631479  9070 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:15:38.650439  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 302035us
I20260709 12:15:38.651446  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:38.507933 14858 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:38.536275 14554 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:38.553678 14835 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:38.697944  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46607.6us
W20260709 12:15:38.667829  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 89274.3us
I20260709 12:15:38.706652  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:38.708212  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 126742us
I20260709 12:15:38.593484 14872 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:15:38.711799  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 116761us
I20260709 12:15:38.656075 14373 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:38.722608  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.741330  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:38.697283 14806 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:38.723549 14870 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:38.704478 14835 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.733048 14876 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:38.699282 14554 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.665437 14550 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:38.742174  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:38.748980  8888 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.658221 14732 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:38.722972 14862 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:15:38.695506 14859 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.713842 14836 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:38.696761 14858 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:38.751309  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 155434us
I20260709 12:15:38.750772  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:38.574889 14864 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.708626 14871 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:38.743825 14611 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:38.666105 14743 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.603014 14863 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.756052 14870 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:38.749650 14872 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:38.759297  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:38.757977 14836 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.748488 14806 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.759758  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:38.742910 14663 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:15:38.758524 14861 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:38.751202 14550 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:38.762540 14373 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:38.757900 14808 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.802459 14859 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:38.858798 14602 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.804949 14795 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.865206 14830 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.763689 14875 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:38.865350 14602 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.865772 14830 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:38.865211 14859 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.867993 14830 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.868990 14859 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.820768 14554 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:38.824412 14722 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:38.875294  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 166242us
I20260709 12:15:38.852805  9623 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:38.854142  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:38.855300  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 95576.9us
I20260709 12:15:38.877130  9618 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:38.855532  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:38.877547  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:38.774307  9067 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:38.864817 14611 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:38.865482 14795 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.811466 14864 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:38.809330 14863 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:38.854923 14255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.001s	sys 0.023s
I20260709 12:15:38.841459 14773 consensus_queue.cc:260] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.849098 14836 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:38.783030 14872 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:38.971463  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63753us
I20260709 12:15:38.870678 14373 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:38.968992  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 208780us
I20260709 12:15:38.858745 14550 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.896267 14602 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:38.857779 14876 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 12:15:38.959666 14808 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:38.884083 14611 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:38.994117  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:38.961565 14813 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.773904 14871 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:38.976387 14373 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:38.974673 14872 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:38.991346 14207 consensus_queue.cc:1048] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:15:38.992271 14826 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:15:38.975871 14818 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:39.011384  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:38.972906 14877 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 12:15:38.960594 14830 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.005512  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:38.976553 14773 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:39.024463  9072 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:39.001905 14808 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:39.013115  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 295476us
I20260709 12:15:38.993943 14795 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.018086  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.001710 14611 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.004496 14883 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:39.029000  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:38.978854  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:39.042111 14806 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.031224  8966 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.000804 14554 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:15:39.047410  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 288193us
I20260709 12:15:39.029675 14722 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:39.006570 14831 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:15:39.008558 14662 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:15:39.003733 14813 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.041353 14819 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
I20260709 12:15:39.040709 14732 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:39.036542 14883 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.055014  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:39.019335 14818 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.072551 14819 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.076802 14858 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.079509 14883 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:39.083053 14818 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.031107 14830 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.053915 14765 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:39.054112 14835 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.088580 14808 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.096853  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.098634  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:39.071393 14722 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:39.084556 14836 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.095999 14871 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.096644 14532 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:15:39.110932  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:39.107975 14831 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:39.112673 14788 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:39.112931 14816 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:39.116215 14890 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:39.122624 14890 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:39.124728  8919 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:39.124933 14890 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.121317 14788 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.142405 14377 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:39.142874 14377 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:39.143685 14377 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.144183 14898 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:39.144860 14898 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:39.146044 14898 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.154026  9621 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:39.161082  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.161911  8991 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:39.162046 14882 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.162624 14882 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.164803 14882 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:39.164856  8822 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.166240 14882 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.167737  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.167341  8822 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 6 to 12, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 12 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:39.168555  9000 raft_consensus.cc:2410] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:15:39.169415  8822 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 4 to 8, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 8 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:39.170248  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.170849  8997 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
W20260709 12:15:39.171346  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.169438  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:39.176991  8994 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:39.177527  9619 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:15:39.179059  8919 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:39.179718  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2400) took 1869 ms. Trace:
I20260709 12:15:39.180020  8919 rpcz_store.cc:276] 0709 12:15:37.310648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.310779 (+   131us) service_pool.cc:224] Handling call
0709 12:15:37.311138 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:39.122729 (+1811591us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54004b08a0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985bb0a1d 00007f3985b971a4 00007f3985c19447 00007f3985c31fe7 00007f3985c337de 00007f3985c3db49 00007f3985c3e416 00007f3985c3ad8f 00007f3985c3a83e 00007f398abff419
0709 12:15:39.179446 (+ 56717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.179672 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187028224}
I20260709 12:15:39.182165  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.166739 14882 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.187935  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 156851us
I20260709 12:15:39.188850  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.137283 14788 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.195745  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:39.192596  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.194046 14795 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.176908 14765 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.195188  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.195621  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.201843  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:39.208243 14830 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.209160 14825 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:39.123993 14722 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.211398 14772 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:15:39.212040  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 233242us
I20260709 12:15:39.215863 14819 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.217199 14207 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:15:39.217504  8817 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 306) took 35698 ms (client timeout 15000 ms). Trace:
I20260709 12:15:39.218364 14806 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.217734  8822 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 9 to 11, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.195899  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.196007  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.195945  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.191617 14894 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:39.231029  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.233734  9074 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:15:39.294034  9074 pending_rounds.cc:85] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 13
I20260709 12:15:39.294308  9074 pending_rounds.cc:107] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:15:39.294581  9074 raft_consensus.cc:2889] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:39.295156  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 99303.2us
I20260709 12:15:39.236596  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:39.244194  9622 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:39.249893  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.127854 14550 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.238196  9071 raft_consensus.cc:2955] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 3 to 10, VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:39.296999  8966 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.251708  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:39.181979 14861 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:39.260488  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 58729.3us
I20260709 12:15:39.299005  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:39.299700  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.300542  8996 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:39.301362  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:39.301928  8995 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:39.302007  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:39.303432  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51816.7us
I20260709 12:15:39.304141  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.304493  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:39.196651 14813 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.259832 14905 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:39.318271  8966 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.196101 14835 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:39.287367  9617 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:39.290478  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.291093  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.324554  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:39.324844  9000 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:39.291904  8822 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.235693  9072 raft_consensus.cc:1275] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:39.326170  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.326584  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:39.307422 14903 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:15:39.307708  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:39.308619  8921 raft_consensus.cc:1240] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:39.337257  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.338124  9072 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:39.309564 14550 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.310107 14889 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:39.331708 14900 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:15:39.340102 14887 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.341645  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3580) took 2112 ms. Trace:
I20260709 12:15:39.342643 14883 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.342072  9069 rpcz_store.cc:276] 0709 12:15:37.229487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.299115 (+ 69628us) service_pool.cc:224] Handling call
0709 12:15:37.319548 (+ 20433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:37.355791 (+ 36243us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:15:37.365990 (+ 10199us) log.cc:844] Serialized 14 byte log entry
0709 12:15:37.423983 (+ 57993us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b1800030280. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:15:39.014687 (+1590704us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b1800030280. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4dc02 00007f39857d520b 00007f39857dad23 00007f39857db23a 00007f3985c45a2a
0709 12:15:39.215306 (+200619us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:39.216049 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 12:15:39.216220 (+   171us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:39.216256 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.216323 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.341418 (+125095us) raft_consensus.cc:1685] finished
0709 12:15:39.341442 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.341583 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177873,"prepare.queue_time_us":10461,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":185118,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":14235,"spinlock_wait_cycles":22292736,"thread_start_us":57075,"threads_started":1,"wal-append.queue_time_us":1742630}
I20260709 12:15:39.345692  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.346396 14883 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:39.347185  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.347608  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.348886  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.349555  9069 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:39.353127 14819 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.353986 14819 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.356304 14377 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:39.357780  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.358016 14819 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.359157  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.256572 14207 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:39.312155 14824 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.868s	user 0.014s	sys 0.000s
I20260709 12:15:39.313958  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.408587  8922 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:39.327560  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.322973 14820 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:39.330703 14884 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:39.421604  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:39.422405  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.330772 14905 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.423722  9040 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:39.424984 14905 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.331708 14885 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:39.332217 14902 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:15:39.332820 14859 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:15:39.333338 14822 consensus_meta.cc:287] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 12:15:39.334892  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.427083 14859 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:39.312238  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.427537 14859 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:39.427934  8923 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:39.249089 14765 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.458809  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 124008us
I20260709 12:15:39.313638  8995 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:39.384570  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.398795 14813 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:39.399573 14858 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:39.400087  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75617.8us
I20260709 12:15:39.248953 14795 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.402690 14819 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:39.293537 14806 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.405967  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.292774 14864 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:39.409983  9068 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:39.319967 14861 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.383002  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63230.1us
W20260709 12:15:39.433655  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 406285us
I20260709 12:15:39.510869  9621 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:39.513931  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.517513  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.428416 14859 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.538239  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.372920 14207 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.462229  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.264609 14373 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.361042 14826 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:39.514413  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.459718  8966 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.515643  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.536612  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.427119 14822 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.493925 14836 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:39.458921 14824 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.611181 14845 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:15:39.619149  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:39.359599 14804 consensus_queue.cc:1059] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 12:15:39.754307 14662 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.772949 14743 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:39.831472  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:39.832130  9066 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:39.833648 14373 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:39.835912 14765 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:39.791272 14611 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
I20260709 12:15:39.510377 14864 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:39.718454  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 455432us
W20260709 12:15:39.724700  9589 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.052s	sys 0.054s
W20260709 12:15:39.856208  9589 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.053s	sys 0.054s
I20260709 12:15:39.489883 14602 consensus_queue.cc:1059] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.160s
I20260709 12:15:39.729624  8922 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
W20260709 12:15:39.734486  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 272337us
I20260709 12:15:39.859205  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:39.736923  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 277281us
I20260709 12:15:39.857817  9066 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 21.
I20260709 12:15:39.735947  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:39.503067 14863 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.161s
I20260709 12:15:39.536852 14441 consensus_queue.cc:1048] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.158s
I20260709 12:15:39.508708 14858 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.769732  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:39.720991 14820 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.773368  9067 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:39.778781  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50229.1us
W20260709 12:15:39.732409 14890 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 12:15:39.745759 14730 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:39.755091 14871 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.627774  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:39.910995 14907 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
I20260709 12:15:39.779258 14859 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.771950 14835 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.822036 14554 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:39.849915 14808 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:39.503774 14819 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.749902 14826 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:39.256456  8817 rpcz_store.cc:269] 0709 12:15:03.518793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.519021 (+   228us) service_pool.cc:224] Handling call
0709 12:15:39.217418 (+35698397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:33.420481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:33.421171 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:33.421236 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:15:33.421255 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:33.422555 (+  1300us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:33.422728 (+   173us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:33.422756 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:15:33.512533 (+ 89777us) tablet.cc:701] Row locks acquired
0709 12:15:33.512584 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:15:33.512757 (+   173us) write_op.cc:270] Start()
0709 12:15:33.512921 (+   164us) write_op.cc:276] Timestamp: P: 1783599333512683 usec, L: 0
0709 12:15:33.512959 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:15:33.621443 (+108484us) log.cc:844] Serialized 5448 byte log entry
0709 12:15:34.412879 (+791436us) op_driver.cc:464] REPLICATION: finished
0709 12:15:34.961666 (+548787us) write_op.cc:301] APPLY: starting
0709 12:15:34.961769 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:35.036140 (+ 74371us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:35.036306 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:35.117748 (+ 81442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:35.119126 (+  1378us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c36e28 00007f3989671581 00007f3989670d58 00007f39896759f1 00007f39896759a9 00007f3989675939 00007f3989675901 00007f3989674b2d 0000000000388634 0000000000388479
0709 12:15:35.194765 (+ 75639us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:15:35.199699 (+  4934us) write_op.cc:312] APPLY: finished
0709 12:15:35.258974 (+ 59275us) log.cc:844] Serialized 129 byte log entry
0709 12:15:35.259196 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:35.259390 (+   194us) write_op.cc:454] Released schema lock
0709 12:15:35.259470 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:35.259988 (+   518us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:35.260027 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2574551,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":548494,"apply.run_cpu_time_us":21382,"apply.run_wall_time_us":298288,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":90255,"prepare.run_cpu_time_us":45915,"prepare.run_wall_time_us":1698898,"raft.queue_time_us":231555,"raft.run_cpu_time_us":15789,"raft.run_wall_time_us":592447,"replication_time_us":899727,"spinlock_wait_cycles":6649088,"thread_start_us":767685,"threads_started":4,"wal-append.queue_time_us":222365,"wal-append.run_cpu_time_us":74783,"wal-append.run_wall_time_us":2865950}]]}
W20260709 12:15:39.887943  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:39.949594  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.852779 14611 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.844375 14883 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:15:39.877173 14882 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:39.896585  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:39.895749  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:39.795938  8924 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
W20260709 12:15:39.906563  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 170685us
W20260709 12:15:39.986904  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 91227.9us
I20260709 12:15:39.778450 14550 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.897176 14373 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:39.992187  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:39.912751  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:39.917168  9073 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:39.906121 14908 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:15:39.842032 14662 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.780653 14836 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:39.887367 14875 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.899897 14898 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:39.897706 14804 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:40.009416 14788 consensus_meta.cc:287] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.760s	user 0.004s	sys 0.007s
I20260709 12:15:39.900029 14901 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.896940 14884 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:39.869095 14864 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:39.911530 14813 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:39.953143  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:39.971540  9620 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:15:39.971977  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:39.976432  8889 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:39.987846  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:39.942474 14892 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:39.991843  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:40.033941 14806 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:40.065004  9071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.016s	sys 0.019s
W20260709 12:15:39.975148 14913 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:15:39.951747 14910 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.117s	user 0.001s	sys 0.002s
I20260709 12:15:39.922386 14890 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:39.922508 14820 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.003350  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:40.080134  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 76900.4us
I20260709 12:15:40.049278 14822 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:39.969118 14819 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.036448  9068 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:40.057005 14795 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.001190 14818 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:39.946513 14808 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:39.992446 14373 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:39.948413 14554 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.104429 14554 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:40.105826 14909 log.cc:927] Time spent T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:15:40.107576 14861 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.109175  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.109834  9617 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:40.007975 14894 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:40.111797 14894 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:40.113042 14894 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:39.999691 14746 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.115351 14746 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.116540 14890 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.117573 14808 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.118227 14746 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:40.061995  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 85634.8us
I20260709 12:15:39.941989 14889 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.119577 14889 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.121855 14611 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.122516 14889 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:39.996893  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 100384us
W20260709 12:15:40.065442  9071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.016s	sys 0.019s
I20260709 12:15:40.123476  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:40.123771 14662 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.125079  9071 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:40.125434 14820 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:40.127031 14916 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:15:40.038699 14804 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.128564 14804 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:40.130451  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:39.946177 14835 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.081375  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:39.942361 14831 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:39.489092 14885 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:40.062987 14813 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.040730 14875 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:40.083051 14918 log.cc:927] Time spent T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:15:40.039597 14836 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.066872 14736 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:15:40.118842 14808 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.001417 14550 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.211018  8922 raft_consensus.cc:1240] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:40.132230  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:40.133802  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:40.135160  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:40.135524  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:40.213920  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 80193.4us
W20260709 12:15:40.214203  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 82081.6us
I20260709 12:15:40.055775 14788 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.080590 14806 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:40.058665 14901 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.062445 14884 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.087136 14882 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:15:40.150307 14921 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:15:40.175599  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 94283.1us
I20260709 12:15:40.093976 14818 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.221316  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.222831  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.225010  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.164112 14662 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:40.102048 14824 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:40.163902 14913 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:40.197477 14813 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:40.226976 14893 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.227510 14736 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:40.208236 14441 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:15:40.192525 14868 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.229350 14377 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:40.154511 14816 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:40.066712 14892 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.278808  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.280930  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.277455 14882 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.236478  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.324707 14882 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.283056 14539 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.326115 14539 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.328280 14550 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.328465 14539 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.329218 14736 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:40.331182 14872 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.318s	user 0.007s	sys 0.004s
I20260709 12:15:40.330924 14893 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.229779 14861 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:40.342221  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 354398us
I20260709 12:15:40.343459  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:40.220657 14746 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:40.345276  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:40.346675  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.204530 14554 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.352829  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.357281  8995 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:40.205688 14795 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.371625  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.356516  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.372993  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.309049 14788 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.365761  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.368850  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.382223  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.382433  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.382827  9000 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:40.368818  8924 raft_consensus.cc:1240] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:15:40.332152 14892 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.376055  8995 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:40.365371  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.389655  8923 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:40.314059 14818 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.308262 14743 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.241900 14858 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.331634 14872 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.389189  8991 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:40.341234 14861 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.379873  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:40.385864  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:40.239702 14806 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.358975 14746 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.395826  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.403215  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.410311  8998 raft_consensus.cc:1240] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:15:40.405064  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:40.350253 14871 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:40.414644  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:40.432229  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.437394  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:40.389061 14532 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.230564 14804 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.225682 14831 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.443418  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.484309  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.485114  8998 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:40.486330  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.454645  9000 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:40.468623  8992 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:40.489301  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.374763 14554 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.491861  8997 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:40.471417 14937 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:40.473929  8991 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:15:40.493233 14554 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.479579  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.494858  8920 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:40.495927  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.496577  8920 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
W20260709 12:15:40.497042  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88427.1us
I20260709 12:15:40.497598  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.497751  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:40.499606 14937 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:40.499998  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:40.500034 14937 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.500809 14937 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:40.499024  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.502104  8920 raft_consensus.cc:2393] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:40.464462 14932 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:15:40.407788 14861 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.404946 14885 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:40.470343  8917 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:40.409081 14806 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.413163 14746 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:40.507107  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.508126  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:40.348214 14868 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:40.480469  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.529171  9000 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.536310  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.512487  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.502851  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.433885 14828 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:40.387679 14795 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.406095 14743 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.540668  9621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34344 (request call id 1241) took 1340 ms. Trace:
I20260709 12:15:40.540961  8922 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:40.541728  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:40.544588 14920 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 12:15:40.549434  9621 rpcz_store.cc:276] 0709 12:15:39.191701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.194922 (+  3221us) service_pool.cc:224] Handling call
0709 12:15:40.531645 (+1336723us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540046ee54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:40.531803 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656030464}
I20260709 12:15:40.515017 14875 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.509253 14441 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.550443  8993 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:40.509449 14863 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.544772 14884 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:40.557703  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 58334.8us
I20260709 12:15:40.534451 14931 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:40.528126 14871 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:40.529610 14885 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.529356 14835 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.482306 14532 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.548703 14729 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.570719  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.542471 14836 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.553061 14893 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.537285 14662 consensus_queue.cc:1059] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:15:40.556316 14824 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:40.566794 14441 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.596052  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.572302 14863 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.598377 14929 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.598953 14929 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.599980 14863 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.603305 14441 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.597316  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:40.606544  9621 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:40.579860 14885 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:40.611946 14722 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:40.612497 14722 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:40.613324 14722 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.614538 14722 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:40.615944 14890 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:40.615495 14373 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.616348 14890 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:40.616643 14373 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:40.617149 14890 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:40.617690 14864 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.000s
I20260709 12:15:40.618387 14890 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:40.622804 14871 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:40.624249 14930 log.cc:927] Time spent T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:15:40.625461 14859 consensus_meta.cc:287] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.002s
I20260709 12:15:40.612030 14826 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.618603 14864 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.615970 14868 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.628283 14901 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.593863 14824 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.659139 14864 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.661070 14937 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.664021 14937 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.642493 14872 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.546975  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.528769  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:40.712770  8923 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:15:40.713529  8923 pending_rounds.cc:85] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Aborting all ops after (but not including) 12
I20260709 12:15:40.713886  8923 pending_rounds.cc:107] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:15:40.714352  8923 raft_consensus.cc:2889] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:40.574548  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:40.715066  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.716995  9622 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 20: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:40.718693  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.578784  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.570407  9000 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:40.589617 14729 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.749089  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.750252 14729 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.751129 14532 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:40.753536  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 224696us
I20260709 12:15:40.724124 14795 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.639489 14804 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.755160 14935 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:40.730041 14831 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:40.629793 14207 consensus_meta.cc:287] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.002s
I20260709 12:15:40.757411 14207 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.759778  9072 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:40.633105 14882 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.634582 14813 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.734303  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.737035 14743 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:40.718519  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 143920us
W20260709 12:15:40.719025  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 218951us
I20260709 12:15:40.760496  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:40.770766  8998 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:40.773392  8993 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:40.773554 14923 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:40.770812  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 172852us
I20260709 12:15:40.782099  9619 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:40.783812  9069 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:15:40.784022  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.784258  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:40.785244  9066 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:40.786579  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:40.786777 14890 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:15:40.791990  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.793183 14795 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.794032 14795 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:40.797991 14942 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:15:40.800153  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3607) took 1034 ms. Trace:
I20260709 12:15:40.800765  9070 rpcz_store.cc:276] 0709 12:15:39.765526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.767996 (+  2470us) service_pool.cc:224] Handling call
0709 12:15:39.768289 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:39.940483 (+172194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:39.940531 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:39.947555 (+  7024us) log.cc:844] Serialized 26 byte log entry
0709 12:15:40.090448 (+142893us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:40.090488 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.799361 (+708873us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400421dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:40.799453 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:40.799540 (+    87us) raft_consensus.cc:1685] finished
0709 12:15:40.799561 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:40.799901 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4017,"spinlock_wait_cycles":394950528,"thread_start_us":79656,"threads_started":1,"wal-append.queue_time_us":252951}
I20260709 12:15:40.803052  8924 raft_consensus.cc:1240] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:40.807898  9065 raft_consensus.cc:1240] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:40.779631  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:40.809782 14954 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:15:40.809954  9065 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:40.810560  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.803920 14882 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.811076  8964 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:40.812271  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3603) took 1785 ms. Trace:
I20260709 12:15:40.812790  9067 rpcz_store.cc:276] 0709 12:15:39.026684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.027334 (+   650us) service_pool.cc:224] Handling call
0709 12:15:39.027684 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:39.914147 (+886463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.811735 (+897588us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540026cad4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:40.812087 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714447744}
I20260709 12:15:40.815766 14858 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:40.816367 14858 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:40.816567  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3608) took 1050 ms. Trace:
I20260709 12:15:40.816833 14858 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:40.817057  9068 rpcz_store.cc:276] 0709 12:15:39.765789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.765964 (+   175us) service_pool.cc:224] Handling call
0709 12:15:39.766301 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.085782 (+319481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.815983 (+730201us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54004209d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:40.816347 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620697856}
I20260709 12:15:40.770916 14813 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.821800  9624 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:15:40.822402  9624 pending_rounds.cc:85] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 13
I20260709 12:15:40.822774  9624 pending_rounds.cc:107] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:15:40.805085 14207 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.823112  9624 raft_consensus.cc:2889] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:40.806186 14824 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.825163  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.828722  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.810070  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:40.867522 14795 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:40.849645 14824 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:40.868721 14824 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.869338  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:40.871564 14919 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.040s	user 0.004s	sys 0.000s
I20260709 12:15:40.872568  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:40.873097 14816 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.873641 14816 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.874046  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.871105  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:40.883924  9624 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:40.857666 14942 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:15:40.886991  9000 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:40.886853  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:40.900498  9065 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:40.902068  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:40.899785  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 96419.2us
I20260709 12:15:40.901176 14824 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:40.923130 14825 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:40.927583 14255 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:40.928171 14255 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:40.928629 14255 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.932411 14207 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:40.933400 14207 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.933830  9000 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:15:40.936913 14207 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:40.938385 14818 consensus_meta.cc:287] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.532s	user 0.000s	sys 0.017s
I20260709 12:15:40.938467 14923 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.939172 14923 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:40.940935  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 46756.4us
I20260709 12:15:40.941609 14923 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:40.943821  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:40.944571  9615 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:40.945412 14923 consensus_queue.cc:1059] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:40.946511 14894 raft_consensus.cc:3055] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:40.947022 14894 raft_consensus.cc:740] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:40.948935 14894 consensus_queue.cc:260] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.950431 14806 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:40.952893 14894 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:40.969923 14951 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:15:40.970189  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.983413 14207 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:40.983976  9071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1253) took 1009 ms. Trace:
I20260709 12:15:40.984282 14207 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.984589  9071 rpcz_store.cc:276] 0709 12:15:39.974421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.125757 (+151336us) service_pool.cc:224] Handling call
0709 12:15:40.126004 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.230485 (+104481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:40.230516 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:40.230572 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:40.230610 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.983421 (+752811us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400368154. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:40.983499 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:40.983765 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239878016}
W20260709 12:15:40.991314 14819 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.011s
I20260709 12:15:40.991979 14819 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:40.993551  9074 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:40.994521  8994 raft_consensus.cc:1240] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:40.997121  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:40.915565 14898 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.006s
W20260709 12:15:41.006587  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 107798us
I20260709 12:15:41.008113 14901 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:41.009487 14901 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:41.009964 14901 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:41.006734 14929 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.011190 14901 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.012674  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.026717  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.018181 14825 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:41.049180  9624 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:40.938901 14818 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.059990  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.061458  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:41.057828  8919 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
W20260709 12:15:41.071553  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 2427) took 1773 ms (client timeout 1501 ms). Trace:
I20260709 12:15:41.075558  9074 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3609) took 1309 ms. Trace:
W20260709 12:15:41.075935  8919 rpcz_store.cc:269] 0709 12:15:39.298527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.298706 (+   179us) service_pool.cc:224] Handling call
0709 12:15:41.070665 (+1771959us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540015a754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:41.071464 (+   799us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3925886720}
I20260709 12:15:41.076153  9074 rpcz_store.cc:276] 0709 12:15:39.766044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.766163 (+   119us) service_pool.cc:224] Handling call
0709 12:15:39.766373 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.994026 (+1227653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.075187 (+ 81161us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400218c54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:41.075485 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821357312}
W20260709 12:15:41.081125  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.083678  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:41.084755 14898 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:41.087364  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:41.093294  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58550 (request call id 2875) took 1834 ms. Trace:
I20260709 12:15:41.071105 14806 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.074554  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1256) took 1069 ms. Trace:
I20260709 12:15:41.097736  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.098699  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.100453  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:41.102447  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 159282us
I20260709 12:15:41.103739  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.104535  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.105088  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:41.106693 14207 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.110505  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2443) took 1118 ms. Trace:
I20260709 12:15:41.116395  9072 rpcz_store.cc:276] 0709 12:15:39.258597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.351687 (+ 93090us) service_pool.cc:224] Handling call
0709 12:15:39.352242 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.760365 (+1408123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.092864 (+332499us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003ee9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:41.093192 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235812224}
I20260709 12:15:41.049170 14825 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.124464  8917 rpcz_store.cc:276] 0709 12:15:39.991796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.993330 (+  1534us) service_pool.cc:224] Handling call
0709 12:15:39.998439 (+  5109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.530163 (+531724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.109967 (+579804us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540020e9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:41.110285 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084814592}
I20260709 12:15:41.119812  9069 rpcz_store.cc:276] 0709 12:15:40.005149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.130492 (+125343us) service_pool.cc:224] Handling call
0709 12:15:40.130735 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:40.784393 (+653658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.074121 (+289728us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54001b6554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:41.074476 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455486720}
W20260709 12:15:41.144248 14722 consensus_meta.cc:287] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.014s
I20260709 12:15:41.147208  9068 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:41.103782 14901 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.047739 14816 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.140133 14819 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.191789  9072 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
W20260709 12:15:41.194331  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 107193us
I20260709 12:15:41.194499  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.195353  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:41.197659  9065 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:41.197691  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.199461  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.165727 14898 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:41.201488  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:41.203375 14746 consensus_meta.cc:287] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.010s
I20260709 12:15:41.203876 14746 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.206025 14746 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.208470 14722 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:41.209751  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.209309 14722 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.211001  8919 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:41.212524  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.213367  8918 raft_consensus.cc:2393] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:41.214803  8996 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
W20260709 12:15:41.215009 14963 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 12:15:41.219158 14818 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.220677  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.221313  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.221562  9616 raft_consensus.cc:2368] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:41.221673  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.222361  9622 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:41.222635  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.223026  9616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:41.223662  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.223956  9616 raft_consensus.cc:606] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:41.224586  9616 raft_consensus.cc:614] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:41.225252  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.231493 14806 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:41.231768  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.232255 14806 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.234562 14806 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.236284  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.236972  9071 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:41.237529  9071 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:41.240335  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.242219  8966 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.248091  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.249590 14532 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:41.250304 14532 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.253132 14769 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:41.256112  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 85280us
W20260709 12:15:41.257236  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44303.4us
I20260709 12:15:41.275954 14864 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:41.260322  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.280719  9065 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:41.281155  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.283725  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.284744  8920 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:41.232878  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.285804  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.286295  9072 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:41.288125  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.289832  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.291920  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.293503  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.295506  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.295832  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:41.296758 14898 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:41.297151 14898 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.297484 14898 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:41.300314 14861 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.008s
I20260709 12:15:41.300827 14617 consensus_queue.cc:1059] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:41.300829 14861 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.301954 14831 raft_consensus.cc:3055] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:41.302335 14831 raft_consensus.cc:740] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:41.303390 14861 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.303357 14831 consensus_queue.cc:260] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.305416 14831 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.310551  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.316560 14532 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.318427 14722 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.322356  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.235147 14806 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:41.323313 14806 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.324002  8923 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:41.325120  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.325546 14806 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.326431  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.330262 14255 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.333035  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.333489  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.335000  9620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:41.335703  9620 raft_consensus.cc:606] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:41.336155  9620 raft_consensus.cc:614] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:41.265618 14885 consensus_meta.cc:287] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 12:15:41.339780 14885 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.341018  8992 raft_consensus.cc:1240] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:41.341358  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:41.341975 14885 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.341039  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.333491 14816 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.346786  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:41.347446 14923 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:41.347492  8917 raft_consensus.cc:606] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:41.348106  8917 raft_consensus.cc:614] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:41.357293  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.350338 14875 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:41.351429  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:41.353241  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 165465us
I20260709 12:15:41.354068  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:41.354518 14858 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.007s
I20260709 12:15:41.372918 14858 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.374210  8993 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:41.375023  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:41.376389 14875 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:41.376809 14875 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:41.377228 14875 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.378101  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.378983  8916 raft_consensus.cc:2376] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15. Re-sending same reply.
I20260709 12:15:41.354933  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:41.349247  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 107476us
I20260709 12:15:41.363304  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.369343  9620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:41.330688  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:41.370129 14894 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:41.388208  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.383757  9065 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:41.387885  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:41.394575  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 94115.9us
I20260709 12:15:41.385918  9620 raft_consensus.cc:606] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:41.395397  9620 raft_consensus.cc:614] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:41.396174 14894 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.396778 14824 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:41.397951 14824 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:41.398303 14824 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:41.401532  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.405090  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:41.441061  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 66205.6us
I20260709 12:15:41.399612 14858 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.409015 14894 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.427078 14831 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:41.423605 14746 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:41.454437 14746 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.454984 14746 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:41.451472 14859 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.451898  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.453459  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:41.468937 14898 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.471558  8920 raft_consensus.cc:1240] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:15:41.473587  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:41.475003  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:41.477048  8917 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:41.480291  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.482241  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:41.483814  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 153223us
I20260709 12:15:41.485018  8888 leader_election.cc:400] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:41.485323  8888 leader_election.cc:403] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:41.501972  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53622.2us
W20260709 12:15:41.505949  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60909us
I20260709 12:15:41.510360  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.512099  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.426798 14824 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.445672 14806 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.450176 14255 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.522716  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:41.525490  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:41.517755 14901 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:41.524515  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:41.510835 14769 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:41.563313  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:41.532127 14722 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.574420  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.516980 14875 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.540977 14898 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:41.597959  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.577368  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:41.596601  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.546959 14831 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.605362  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:41.610190  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:41.615350 14937 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:15:41.616381 14765 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:41.617596 14885 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.618330 14885 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.622015 14935 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:41.622542 14935 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:41.623356 14373 consensus_queue.cc:1059] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 12:15:41.627499 14927 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.628178 14927 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.602254 14861 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:41.629588 14861 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:41.629945 14861 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:41.630528 14927 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.566972 14824 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.638090  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.578642 14894 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:15:41.639253  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 67131.6us
I20260709 12:15:41.634802  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.598409 14858 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:41.534479 14806 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.646188  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:41.659763  8966 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.644328 14858 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:41.580308 14722 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.602963 14769 consensus_queue.cc:1059] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:15:41.648348 14532 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:41.663605 14858 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.635119 14255 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:15:41.667881  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:41.672859  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95605.6us
I20260709 12:15:41.648792 14894 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:41.678361 14722 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.657554 14207 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:15:41.671130 14769 raft_consensus.cc:3055] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:41.687611 14769 raft_consensus.cc:740] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:41.690363 14769 consensus_queue.cc:260] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.670126 14935 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.691550 14769 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.691952 14935 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:41.694097 14373 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:41.694646 14730 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:41.704071  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.711381  8916 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:41.694734 14373 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.723671 14894 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.697448 14901 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:41.716549 14927 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:41.710621 14831 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:41.746165  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:41.740491 14825 consensus_meta.cc:287] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.005s
I20260709 12:15:41.754632  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.755928  9619 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:41.758023 14819 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:41.758460 14819 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:41.754634  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.734192 14901 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:41.760273 14875 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.759721 14819 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.759743 14806 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.759508  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:41.748718  8925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.026s	sys 0.029s
W20260709 12:15:41.767483  8925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.026s	sys 0.030s
I20260709 12:15:41.772861  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.769982 14890 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:41.780560  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.768795 14927 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:41.793431 14859 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:41.795018  9037 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.795492 14898 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:41.779942 14819 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.801640  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.767457 14722 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:15:41.786170  8917 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:41.754060 14825 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.803310 14885 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.810498 14816 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:41.767630 14746 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.830762 14746 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:41.831086 14722 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:41.831601 14722 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:41.822819 14532 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:15:41.832309  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 389946us
W20260709 12:15:41.835192  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.841889  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:41.841274 14818 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:41.845899 14859 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:41.812758 14901 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.815629 14806 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:15:41.838330 14532 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:41.856318 14806 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:41.856892  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.858116 14818 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:41.858530 14818 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:41.859403 14859 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:41.859977 14859 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.862167 14859 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.863993 14825 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:41.856894 14806 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.864959 14806 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.852821 14722 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.865880 14722 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.867461 14818 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.867849 14532 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.875417 14769 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:41.876001 14769 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:41.877168 14769 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:41.878756 14769 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:41.899408  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 260111us
I20260709 12:15:41.888221 14818 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:41.914691  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.890700 14373 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:41.899857 14901 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.927937  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:41.930899  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:41.931778  9616 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:41.933518  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.934082  9620 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:41.936419  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.937162  9618 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:15:41.937620  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 328087us
I20260709 12:15:41.885308 14927 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:41.936198  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:41.924628 14746 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:41.957505  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.953552  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:41.959292  8916 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:41.954031  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.960510  8919 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
W20260709 12:15:41.963333  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.947559 14859 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:41.983366  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 189744us
I20260709 12:15:41.987473  9068 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:15:41.993780  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:41.991572  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:42.005059  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 65536.6us
W20260709 12:15:42.011538  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 210040us
W20260709 12:15:42.024365  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76170.9us
I20260709 12:15:42.028534  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:41.986224 14816 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:42.037213  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.045351  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.045579  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.046276  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:42.046980  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:42.046350  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.049494  9071 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:42.050220  9065 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:42.049377  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.050380  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:42.056286  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 49855.8us
I20260709 12:15:42.058338  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:42.047523 14973 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:15:42.035730 14894 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.059482  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:41.994222 14885 consensus_queue.cc:1059] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:15:42.061686  9068 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:15:42.006904 14746 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:42.052871 14971 log.cc:927] Time spent T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:15:42.057185  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:42.066171  9074 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:42.069326  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:42.034027 14831 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:15:42.073796  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 94865.8us
I20260709 12:15:42.031105 14937 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:15:42.049289 14871 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.077062  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:42.081841  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.080205  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:42.083282  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.061730 14859 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:42.088814  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 104966us
I20260709 12:15:42.096249  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.077730 14984 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.094457  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2782) took 1728 ms. Trace:
I20260709 12:15:42.095993  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:42.094949  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59490 (request call id 1259) took 1026 ms. Trace:
I20260709 12:15:42.061350 14861 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.110364  9066 rpcz_store.cc:276] 0709 12:15:41.068830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.069060 (+   230us) service_pool.cc:224] Handling call
0709 12:15:41.069550 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.070043 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.070070 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.070831 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.525837 (+455006us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:41.525877 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.525941 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.094701 (+568760us) raft_consensus.cc:1685] finished
0709 12:15:42.094728 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.094879 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1440,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":185,"thread_start_us":454505,"threads_started":1,"wal-append.queue_time_us":675952}
I20260709 12:15:42.088667 14859 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.126905  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.127833  8888 leader_election.cc:400] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:42.129520  8919 raft_consensus.cc:2410] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:15:42.133011 14977 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:15:42.133363  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.134063  8997 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:42.133711 14806 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.135593  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.136693  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.137481  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.137714  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.138082  8991 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:42.138236  8994 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:42.139583  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.138942  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.140251  8993 raft_consensus.cc:2368] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19.
W20260709 12:15:42.141134  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 112127us
W20260709 12:15:42.141974 14975 log.cc:927] Time spent T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:15:42.093370 14831 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:42.143479 14831 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:42.144490 14859 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.144423 14831 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.145780 14831 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.146181  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.151579 14984 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.151800 14923 raft_consensus.cc:3055] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:42.152285 14923 raft_consensus.cc:740] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:42.153108 14923 consensus_queue.cc:260] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.154333 14923 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:42.154385  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55013us
I20260709 12:15:42.154827 14816 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.091960 14858 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.157445 14858 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.159898  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.134941  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.139006  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.164350  9620 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:42.165895  9622 raft_consensus.cc:2410] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:15:42.091207 14985 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:42.161113  8916 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:42.108028  8925 rpcz_store.cc:276] 0709 12:15:40.366538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.366672 (+   134us) service_pool.cc:224] Handling call
0709 12:15:40.367043 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:40.367434 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:40.367459 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.112788 (+745329us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:41.113407 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.768158 (+654751us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:41.768214 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.768583 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.094144 (+325561us) raft_consensus.cc:1685] finished
0709 12:15:42.094165 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.094392 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7441,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6763,"spinlock_wait_cycles":3893632,"thread_start_us":654192,"threads_started":1,"wal-append.queue_time_us":710619}
I20260709 12:15:42.188459  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:42.190574  8922 raft_consensus.cc:3060] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:42.091856 14894 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.193657  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.202874  8992 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:42.202569  8997 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:42.093982 14871 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.210875 14894 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.213054 14858 raft_consensus.cc:2764] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:15:42.202538 14994 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:15:42.208917 14981 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.203477 14765 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.225685 14806 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.225574 14991 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.231552 14991 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.234166 14991 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.234776 14255 consensus_queue.cc:1059] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:42.220050 14617 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:15:42.236819 14617 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:42.238984 14861 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.242424 14935 consensus_queue.cc:1059] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:15:42.243643  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 161879us
I20260709 12:15:42.243413 14765 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.243831 14978 raft_consensus.cc:3055] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:42.244298 14978 raft_consensus.cc:740] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:42.244499  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.245182 14978 consensus_queue.cc:260] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.209635 14985 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:42.246727  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:42.212188 14996 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.216246 14746 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.235617 14255 consensus_queue.cc:1243] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:15:42.247165  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.245666 14765 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.253728  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.255017 14985 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.256961  9587 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.246527 14978 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:42.264501  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55961.9us
I20260709 12:15:42.246794  8922 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:42.221977 14981 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.264050 14996 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.285362 14996 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.286520 14871 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:42.287626  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.287966  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.290099  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.290675 14890 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:42.291334 14890 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.294241 14890 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.294849 14890 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:42.272440 14894 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.300578  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:42.303699  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 146077us
I20260709 12:15:42.274117 14984 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.309541  9618 raft_consensus.cc:2468] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:42.274621 14986 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.285605 14859 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.311473 14871 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.303094 14765 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.295174 14890 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:42.337953 14824 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.002s
W20260709 12:15:42.339661  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52156.2us
I20260709 12:15:42.340723  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.342448  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:42.343477  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.343582  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.343724 14995 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.344732  9071 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:15:42.344775 14995 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:42.346012  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55996.3us
I20260709 12:15:42.346900  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.347860 14806 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:42.348183  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.349112 14818 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.349371 14864 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:42.350147 14864 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:42.356130  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 54146.8us
I20260709 12:15:42.357235  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.358341 14825 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.360131  9587 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.370287 14864 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.370922  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.348023  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.372581 14976 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:42.376044 14532 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.380831  8996 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:15:42.385329 14981 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:42.385741 14722 consensus_meta.cc:287] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 12:15:42.386725  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57423.6us
I20260709 12:15:42.390386  9073 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:42.319931 14935 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:15:42.392542  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 231263us
I20260709 12:15:42.318832 14986 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:42.395332 14769 consensus_meta.cc:287] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.005s
I20260709 12:15:42.396867  8996 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:42.397862  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:42.420565  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60553.4us
I20260709 12:15:42.421483  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.385802 14996 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.422540 14875 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:42.422802  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.422998 14875 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:42.424160  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.424351 14978 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.402679  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.421030  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.408699 14995 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.415030  9622 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:42.416579  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.395380  9624 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:42.407976  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:42.426695  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 84338.2us
I20260709 12:15:42.396360 14937 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:42.427645  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.420926  8922 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.405547 14871 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:42.418917 14986 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.417354 14935 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:42.435672  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.434365  8963 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:42.421178 14765 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:42.439254  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.439764 15010 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.440994 14858 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:42.442219 14935 raft_consensus.cc:3060] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.433015 14995 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.429339 14825 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.444242  8996 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.444808  8889 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.447749  8993 raft_consensus.cc:1240] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:42.424409 14875 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.397807 14984 consensus_queue.cc:1059] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:15:42.453270  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 105304us
I20260709 12:15:42.471808 14901 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:42.472114  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.472466 14901 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:42.473600 14901 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.474555  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.433140 14890 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.430619 14978 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.476287 14890 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:42.478827 14818 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.479384 14871 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:42.479673  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:42.480370  9622 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.482400 14859 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:42.460157  8888 leader_election.cc:400] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19.
I20260709 12:15:42.485901  8888 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.487412  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.416837 14976 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.424192 14996 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.456796  8922 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:42.434654 14927 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.457880 15007 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:42.496984 15007 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:42.497498 15007 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:42.497401 14927 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.472477 15009 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.499450 15009 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.499858 15009 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.501416 14976 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.499869 15011 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:42.476372 14984 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:42.504155  8917 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 20. Current term is 21. Ops: []
I20260709 12:15:42.504240 14984 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:42.488477  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.490456  9040 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.469568  8996 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:42.493875 15002 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.469247 14746 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:15:42.506708 15002 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:42.510932 14997 consensus_queue.cc:1175] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "491a1127924f43d4a369f7d09c3a68db" responder_term: 13 status { last_received { term: 13 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 13 index: 7 } }
I20260709 12:15:42.511313  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:42.512123  9616 raft_consensus.cc:2368] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19.
I20260709 12:15:42.513037  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.510933  9618 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:42.514292  8996 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:15:42.514638  8996 pending_rounds.cc:85] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 12
I20260709 12:15:42.495205 15003 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.495867  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.519222  8996 pending_rounds.cc:107] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:15:42.487367 14769 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:42.519826  8996 raft_consensus.cc:2889] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:42.515048 14818 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:42.515148 14999 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.515646  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.516186  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.526882  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.526947  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.516909 15010 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:42.517369 14722 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.517956 14976 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:42.539623  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:42.540629 14976 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:42.541163 14976 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:42.542534 14995 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.523012  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.536204 14617 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.543728 14875 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.543473 14617 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.544893 14986 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.545800 14617 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.546396  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.546746  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.547503 15006 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.546772  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.548442  8995 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.546433 14818 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:42.549120 14986 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.538754 14864 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.549942 14818 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.554158  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.521327 14979 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:42.490667 14858 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:42.556171  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.556932  9000 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.556537  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.542086 14976 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.546968  8998 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.572129 14976 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.572224  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.573539  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.547467  8997 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:42.575385 14995 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:42.575937 14995 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.538817 14722 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.577982 14995 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.578951 15003 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:42.579506 14722 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.580258  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.582298  8916 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:42.579500 15003 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.585638 15003 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.589663  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.522606 14769 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.469439 14937 raft_consensus.cc:2804] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:42.604321  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.604604  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.537894 15010 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.611544  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.540704 14981 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.561532  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.562325  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.538298 14997 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:42.494439 14819 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.006s
I20260709 12:15:42.549917 14986 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.629230  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.625916  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.534701  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.565639 15002 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.566685 14927 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:42.556535 14858 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.580404  8995 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:42.558611  8993 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:42.594261  9622 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:42.595276  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.599795  8925 raft_consensus.cc:2410] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:15:42.599692  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.608608  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.628257 14996 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:42.605703  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:42.638428  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.634367  8922 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:42.590852  8998 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:42.618202  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.620119  8992 raft_consensus.cc:2376] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17. Re-sending same reply.
I20260709 12:15:42.628505  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.630244  9068 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:42.643692  8966 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.645046  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.623047 14816 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.647992  8916 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:42.627170 14937 raft_consensus.cc:697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:42.657447  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 127430us
I20260709 12:15:42.660373  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.661057  8992 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.651659 15002 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:42.665247 15017 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:42.664980 15009 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.666023 15017 consensus_queue.cc:1059] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:42.667186 15017 raft_consensus.cc:3055] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:15:42.667433  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 151882us
I20260709 12:15:42.667567 15017 raft_consensus.cc:740] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:42.646073 14996 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.668701 15017 consensus_queue.cc:260] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.672679  8923 raft_consensus.cc:2393] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:42.669806 14996 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.670425 14816 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:42.673435 15017 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.677256 15009 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.672231  8966 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.657660  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.633635 14722 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:42.683707  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.683833 14722 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.684408  8919 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:42.688952  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:42.695798 14769 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.695917  8992 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:42.696831  8999 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:42.700194  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.632165 14806 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:15:42.712924  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.629650 14997 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.635885 14986 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.685990 15003 raft_consensus.cc:2764] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:15:42.735071  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.735787  9590 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.711660  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:42.739183  8920 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:15:42.702970 15009 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.746953  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.748808  9000 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:42.745699  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.753325  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.753961  9000 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:42.757498  8992 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:42.738206 15010 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.758718  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.741421 14532 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:42.757895 14722 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.766295 14255 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:42.766108 14532 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.767413 14997 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.752378 15009 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.768031 14984 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.769245 14984 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.770615 15009 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.747797 14859 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:42.768291 14532 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:42.752038 14769 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:42.775588  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.785282 14769 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:42.786039  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:42.786252 14769 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.771659 14937 consensus_queue.cc:237] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.781231  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.790390  8888 leader_election.cc:400] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19.
I20260709 12:15:42.790750  8888 leader_election.cc:403] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:15:42.792107  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:42.792593 14255 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:42.793186 14255 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:42.794098 14255 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.794593 15003 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:42.795259 15003 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:42.781064 15007 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.796116  8889 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.796221 15003 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.797796 15007 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:42.741874 14617 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:15:42.759591 14816 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.784570 14871 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:42.802911  8995 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:42.803079  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.794494 14999 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19.
I20260709 12:15:42.756013 14935 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.806421 14935 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:42.807610 14927 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.796226 14997 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:15:42.808132  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.808821 14997 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:42.811333  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.812455  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.812989  8925 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:42.814005  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.814188  8923 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:42.815943  9000 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.821146  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.822507  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:42.823185  9620 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:42.821986  9616 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:42.798966 15007 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.807420 14373 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:42.781096 14986 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:42.815412 14997 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:42.844357  8888 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:42.848428  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.848870  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.850919  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.854597  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:42.861313  8995 raft_consensus.cc:2468] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:42.865149  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.865406  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:42.871204  8923 raft_consensus.cc:2368] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:42.808975 14927 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:15:42.870537  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 67074.7us
I20260709 12:15:42.871671  8992 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:42.834534 14999 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:42.872108  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 74805.5us
I20260709 12:15:42.841678 15007 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.876076  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.880939  9000 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:42.884316  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:42.885011  9072 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.899515  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:42.834190 14871 consensus_queue.cc:1059] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:15:42.902846  8996 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:42.870823 14864 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.910473  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.913739  8966 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:42.910239  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.915436  9068 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 19: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:42.872164 14722 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:42.910239  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.919616  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:42.916018  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:42.884712 15007 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.922156  9067 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:42.900543 14532 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.887663 15026 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:15:42.928562  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:42.932413  9590 leader_election.cc:400] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:42.933935  9590 leader_election.cc:403] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:42.920555 14722 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.888309 14901 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:15:42.945793  8996 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:42.923903 14532 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.944440 14722 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:42.903780 14999 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:42.947351 15017 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:15:42.976967  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.950287 15009 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:43.002316 15009 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.002841 15009 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:43.003965 14997 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:42.960913 14979 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.960211 14978 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:42.991247  8822 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 210) took 42828 ms (client timeout 15000 ms). Trace:
W20260709 12:15:43.008392  8822 rpcz_store.cc:269] 0709 12:15:00.115433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.121800 (+  6367us) service_pool.cc:224] Handling call
0709 12:15:42.931516 (+42809716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:39.994451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:40.206210 (+211759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:40.224577 (+ 18367us) write_op.cc:435] Acquired schema lock
0709 12:15:40.232817 (+  8240us) tablet.cc:662] Decoding operations
0709 12:15:40.556331 (+323514us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:40.560374 (+  4043us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:40.570719 (+ 10345us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:15:40.638824 (+ 68105us) tablet.cc:701] Row locks acquired
0709 12:15:40.639688 (+   864us) write_op.cc:260] PREPARE: finished
0709 12:15:40.645853 (+  6165us) write_op.cc:270] Start()
0709 12:15:40.656175 (+ 10322us) write_op.cc:276] Timestamp: P: 1783599340642353 usec, L: 0
0709 12:15:40.657119 (+   944us) op_driver.cc:348] REPLICATION: starting
0709 12:15:40.668331 (+ 11212us) log.cc:844] Serialized 2039 byte log entry
0709 12:15:41.090394 (+422063us) op_driver.cc:464] REPLICATION: finished
0709 12:15:41.735446 (+645052us) write_op.cc:301] APPLY: starting
0709 12:15:41.738311 (+  2865us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:41.862355 (+124044us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:41.862480 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:41.988228 (+125748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:41.988593 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:15:41.988678 (+    85us) write_op.cc:312] APPLY: finished
0709 12:15:41.989177 (+   499us) log.cc:844] Serialized 57 byte log entry
0709 12:15:42.041816 (+ 52639us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.068400 (+ 26584us) write_op.cc:454] Released schema lock
0709 12:15:42.079047 (+ 10647us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:42.090824 (+ 11777us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.090855 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2320577,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":594600,"apply.run_cpu_time_us":22147,"apply.run_wall_time_us":380731,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":610553,"prepare.run_cpu_time_us":9420,"prepare.run_wall_time_us":814891,"raft.queue_time_us":211309,"raft.run_cpu_time_us":96120,"raft.run_wall_time_us":383293,"replication_time_us":433015,"thread_start_us":760137,"threads_started":5,"wal-append.queue_time_us":64780,"wal-append.run_cpu_time_us":9531,"wal-append.run_wall_time_us":1236576}]]}
W20260709 12:15:42.992563 15023 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:15:43.043438  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 129825us
W20260709 12:15:43.046636  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 176722us
W20260709 12:15:43.047456  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 171451us
I20260709 12:15:43.042160 14935 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.053126  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.044512  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:43.055799  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 127300us
I20260709 12:15:43.041013 14885 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:43.059453 14806 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:43.051855 14995 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:43.069370  8964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.673s (SENT) [suppressed 12 similar messages]
W20260709 12:15:43.061594 15024 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
W20260709 12:15:43.064442 15021 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:43.068033 14373 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:43.068739  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.058990  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:43.074294  9587 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:43.078999  8925 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:43.086987  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:43.047043 15006 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:15:43.088325  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:43.048238 15009 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.073964 14858 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:43.088934  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:43.053224 14816 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:15:43.099080  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:43.106649  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:43.107998  8925 raft_consensus.cc:2393] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:43.108929  8888 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.086256 14765 raft_consensus.cc:2804] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:43.110044  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:43.070124 14935 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.117126  9616 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:15:43.119717  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:43.122294  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.125103  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.122426  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:43.125705  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.075963 14885 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.128523  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.128636  9067 raft_consensus.cc:2410] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:15:43.129489  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 70999.9us
I20260709 12:15:43.103518 14858 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:43.133347  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.107764 14818 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:15:43.134174  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.128772  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.110875 14985 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:43.110582 14255 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:43.113842 14861 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:43.152496  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.123535 14898 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:43.149461  9069 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:15:43.153853  9618 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:15:43.129490 14765 raft_consensus.cc:697] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:43.111080 14819 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:15:43.140691 14858 raft_consensus.cc:3060] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:43.172008  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:43.175068  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.174018  9616 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:43.153164 14255 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:43.179268  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.165432 14985 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.187578  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.173782 14532 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.186839 14255 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:43.186488 14999 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.182943 14861 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:43.182253 15039 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:43.211637  9065 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 20. Current term is 21. Ops: []
I20260709 12:15:43.218513  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.220480  9072 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:43.207754 15035 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:43.223376  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.239220  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.220263 14999 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:43.246978 14765 consensus_queue.cc:237] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.252274 15041 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.252866 15041 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.253978 15017 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:43.254912  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.255967  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.256814  9068 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:43.256927 14978 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:43.257234 14861 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.257535 14978 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.260551 14935 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.248669 15039 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:43.264103 15039 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.264648  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.268846  9622 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:43.272735  9072 raft_consensus.cc:2393] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:43.273770  9618 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:15:43.272683  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.267549 14999 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.275441  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:43.255088 15041 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.287346  9616 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:43.290479  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:43.296604  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.299391  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:43.306666  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 237307us
I20260709 12:15:43.309657  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.310511 14978 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.314080 15028 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:43.314538 15028 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.305845 15042 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:43.315436 15028 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.316609 15028 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:43.333982  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:43.322279 14885 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.275988 15009 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.303323 14927 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:43.328114  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:43.328610 14722 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:43.328166 14984 consensus_meta.cc:287] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
W20260709 12:15:43.330265 15037 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:15:43.332017  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.292304 14999 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:43.344426  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.345053  9000 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:43.344540  8996 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:43.346876  9623 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:43.304513 14816 raft_consensus.cc:2764] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:15:43.304792 14986 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:43.349550  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:43.352404  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.358369  9037 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.358711  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.363621  8999 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:43.359813  8916 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:43.360736  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.364779  8996 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:43.368530  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.369392 14885 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:43.370513  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.371291 14885 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:43.371663 14885 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:43.372022 14885 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.374773 14927 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:43.375581 14927 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.376864 14927 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.361568  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.381093  9000 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:43.382318  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.384006  8964 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.384546  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.385011 15006 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:43.386480  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.387401 15006 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:43.380674 14885 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.393865  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.275470 14985 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.340399 14987 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:15:43.410630 14987 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:43.411032 14987 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.411943 14987 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.413259 14987 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.420876 14858 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.423493 14858 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.424499 14255 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.426345 14255 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.426694  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:43.402319  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.435551  8997 raft_consensus.cc:2393] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:43.404476 14806 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.404819  8998 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:43.405484 14986 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.407979 14722 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.361225 15044 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:43.409605  9069 raft_consensus.cc:1240] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:43.427320 15035 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.355271 15007 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:43.429191  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.401180  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.436612  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.458678  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.460019  9000 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:43.461360  8996 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
W20260709 12:15:43.440353  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44191.2us
I20260709 12:15:43.446226  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.457512  8925 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:43.465318  8991 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:43.467834  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.470268 14859 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:43.470799 14859 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.459667 15035 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.474494 14859 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.475051  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:43.476089 15035 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.443390 14984 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:43.477885 14984 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.478293 14984 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.480717  8994 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:15:43.465253 15044 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.483973 15044 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.489639 15007 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.467098  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.455120 14986 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:43.493538 15036 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.245s	user 0.003s	sys 0.000s
I20260709 12:15:43.494194 14746 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.495679  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.496116  8997 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:15:43.496748  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.497351 14978 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.497932 14978 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.454962 14806 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.500427 14978 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.501185 14806 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:43.506474 14859 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.507887  9623 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:15:43.508625 14746 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:43.509176  9620 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:15:43.510509 15050 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:43.511277  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.511883  9068 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
W20260709 12:15:43.514447 15034 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
I20260709 12:15:43.447418 15042 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:15:43.515605 14978 consensus_queue.cc:1059] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:43.516279 15042 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:43.516615 15042 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:43.517336  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:43.519999  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 381805us
I20260709 12:15:43.521273  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.527275  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.535585  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:43.536463  8999 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.537995  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.542023  9619 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:43.544200  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.532719  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:43.543171  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:43.546304 14981 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:43.549346 14997 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.524221 14976 raft_consensus.cc:3055] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:43.553858 14976 raft_consensus.cc:740] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:43.557157 14859 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.557567 14825 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:43.554867 14976 consensus_queue.cc:260] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.559383  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.560372 15017 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:43.560786 15017 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.561106 15017 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:43.543382 14978 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.562598 14978 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.433542 14979 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:43.569455  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:43.573724  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.570060  9616 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 21.
I20260709 12:15:43.576399  8995 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:15:43.577715  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114945us
I20260709 12:15:43.588577  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:43.599001  9619 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:43.592895 14858 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:43.604630  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:43.520481 14986 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.620728  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:43.621266  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.625159  9624 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:43.517355 15042 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.634325  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.635077  8923 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:43.636385  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:43.638128  8925 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.572284 14871 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:43.572081 14816 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:43.612154 14976 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.643745  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.646385  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:43.589622 14979 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.575120 14746 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:43.648226  8916 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:43.651444  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46948.3us
I20260709 12:15:43.649183  8888 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:43.624042 14824 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:15:43.661599  8920 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:43.636333 15045 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.607267 14819 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:15:43.659054  8818 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 15, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 15 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:43.677104  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:43.678668  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.676270  9624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:43.651770 14722 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.630373 15007 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:15:43.598872 15003 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:15:43.763278  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:43.655985 14875 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:43.760926  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73070us
I20260709 12:15:43.610502 14981 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:15:43.660429 14996 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:43.763957  8995 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:43.660766  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:43.683871  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 110525us
I20260709 12:15:43.768808  8992 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:43.666368  8916 raft_consensus.cc:1275] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:15:43.771370  9615 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:43.678336 15027 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.793931  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.804420  9069 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:43.685245 14885 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.761772 14890 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.813519  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.811561  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.657601 14746 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:43.793076  8818 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 4 to 7, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.675668 15042 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:43.823223  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:43.823787  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.661815 14769 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.662572 14255 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:43.773913 14831 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.827752  9067 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 19: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:43.679544 14984 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.661705 14871 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:43.656493 14816 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:43.846118  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 64114.3us
I20260709 12:15:43.765467 14901 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:15:43.756664 15045 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.764475 14722 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.823174 14746 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:43.849714  8818 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 15, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 15 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:43.859040 15063 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:43.860955  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 88935.3us
I20260709 12:15:43.857509  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:43.888064  9065 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.839121  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.802327 14617 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:15:43.862027  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 92444.3us
I20260709 12:15:43.892036  9072 raft_consensus.cc:3060] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.866653  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:43.874356  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:43.878825  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 108003us
I20260709 12:15:43.886091  8919 raft_consensus.cc:2468] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:43.803292 14875 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:43.890224  9587 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:43.920980  8818 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 11, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:43.848446 14255 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:43.888965  9071 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:43.925050  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:43.925709  9066 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
W20260709 12:15:43.919484  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52924.5us
W20260709 12:15:43.931217  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 133747us
I20260709 12:15:43.828838 14890 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:43.897328  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 236634us
I20260709 12:15:43.821069 15027 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.149610  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:44.151166 15063 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:43.934621  9070 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:15:44.151978 14890 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.151994 15027 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.936343 15060 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:44.152935  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.153292  9066 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:15:44.153698  9066 pending_rounds.cc:85] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 13
I20260709 12:15:43.939951 15038 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 12:15:43.940503 15043 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:15:43.941469 15055 log.cc:927] Time spent T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:15:43.942226 15051 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:15:43.943044 15054 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:15:43.944943 15065 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:43.948221 14859 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.156857 14859 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.156762 15065 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.157446 14859 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:43.838330 14831 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.161397 14831 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.162473  8920 raft_consensus.cc:1275] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:44.159061 15065 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.166018 15065 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:44.167706  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.170296  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:43.949347 14987 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.536s	user 0.004s	sys 0.007s
I20260709 12:15:43.951103 14816 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:43.951431  8818 catalog_manager.cc:5697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.172416  8818 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 12 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.173859  8818 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:44.175583  9068 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:15:44.175951  9068 pending_rounds.cc:85] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 12
I20260709 12:15:44.176158  9068 pending_rounds.cc:107] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:15:44.176373  9068 raft_consensus.cc:2889] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:43.952709 15045 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.935380 15066 consensus_queue.cc:1048] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:15:43.959463 15046 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:43.961069 14984 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:43.967911 14255 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:43.969473 15053 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:15:43.973440  8992 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:44.182840 15046 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:43.973567  8966 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:44.183710  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 210674us
I20260709 12:15:44.183777 15046 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.185186 15046 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:43.978623  8999 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:43.979925  8925 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:43.933135 14617 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:44.001605 14999 consensus_meta.cc:287] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.003s
I20260709 12:15:43.835706 14769 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.023481  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.191532 15066 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:44.192342 15066 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.193269 14769 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.193743  9624 raft_consensus.cc:606] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:44.194101  9624 raft_consensus.cc:614] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:44.191610 14999 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.195662  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.197417 14999 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.198467 15064 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.198786 14769 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.199330 14769 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.199158 15064 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.202106 15064 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:44.026731  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 96285.1us
I20260709 12:15:43.891556 14978 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.203629 14978 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:43.853267 14993 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.266s
I20260709 12:15:44.207034  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.207887  8925 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:44.215956  9590 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.216912 14976 raft_consensus.cc:2804] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:44.217412 14976 raft_consensus.cc:697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:44.218220 14976 consensus_queue.cc:237] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.221588  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:44.222172  8992 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:44.036269  9065 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:44.049923  9072 raft_consensus.cc:2468] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:44.029191 15017 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.060047  9623 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:15:44.066144 14997 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
W20260709 12:15:44.075968  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.103415 14722 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.104240 14875 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.104712 14871 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:44.107056 15061 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:15:44.123493  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:44.138175 15028 consensus_meta.cc:287] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.000s
I20260709 12:15:44.144409  9069 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 21.
I20260709 12:15:44.045217 14979 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.153944  9066 pending_rounds.cc:107] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:15:44.256808  9066 raft_consensus.cc:2889] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:44.175120  8818 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 18, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.187397 15063 raft_consensus.cc:2804] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:44.222867  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.260848  8996 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:44.261350  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.261782  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.261958  9066 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:44.262450  8996 raft_consensus.cc:2393] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:44.223544  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.263146  9620 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:44.263100  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:44.263326  8995 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:44.227756  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 79514.7us
W20260709 12:15:44.228089  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 75217.4us
I20260709 12:15:44.239274  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.265547  8999 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
W20260709 12:15:44.242008  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.245671  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:44.267663  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 62349.5us
I20260709 12:15:44.225950  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.268822  8997 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:44.249014  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:44.270032  9000 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.250289  8922 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:15:44.252759  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 362637us
I20260709 12:15:44.253742  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.278029  8991 raft_consensus.cc:2410] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:15:44.295454 14978 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.296429 14978 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.302186  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.306631  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:44.246610 14993 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.202216 14769 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.307574  8818 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 15, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 15 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:44.321873  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 115097us
I20260709 12:15:44.251546 14818 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.313891  9000 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:44.248433 15043 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:44.253764 14875 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.253410  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.325522  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.150009 14746 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.329175  9072 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:44.258843 14987 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:44.332331  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:44.332531  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:44.336764  8925 raft_consensus.cc:1240] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:44.340885  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.341650  8916 raft_consensus.cc:2368] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:44.336560  8922 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:44.345050  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:44.345984  9618 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.312858 15065 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.353073  8992 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:44.314523 15063 raft_consensus.cc:697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:44.347955  8818 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.328298 14993 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.372641  8818 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 13, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.374476  8818 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 15, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 15 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:44.376150  8818 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 13, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 13 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.377759  8818 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 15, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 15 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.379294  8818 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:44.380815  8818 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 14, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.382936  8818 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.384202  8818 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 14, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.386373  8818 catalog_manager.cc:5697] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:44.387931  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.387629  8818 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 8 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 12 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.389339  8818 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 11, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 11 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:44.390864  8818 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 15, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 15 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.391633 15070 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.392402 15070 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.392469  8818 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 16, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.323760 15059 consensus_queue.cc:1048] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:15:44.328078 14859 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.394658  8818 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 13, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 13 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:44.404757  8924 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:15:44.406339  9037 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:44.408145  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 62922.9us
W20260709 12:15:44.408882  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76637us
I20260709 12:15:44.424687  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.491351  8818 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 13, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 13 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.405591  9040 leader_election.cc:400] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:44.495561  9040 leader_election.cc:403] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:44.320637 14978 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.503983  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:44.505061  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 98798.6us
I20260709 12:15:44.510564  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:44.516991  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 111550us
I20260709 12:15:44.517545  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.519902  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.356957 14819 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.356602 15065 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.527174  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.528031  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.405839 14806 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:44.530344  9615 raft_consensus.cc:2368] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15.
I20260709 12:15:44.529711  9066 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.412894 14825 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:44.536290  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.408792 15027 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:44.346618 14875 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.418596 15017 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.557396  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.363777  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.395136 15070 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.540541  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.544864  9071 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:44.539749  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.546669  8818 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.593792  8818 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.509784 15031 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.513234 14985 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:44.540365 15065 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.354995 14871 consensus_queue.cc:1059] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 12:15:44.420163 15066 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.417179 15063 consensus_queue.cc:237] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.561916  9619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:44.564819 14979 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.526664 15057 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16.
I20260709 12:15:44.565745 14937 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.566220 15058 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:44.405591 14927 consensus_queue.cc:1059] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:15:44.545425 14999 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.539225 15038 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:44.551374 14255 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:15:44.550532 14898 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.545295 14986 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:15:44.573625 15044 raft_consensus.cc:3055] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:44.367882 14818 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.575452 14987 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:44.576859 14875 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.577965 14373 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.558243  9068 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:44.586531  9000 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:44.587604  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.604140  9618 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:44.405226 14816 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.606844  8917 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:44.610770 15031 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.512961 14831 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:15:44.553098 14825 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.695428  9072 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:44.617740  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.620045  9619 raft_consensus.cc:606] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:44.696559  9619 raft_consensus.cc:614] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:44.650249  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:44.664059  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 145866us
I20260709 12:15:44.664363  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.670534  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.621227 15027 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.701215 15027 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.617769 15009 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.703454 15009 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.703958 15009 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.674506  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.404006 15043 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.656359 14617 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:44.707656  8924 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:44.686151  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.708851  8920 raft_consensus.cc:1240] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:44.709093 15027 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.685173  9615 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
W20260709 12:15:44.608194  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 67736.7us
I20260709 12:15:44.710554  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.711831  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.712736  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:44.713663  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:44.662853 14999 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.714722 14999 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.539510 15069 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:44.674929 15044 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:44.687186  9067 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:15:44.674667 15038 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:44.716961  8888 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.687878 14875 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:44.728081  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 200113us
I20260709 12:15:44.660234 14937 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.677309 14898 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.694691 14987 consensus_queue.cc:1243] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:44.717024 15039 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:15:44.739753  8888 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:44.740727  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:44.723719 14890 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:44.752628 14890 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.753087 14890 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.723870 14617 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:44.755508 14617 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.755602 15017 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.755940 14617 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.756187 15017 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.715853 14825 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.756668 15017 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.724341 15027 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.759563 15027 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:44.759899 14859 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.760973  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.761632  9067 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:44.762411 14981 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:44.762796 14981 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.763125 14981 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.765543 14937 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.769274  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.770030  9619 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:44.771083  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.771652  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.772344  9624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf"
dest_uuid: "4993160378a142a1bc21648120cbaebc"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:42422
I20260709 12:15:44.773025  9624 raft_consensus.cc:606] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:44.773294  9067 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:44.774883  9588 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:44.775432 14818 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:44.775866 14769 raft_consensus.cc:2804] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:44.776404 14769 raft_consensus.cc:697] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:44.756148 14999 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.749878 14898 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.737820 15071 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:44.780026 15071 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.780174 15009 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:44.781064  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44577.7us
I20260709 12:15:44.782127 15071 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.782459 15009 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:44.782788 14999 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.783277 15086 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:44.783479 15058 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:44.784044 14806 raft_consensus.cc:3055] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:44.784552 14806 raft_consensus.cc:740] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:44.782765  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.785586 14806 consensus_queue.cc:260] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.787182 15088 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:44.787778 15038 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.742460 14875 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.790261 14985 raft_consensus.cc:3055] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:44.790532 14875 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.790697 14985 raft_consensus.cc:740] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:44.731535 15069 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.791512 15069 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.791779 14985 consensus_queue.cc:260] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.792403 15045 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:44.793085 14985 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.747494 15089 consensus_queue.cc:1059] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:44.787362  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44509.8us
I20260709 12:15:44.793933 15069 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.794831 14806 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:44.798242 14993 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.695057 14816 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.799423 14986 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:44.800021 14986 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.800665 14746 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.777349 14769 consensus_queue.cc:237] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.802093  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:44.802726  8920 raft_consensus.cc:606] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:44.803048  8920 raft_consensus.cc:614] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:44.804553  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:44.805263  8920 raft_consensus.cc:2393] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:44.801025 14816 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:44.805553 15083 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.182s	user 0.003s	sys 0.000s
I20260709 12:15:44.806905 15039 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:44.807575 15039 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:44.809077 14979 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:44.808638 15039 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:44.809710  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:44.806420  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.811625 14898 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:44.811914  8921 raft_consensus.cc:606] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:44.812141 14898 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.806401  9067 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:44.814188 14898 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.742400 15068 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:15:44.816988  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:44.809710 14979 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.821635  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:44.823730  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:44.802165 14986 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:44.826418  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.827225  8999 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:44.828060  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:44.831784  8996 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:15:44.838198  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:44.835669  9066 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:44.842228  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.842876  9073 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.843830  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.846572  8992 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:44.849349  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:44.855304  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:44.759950 15027 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:44.859694  8994 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:15:44.820029 15045 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:44.864501  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.868609  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.869306  9619 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:44.865593  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.871076  9623 raft_consensus.cc:2410] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:15:44.876029  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:44.844494 14819 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.779074 15065 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.879521  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:44.884677  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.885224  9037 leader_election.cc:400] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15.
I20260709 12:15:44.885337  9615 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:44.885833  9037 leader_election.cc:403] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:44.852174 15009 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.826478 14898 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:15:44.779103 15017 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:44.826622 15071 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 12:15:44.907845  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 69730.5us
I20260709 12:15:44.905471  9616 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:44.932174  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:44.845397 14976 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:15:44.944650  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.951622  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:44.951941  9619 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:44.868316 15057 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.954165  9073 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:44.967093  9620 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:15:44.840574 14993 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:15:44.883390 15060 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.874354 15058 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:44.883844 14819 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.890609 14927 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15.
I20260709 12:15:44.876134 15099 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.145s
I20260709 12:15:45.021075 15065 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.023185 15017 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.023769 15045 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.027813 14825 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.030300 14825 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:45.032070 15096 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:45.034291  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.037488  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.038071 14890 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.040319 15106 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:45.020891 15091 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:44.928172 15086 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:15:44.946746 15009 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.053694 14373 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:45.035840 15046 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:45.156775  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.157567  9073 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:45.044361 15069 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.012703 15060 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.176834  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
W20260709 12:15:45.188316 15075 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
I20260709 12:15:45.188665 15109 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.189146 14890 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.189344 15109 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:45.149983  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 216700us
W20260709 12:15:45.191497 15097 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:15:45.193607 15079 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:15:45.194737 15009 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.166991 14986 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:45.195761 14986 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:45.198025 15084 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.571s	user 0.000s	sys 0.002s
I20260709 12:15:45.198236 14986 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:45.167264 15069 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:45.190459 15095 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:15:45.006354 15057 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.157702 15046 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.278304  8923 raft_consensus.cc:1240] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:45.274257 15073 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.274911 15108 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:45.054735 14981 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.019062 15058 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.189126 15107 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:45.093844 15106 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.280457 15046 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:45.276409 14859 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:45.326483  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 394383us
I20260709 12:15:45.351449  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.352277  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:45.353209  8916 raft_consensus.cc:2393] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:45.319420 14617 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
I20260709 12:15:45.358053  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:45.360424  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:45.360000  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 497128us
I20260709 12:15:45.362807  9073 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
W20260709 12:15:45.321146 15039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.011s
W20260709 12:15:45.366659  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 479576us
I20260709 12:15:45.377157  8923 raft_consensus.cc:1275] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:15:45.366900  8966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.010s
I20260709 12:15:45.378857  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.380440  8923 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
W20260709 12:15:45.381381  8966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.010s
W20260709 12:15:45.382359  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 558621us
I20260709 12:15:45.383965  8966 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:45.387277  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.388059  8993 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:45.325915 14979 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:45.438724  9620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1252) took 1055 ms. Trace:
I20260709 12:15:45.386381  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:45.444651  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58356.5us
I20260709 12:15:45.441938  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:45.443128  9620 rpcz_store.cc:276] 0709 12:15:44.322024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.322164 (+   140us) service_pool.cc:224] Handling call
0709 12:15:44.345317 (+ 23153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.970781 (+625464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.377295 (+406514us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54004cf754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:45.377532 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429057408}
I20260709 12:15:45.449535  9616 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:45.449640  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:45.451577  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:45.452416  9616 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
W20260709 12:15:45.387804 15039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.000s	sys 0.012s
I20260709 12:15:45.451702  9037 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:45.469112  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.470096  9066 raft_consensus.cc:2368] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:45.471793  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.472506  9066 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:45.376796 15059 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:15:45.504560  8963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.023s
W20260709 12:15:45.506079  8963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.023s
I20260709 12:15:45.320267 15073 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:45.507685  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 552014us
I20260709 12:15:45.509279  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.524286  9073 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:45.457047 14825 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:45.365751 14859 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.375983 14617 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.483959 14769 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.322036 15044 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.504596 15109 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:45.592811  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 141566us
I20260709 12:15:45.511494 15059 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:45.626230  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:45.526549 15127 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.641637  9066 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:45.642830  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.633245  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:45.482738  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:45.637035  8888 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:45.638368  8920 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:45.596844 14818 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:45.593971 15017 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:45.646498  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 262758us
I20260709 12:15:45.596462 14825 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:45.653682  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:45.654402  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 171787us
I20260709 12:15:45.626121 15086 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:45.655658  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:45.424984 15107 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.659335  8992 raft_consensus.cc:3060] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:45.660877  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 151063us
I20260709 12:15:45.638684 15044 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:45.649108 15094 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:15:45.661118  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:45.664777  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.665277  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.665491  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:45.666003  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:45.661720  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:45.663019  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:45.665858  8916 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:45.597144 15100 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:15:45.671675  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:45.672255 15103 log.cc:927] Time spent T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 12:15:45.672667 14818 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:45.655972 15009 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:45.623895 14769 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.646492 15119 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:45.708380  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:45.656975 14976 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:45.716817  8992 raft_consensus.cc:2468] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:45.706291  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:45.721653  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:45.744997 15122 consensus_queue.cc:1059] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:15:45.751880 15122 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:45.752358 15122 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.752764 15122 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:45.707445 14818 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.650247 15127 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.750733 15137 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:45.762379 14981 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:45.768314 15105 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
I20260709 12:15:45.770069  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:45.771646 14373 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:45.773334 14373 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:45.766104 14825 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.724058 15119 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:45.682044 15071 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:45.757858 15124 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:15:45.636106 14986 consensus_queue.cc:1175] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd11e77b4be14e658672599b30d51e76" responder_term: 13 status { last_received { term: 11 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13. Ops: [12.9-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:45.659930 15017 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:45.761869  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55692.2us
I20260709 12:15:45.718333 15069 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:45.765424  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:45.664794 15086 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:45.793254  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.763118 14818 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:45.871716 15106 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.760492 15109 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:45.748505 14976 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.784494 15119 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:45.897146  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:45.898137  8992 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:45.898279  9074 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:45.876194 15060 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:45.883633 15124 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:45.909282 15058 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:45.909274  8996 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:15:45.892074 14898 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:45.912981  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:45.918184  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:45.872128 15071 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:45.909875 14806 consensus_meta.cc:287] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.114s	user 0.008s	sys 0.004s
I20260709 12:15:45.902791 15139 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:45.911375 15110 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:15:45.758819 15059 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:45.910512 15124 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:45.874713 15137 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.955265 15123 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:45.955667 15134 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:15:45.910698 15136 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:45.912024 14617 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:45.899466 15109 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:45.996004  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:45.963867 15141 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:45.998165  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.019263  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.017765  8997 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:46.020367 15146 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:46.021016 15146 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.022517  8996 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:15:46.023411 15146 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:45.995798 15094 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:15:46.029358  8997 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
W20260709 12:15:45.998636 15113 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
W20260709 12:15:45.998322 15118 log.cc:927] Time spent T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:15:45.954214 15073 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.033157  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.035818  8997 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:45.951208 14898 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:46.040760  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 378832us
I20260709 12:15:46.017277 15136 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.963874 15147 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.044821  8963 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:46.030069 14859 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.049297  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 1058) took 1879 ms. Trace:
I20260709 12:15:46.053120  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.052098  8919 rpcz_store.cc:276] 0709 12:15:44.169985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.170108 (+   123us) service_pool.cc:224] Handling call
0709 12:15:44.170386 (+   278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:44.259341 (+ 88955us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:44.624537 (+365196us) log.cc:844] Serialized 14 byte log entry
0709 12:15:45.096413 (+471876us) log.cc:844] Serialized 14 byte log entry
0709 12:15:45.096702 (+   289us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:45.146822 (+ 50120us) log.cc:844] Serialized 52 byte log entry
0709 12:15:45.146989 (+   167us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:45.147278 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 12:15:45.154825 (+  7547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.154911 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.049118 (+894207us) raft_consensus.cc:1685] finished
0709 12:15:46.049134 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.049250 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124811,"prepare.queue_time_us":508345,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":131,"raft.queue_time_us":178050,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":59890,"spinlock_wait_cycles":70000768,"thread_start_us":759402,"threads_started":4,"wal-append.queue_time_us":182725}
I20260709 12:15:46.053732  8991 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
W20260709 12:15:46.040253 15117 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:15:46.040221 15009 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.057226  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:46.058332  8995 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:46.062259  8964 leader_election.cc:400] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:46.064704  8964 leader_election.cc:403] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:15:46.065465 15129 log.cc:927] Time spent T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:15:45.957247 15139 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.046497 15136 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:46.070914  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.075525  8925 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:46.078075  8997 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:46.079859  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.061983 15106 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:46.087019  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.093389  8995 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:46.095328 15127 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.080854 14859 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.097522  9624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42094 (request call id 1020) took 1274 ms. Trace:
I20260709 12:15:46.100762  9624 rpcz_store.cc:276] 0709 12:15:44.823130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.823354 (+   224us) service_pool.cc:224] Handling call
0709 12:15:44.823728 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.833892 (+ 10164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.833944 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.868202 (+ 34258us) log.cc:844] Serialized 26 byte log entry
0709 12:15:45.009433 (+141231us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:45.009513 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.009647 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.097284 (+1087637us) raft_consensus.cc:1685] finished
0709 12:15:46.097307 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.097454 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9744,"raft.queue_time_us":10358,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12406,"thread_start_us":45383,"threads_started":1,"wal-append.queue_time_us":550986}
I20260709 12:15:46.035688 15123 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.068388 15009 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.096323 14898 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.114918 15157 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:46.087901 15106 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.096750 14976 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.067782 15147 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.121886 15106 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.105515 14859 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.124754 15147 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.124991 14859 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.125695 15147 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:46.118119  9070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3694) took 1301 ms. Trace:
I20260709 12:15:46.126323  9070 rpcz_store.cc:276] 0709 12:15:44.816215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.821249 (+  5034us) service_pool.cc:224] Handling call
0709 12:15:44.821569 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.837942 (+ 16373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.837974 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.853373 (+ 15399us) log.cc:844] Serialized 26 byte log entry
0709 12:15:45.368998 (+515625us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:45.369036 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.369111 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.117798 (+748687us) raft_consensus.cc:1685] finished
0709 12:15:46.117830 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.118016 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15960,"raft.queue_time_us":16492,"spinlock_wait_cycles":21135744,"thread_start_us":403462,"threads_started":1,"wal-append.queue_time_us":705916}
I20260709 12:15:46.097040 15086 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.096313 15071 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.130188 15147 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:46.132256 15147 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.132977 15162 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:46.135131 15162 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.115554 15157 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.089115 15155 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
W20260709 12:15:46.119779  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 62672.3us
I20260709 12:15:46.036661 15141 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:46.150920 15143 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:15:46.161751 15086 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:46.163957 15086 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.166357 15086 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:46.168403 15144 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:15:46.169862 15137 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.171257 15137 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:46.171893 15137 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.174471 15137 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.176676 15157 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.152467 14818 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.179816 14818 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.152473 15150 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:46.188658  9073 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:46.180907 15150 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.190505  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 2519) took 1335 ms. Trace:
I20260709 12:15:46.190659  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 2013) took 1360 ms. Trace:
I20260709 12:15:46.192062  9616 raft_consensus.cc:1240] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:15:46.190910  8920 rpcz_store.cc:276] 0709 12:15:44.854811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.858267 (+  3456us) service_pool.cc:224] Handling call
0709 12:15:46.190317 (+1332050us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54000da554. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:46.190447 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744147840}
I20260709 12:15:46.195216 15071 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.196062  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:46.190999  9000 rpcz_store.cc:276] 0709 12:15:44.821899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.822969 (+  1070us) service_pool.cc:224] Handling call
0709 12:15:44.842876 (+ 19907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:45.325535 (+482659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:45.325570 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:45.433643 (+108073us) log.cc:844] Serialized 26 byte log entry
0709 12:15:45.758601 (+324958us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:45.758639 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.758726 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.181927 (+423201us) raft_consensus.cc:1685] finished
0709 12:15:46.181952 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.182154 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84830,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20368,"thread_start_us":649445,"threads_started":2,"wal-append.queue_time_us":417120}
I20260709 12:15:46.196790  9072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 3682) took 1652 ms. Trace:
I20260709 12:15:46.197326  9072 rpcz_store.cc:276] 0709 12:15:44.535627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.536022 (+   395us) service_pool.cc:224] Handling call
0709 12:15:46.188165 (+1652143us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54004209d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:46.188274 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327683840}
I20260709 12:15:46.201031  8888 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:46.205744  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 64560.6us
I20260709 12:15:46.189038 15017 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.187772 14898 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.198571 15073 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:46.220649 15027 consensus_meta.cc:287] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 1.337s	user 0.009s	sys 0.004s
I20260709 12:15:46.222479 15163 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:46.227553 15154 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:15:46.228075 15044 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:15:46.198885 15071 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.216595 15137 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:46.238233 15151 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:15:46.240370 15027 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.250005  8921 raft_consensus.cc:1240] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:15:46.221233 14898 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:46.245075  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44138.6us
I20260709 12:15:46.206898 15106 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:46.238821 15153 log.cc:927] Time spent T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:15:46.256152  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:46.260355 15123 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:46.274703  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 80621.9us
I20260709 12:15:46.223635 15073 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.281625 15106 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.261988 15150 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.281978 14898 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.282338 15009 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:46.284346 14819 consensus_meta.cc:287] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.239s	user 0.010s	sys 0.002s
W20260709 12:15:46.286441 15122 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:15:46.286590 15027 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.286827 15139 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.272282 15127 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:15:46.288192 15141 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.299546 15123 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.293254 14831 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:46.297991  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.317888  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.319271  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.320578  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.321859  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.323153  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.301875 14825 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.323835  8994 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:46.278000  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.242980 15163 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.287889 15059 consensus_queue.cc:1048] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:15:46.264040 15137 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.263397 15164 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:46.306841 14819 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:46.314543 14985 consensus_meta.cc:287] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 1.521s	user 0.007s	sys 0.007s
I20260709 12:15:46.327523  8994 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:15:46.316170 15046 consensus_meta.cc:287] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.950s	user 0.009s	sys 0.004s
I20260709 12:15:46.332999  8888 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.339974  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:46.341995  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.310267 15122 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.323364 15123 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.346930 15027 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:46.349853 15027 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:46.350273 15027 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.364017 15059 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:46.364698 15059 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.365046 15059 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:46.329178 14825 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.338932 15046 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.368208 14825 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.369350 15046 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:46.370867 15121 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.739s	user 0.002s	sys 0.002s
I20260709 12:15:46.346784  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.376982 15106 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.377830  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 2015) took 1555 ms. Trace:
I20260709 12:15:46.377790 15106 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.378258  8998 rpcz_store.cc:276] 0709 12:15:44.822463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.822652 (+   189us) service_pool.cc:224] Handling call
0709 12:15:44.848858 (+ 26206us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:44.888477 (+ 39619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.888524 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:44.889359 (+   835us) log.cc:844] Serialized 52 byte log entry
0709 12:15:45.169336 (+279977us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:45.275452 (+106116us) log.cc:844] Serialized 14 byte log entry
0709 12:15:45.275856 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 12:15:45.757022 (+481166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.757110 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.368812 (+611702us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b180025a620. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db
0709 12:15:46.370312 (+  1500us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:46.377578 (+  7266us) raft_consensus.cc:1685] finished
0709 12:15:46.377600 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.377768 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42302,"prepare.queue_time_us":106020,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":866452,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":41671,"spinlock_wait_cycles":28004992,"thread_start_us":699838,"threads_started":3,"wal-append.queue_time_us":520132}
I20260709 12:15:46.345372 15009 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:46.368801 14825 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:46.383445 15152 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:46.384002 15160 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:15:46.391717 15071 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.382565 15046 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:46.371745 15119 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.394982  8923 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:46.395954 15171 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:46.398737  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 121670us
I20260709 12:15:46.427667  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:46.349249 15127 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 12:15:46.500761  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73244.8us
I20260709 12:15:46.388569 15152 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.390925 15009 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:46.516247  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.517014  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.398707 15046 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:46.547326  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.548197  8925 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 7.
I20260709 12:15:46.530892  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.545848  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.397730 15171 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.549505  8918 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:46.553231  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:46.554013  8924 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:15:46.515321 15161 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:15:46.347997 15136 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.575752  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:46.581773 15119 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.582657  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.485677 15166 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:46.340324 15164 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.500594 15162 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.515733 15172 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:46.560201 15124 consensus_meta.cc:287] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.003s
I20260709 12:15:46.587823  8916 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:46.595561  8999 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:46.595495  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.596306  8920 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:15:46.601958  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:46.609838  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114083us
I20260709 12:15:46.595397 15123 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.600858 15163 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.611589 15172 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.614223 15172 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.616611  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.617314 15027 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.617978  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.597323 15124 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.612677 15109 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.627454  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.629619  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:46.630594 15071 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:46.630990 15071 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.631404 15071 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.634970  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:46.644714  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.650978  8995 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.652594 15171 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.627698 15122 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.608776 15046 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.662184 14871 raft_consensus.cc:3055] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:46.642504 14825 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:46.667344 15071 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.670207  8917 raft_consensus.cc:1240] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:15:46.673117  9069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58556 (request call id 3689) took 2061 ms (client timeout 1959 ms). Trace:
I20260709 12:15:46.610463 15009 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.675319 15124 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.680871 15164 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.682365  8924 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
W20260709 12:15:46.692492  9069 rpcz_store.cc:269] 0709 12:15:44.611521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.611870 (+   349us) service_pool.cc:224] Handling call
0709 12:15:46.672846 (+2060976us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400421dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:46.673025 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104807808}
I20260709 12:15:46.682785  8995 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:46.657692 15017 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:46.694651  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.701347 15136 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.701647 14819 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.702817 15152 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.696446 15027 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.679517 14824 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:46.707628 14824 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.710798 14824 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.679831 14871 raft_consensus.cc:740] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:46.715538  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.732286 15027 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.732028 14871 consensus_queue.cc:260] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.732839 15027 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.733335 14871 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:46.733902 15071 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.697357 15017 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.724654  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.730150 15137 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.742900  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:46.719888 15172 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.752489  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:46.753412  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:46.734988 15027 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.764544  9624 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:46.767908  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:46.768843  8920 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.772727  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:46.775159  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.722971 14825 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:46.779364  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:46.780529  9620 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.760855 15017 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:46.789335  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.782940 15027 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:46.784544 14825 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.814908  8993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 2011) took 1993 ms. Trace:
I20260709 12:15:46.795506 14979 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:46.820009 14979 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.819500  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.825462 15128 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:46.825824  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.826817  8995 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:46.823997  9620 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:46.826315 15128 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.879895  8995 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:46.881439  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.885885  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:46.886956  9067 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:46.817394  8993 rpcz_store.cc:276] 0709 12:15:44.821279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.831180 (+  9901us) service_pool.cc:224] Handling call
0709 12:15:44.861233 (+ 30053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.444157 (+582924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.814646 (+1370489us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400324454. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:46.814842 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187454848}
I20260709 12:15:46.891743  9588 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:46.890996 15009 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:46.795997 15027 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.901077 15009 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.901474  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:46.902549  9069 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 22 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:15:46.903129 15027 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.904007  9622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34338 (request call id 1258) took 1462 ms. Trace:
I20260709 12:15:46.904583  9622 rpcz_store.cc:276] 0709 12:15:45.441529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.441681 (+   152us) service_pool.cc:224] Handling call
0709 12:15:46.903688 (+1462007us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540043a3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:46.903888 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908796672}
I20260709 12:15:46.905558 15073 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.823066 14979 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.913146  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:46.810844 14825 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.874126 14819 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:46.919370  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.895306 15139 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.809196 15148 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 12:15:46.891335 15122 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.921854  8918 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:46.903129 15009 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.795300 15063 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.923920 14824 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:46.922866  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2829) took 2266 ms. Trace:
I20260709 12:15:46.915711 15173 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:46.932526  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.938159  8922 rpcz_store.cc:276] 0709 12:15:44.648670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.648813 (+   143us) service_pool.cc:224] Handling call
0709 12:15:44.649298 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.703777 (+ 54479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.703807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.788826 (+ 85019us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:44.789270 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:15:44.886385 (+ 97115us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:44.886421 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.915157 (+2028736us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b540008bbd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:46.915262 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.915311 (+    49us) raft_consensus.cc:1685] finished
0709 12:15:46.915326 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.915479 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":373,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":152382208,"thread_start_us":96738,"threads_started":1,"wal-append.queue_time_us":358448,"wal-append.run_cpu_time_us":15855,"wal-append.run_wall_time_us":1742059}
I20260709 12:15:46.943267  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.942185  8992 raft_consensus.cc:2410] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:46.945233  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:46.945902  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.803333 15059 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.953222  8920 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:46.945912  8918 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:46.973049  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:46.942387 15173 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.975015 15173 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:46.930888 15139 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:46.979055 15139 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.985975 15173 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.986032 15059 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:46.960247 14824 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:15:46.988751 15173 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:46.990883  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:46.944764 15063 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:46.994557 15063 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:46.995376  8992 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:46.925315 14819 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:47.006209  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 93186.3us
I20260709 12:15:46.972376  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.008912  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3701) took 1483 ms. Trace:
I20260709 12:15:47.010111  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.012482  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.009526  9065 rpcz_store.cc:276] 0709 12:15:45.533279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.790242 (+256963us) service_pool.cc:224] Handling call
0709 12:15:45.887950 (+ 97708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.901647 (+ 13697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:45.901694 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:45.901751 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:45.901794 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.008666 (+1106872us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000e8dd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:47.008715 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.008852 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30913920}
I20260709 12:15:46.932942 15122 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.026970  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:47.028198  8995 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:47.028232  8992 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.020273 15173 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:47.020774 14824 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:47.048803  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:47.041273 15063 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.044667 15139 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.047564 15173 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:47.055800  8992 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:47.050474 14824 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:47.056438 15063 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.075759  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.077286  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.078473  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.079475 15031 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.079571  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.058148 15173 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:47.084285  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.086500  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:47.090195  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:47.094537  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.095924  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.094085 15071 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:47.057049 15139 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.102939 14824 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.067950 15128 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:47.106362  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.108230  8918 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:47.108443  9620 raft_consensus.cc:2410] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:15:47.111361  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.112874  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.113018  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.113556  9622 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:15:47.113768  9624 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:47.114907  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.116695  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.117296  9067 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:47.117483 15122 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.118119  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.118717  9065 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:47.109758 15007 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:47.119940 15007 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:47.120877 15007 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.088423 15101 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:15:47.122952  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:47.123798  9616 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:47.124109  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.124917 15063 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:47.123817  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:47.106379 15017 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.132601  9619 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:47.133919 15017 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.139592 14859 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.140326  8888 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:47.140138 14859 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.141191 15045 consensus_queue.cc:1059] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:47.142198 15045 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:47.142406 15027 raft_consensus.cc:3055] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:47.142851 15027 raft_consensus.cc:740] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:47.143847  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.143778 15027 consensus_queue.cc:260] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.144711  9066 raft_consensus.cc:2393] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:47.145845  9616 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:47.141439 15071 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:47.156107  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.091430 15189 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:15:47.091949 15031 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:47.164577  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.150810  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.159674  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.166900  8918 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:47.161746  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:47.163300  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.150179  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.169373  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:47.171195  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.172290  8922 raft_consensus.cc:2393] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:47.173623  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.173391  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.175002  9618 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:15:47.176270  9616 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:15:47.162683 14617 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:47.180846  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:47.181234  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.182880  9618 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:47.183210  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:47.178079  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.184212  9620 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:47.168895 15063 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:47.185487  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:47.185580 15063 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.186189  9065 raft_consensus.cc:2376] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16. Re-sending same reply.
I20260709 12:15:47.191773  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.192198 15063 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:47.193189 15173 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.162784 15071 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.179745 15027 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.169377 15045 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:47.198110  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2520) took 2333 ms. Trace:
I20260709 12:15:47.194679  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:47.200984  8921 rpcz_store.cc:276] 0709 12:15:44.864295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.864430 (+   135us) service_pool.cc:224] Handling call
0709 12:15:44.883955 (+ 19525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.250424 (+1366469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.197872 (+947448us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001e55d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:47.198055 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3141090176}
I20260709 12:15:47.231182  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.231900  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.189394 14617 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.242906  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.241034  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.244511  8888 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.239164  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.195703 15071 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:47.251500  9587 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:47.196504 15057 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.230652 14890 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.253244  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.258612  9620 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:47.258692  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.259712  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.231552 14819 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.261474  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.264101  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:47.261056  9618 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:47.267161  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.270251  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:47.271189  9067 raft_consensus.cc:2393] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:47.271154  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.272260  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:47.272572  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.272264  8888 leader_election.cc:400] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:47.274425  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.280254  8888 leader_election.cc:403] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:15:47.275729  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.276625  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.263381  9587 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:47.280975  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.281353  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:47.281675  9072 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:47.282677  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.282758  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.283339  9072 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 11.
W20260709 12:15:47.283859  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.255584 15101 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:47.288259  8991 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:47.288901  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.290103  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:47.289398  9070 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:47.290215  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.291448  9072 raft_consensus.cc:2410] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:15:47.289214  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:47.259616 15031 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:47.299628  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.288918  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.306137  8993 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:47.300346  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.304359  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.307420  9066 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:47.307585  9072 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:47.308255  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.305178  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.303399  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.308483  9072 raft_consensus.cc:2368] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:47.312669  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:47.313694  9072 raft_consensus.cc:2368] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:47.312842  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.314424  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.315117  9074 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:47.316319  8991 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:15:47.317932  9069 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:47.290364 15046 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.304252 15071 raft_consensus.cc:2804] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:47.334371 15071 raft_consensus.cc:697] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:47.335808 15071 consensus_queue.cc:237] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.342738  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.268986 15148 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:15:47.321708  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:47.322829  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:47.294896 14722 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:47.293541 14937 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:47.263083 14890 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.326439  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.328965  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.331512  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.332386  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.360978  9066 raft_consensus.cc:2410] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:47.362267  8993 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:47.332448 15173 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:47.310014 15152 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:47.320549  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.277405 15120 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:15:47.309623 15101 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:47.323434 15087 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:47.346882 15007 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:47.375526 15122 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.371332 15149 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:15:47.386226  8922 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:47.350899 14937 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.355500 14819 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:47.366756 15045 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:47.390524  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.396338  8921 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:47.399497  8993 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:47.370179 14927 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.376289 15068 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:47.388764 15128 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.383285 15087 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:47.388345 15116 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:47.371268 14979 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:15:47.388563 15057 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.395483 14937 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:47.387399 15007 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:47.427758  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.431810 15198 log.cc:927] Time spent T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:15:47.433668  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:47.392868 15122 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:47.437821 15178 log.cc:927] Time spent T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.731s	user 0.000s	sys 0.002s
I20260709 12:15:47.438275 15122 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:47.444178 15196 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:15:47.446012  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.447067  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.447266  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.447757  8924 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:47.448279  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.420979 15068 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.448640  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.449002  8920 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:47.449851  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.450459 15068 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.425740 15128 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.451902 15116 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.458006  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:47.412145 15045 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:47.463399  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.465828  9040 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:47.467707  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.469085  8920 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:47.471866  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:47.473356  8918 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:47.474254  8916 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:47.425632 15087 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.475481  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.480089  8919 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:47.481288  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.474574  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.451010 15068 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.429313 15057 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.454178 15128 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:47.404196 14819 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.430925 15007 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:47.454208 15116 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:47.493362  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:47.420744 14927 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.438870 15122 consensus_queue.cc:1059] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:15:47.493816  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:47.501936  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.501538 15189 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:47.537878  8920 raft_consensus.cc:2468] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:47.483853  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:47.590473 14890 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:47.586584 15202 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:47.504096 15116 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:47.506448 15045 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.556416  8921 raft_consensus.cc:2468] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:47.559755  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:47.487128 15043 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:15:47.551580 14769 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:47.501941 15128 consensus_queue.cc:1059] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:15:47.494907 15068 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.464908 15101 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.560606 15189 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:47.583570 15100 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:47.587684  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 215870us
W20260709 12:15:47.594403  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 128646us
I20260709 12:15:47.592311 15149 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:15:47.606484  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 46805.8us
I20260709 12:15:47.624935  8963 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:47.599753 15202 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.599512 15116 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.608348 15043 consensus_queue.cc:1243] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 2fec7bba20864beea35ba1b33132e47d log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:47.631614 14871 raft_consensus.cc:3055] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:47.636070 14871 raft_consensus.cc:740] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:47.640623  8920 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:47.628186  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:47.657076  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 185319us
I20260709 12:15:47.630187 15202 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:47.689736  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:47.636890 14871 consensus_queue.cc:260] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:47.633083 15066 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:47.632715 15116 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.630311 15149 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.702392 14617 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:47.728180 14871 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:47.728837 15213 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.736500 15213 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:47.738687 15213 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:47.704221  9073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2924) took 2225 ms (client timeout 2025 ms). Trace:
W20260709 12:15:47.739070  8996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 3415) took 1781 ms (client timeout 1656 ms). Trace:
I20260709 12:15:47.637872 14819 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:47.648480 14927 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:47.739404  9073 rpcz_store.cc:269] 0709 12:15:45.478369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.674709 (+196340us) service_pool.cc:224] Handling call
0709 12:15:47.703969 (+2029260us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54003ee9d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:47.704135 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977717120}
I20260709 12:15:47.626895 15100 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:47.725713  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 91533.7us
W20260709 12:15:47.711666 15199 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:15:47.917411  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 227757us
I20260709 12:15:47.770349  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:47.739494  8996 rpcz_store.cc:269] 0709 12:15:45.958016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.966075 (+  8059us) service_pool.cc:224] Handling call
0709 12:15:47.738819 (+1772744us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5400262fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:47.738966 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6443264}
I20260709 12:15:47.709918 15215 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:47.729957 14746 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:15:47.918283  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 287124us
I20260709 12:15:47.946631  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:47.621270 15125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.737s	user 0.014s	sys 0.032s
I20260709 12:15:47.970359  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:47.968179  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 310121us
I20260709 12:15:47.741091 15149 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:47.943787 15197 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 12:15:48.009649  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.036985  9073 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:48.039752  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.730263 15203 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.240s
W20260709 12:15:47.974011 15125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.100s	user 0.014s	sys 0.033s
W20260709 12:15:48.045928  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 417792us
I20260709 12:15:48.046434  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.052204  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:48.054528  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 105660us
I20260709 12:15:47.944610 15107 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.065784  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:47.974963 15212 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.068220  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.074628  9069 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:48.048015 15059 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:48.075798 15059 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.057752 15225 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:48.079556 15225 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.081959 15225 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:48.082700 15007 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 12:15:48.083448 15068 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:48.057953 15206 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:15:48.084004 15179 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.380s	user 0.000s	sys 0.004s
I20260709 12:15:48.084631 15100 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.085474  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 1078) took 1495 ms. Trace:
W20260709 12:15:48.073310 15046 consensus_meta.cc:287] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.003s
I20260709 12:15:48.090610  9071 raft_consensus.cc:1275] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:48.095387  8925 rpcz_store.cc:276] 0709 12:15:46.590473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.590612 (+   139us) service_pool.cc:224] Handling call
0709 12:15:46.591007 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:46.591387 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.591423 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:46.591992 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 12:15:46.657423 (+ 65431us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:46.657462 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.657525 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:47.724744 (+1067219us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:48.085152 (+360408us) raft_consensus.cc:1685] finished
0709 12:15:48.085173 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.085414 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":932,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5192,"spinlock_wait_cycles":46086016,"thread_start_us":47404,"threads_started":1,"wal-append.queue_time_us":98947}
I20260709 12:15:48.094841  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.059175 14927 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:47.965996 15215 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:48.090327 15211 log.cc:927] Time spent T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:15:47.892192 15189 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.106994 15002 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.125142  9040 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.122654 15217 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:48.122928  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.123436  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.124946  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.127951  9069 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:48.116380 15225 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:48.101689 15046 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:48.107345 14927 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:48.083153 15007 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.132898  8992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3435) took 1501 ms. Trace:
I20260709 12:15:48.135039  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:48.135505  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 165221us
I20260709 12:15:48.138204  8992 rpcz_store.cc:276] 0709 12:15:46.631486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.057987 (+426501us) service_pool.cc:224] Handling call
0709 12:15:47.058390 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:47.059129 (+   739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.059163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:47.081627 (+ 22464us) log.cc:844] Serialized 52 byte log entry
0709 12:15:47.405363 (+323736us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:47.638078 (+232715us) log.cc:844] Serialized 14 byte log entry
0709 12:15:47.728049 (+ 89971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.728131 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:48.132681 (+404550us) raft_consensus.cc:1685] finished
0709 12:15:48.132702 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.132840 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326655,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":96440,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":348367104,"thread_start_us":603209,"threads_started":3,"wal-append.queue_time_us":409643}
I20260709 12:15:48.119060 15107 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:48.126421 15142 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.144742  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:48.137116 14937 consensus_meta.cc:287] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.001s
I20260709 12:15:48.129438 15217 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.145943  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.137953 14927 raft_consensus.cc:3060] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.152846  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.155001  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.143888 15225 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.155664  9073 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:48.156201 15225 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.145414 14819 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:48.159582 15219 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.162027  8918 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:48.162931  9071 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:48.165293  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.169756  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.170394  9065 raft_consensus.cc:3060] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.170862  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.176306  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.177928  8919 raft_consensus.cc:1240] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:48.144069 15068 raft_consensus.cc:2804] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:48.177968  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.182161  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.186360 15146 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:48.188195 15146 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:48.188577 15146 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:48.190194  8998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1266) took 1892 ms. Trace:
I20260709 12:15:48.190688  8998 rpcz_store.cc:276] 0709 12:15:46.298035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.381007 (+ 82972us) service_pool.cc:224] Handling call
0709 12:15:46.383710 (+  2703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.603700 (+219990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.603728 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:46.603777 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:46.603810 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.189916 (+1586106us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54000f50d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:48.189967 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.190122 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505462656}
W20260709 12:15:48.191679 15218 log.cc:927] Time spent T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:15:48.191752  8999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49082 (request call id 3418) took 2173 ms (client timeout 2133 ms). Trace:
W20260709 12:15:48.192307  8999 rpcz_store.cc:269] 0709 12:15:46.018766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.018946 (+   180us) service_pool.cc:224] Handling call
0709 12:15:48.191526 (+2172580us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400325354. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:48.191661 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323107584}
I20260709 12:15:48.192843  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.195344 15215 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:48.171219 15224 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:48.199975 15217 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.181268 15002 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:48.246377  8888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.137.2:35539 timed out after 2.133s (SENT) [suppressed 12 similar messages]
I20260709 12:15:48.251097 15230 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:48.148311 15107 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.253198  9065 raft_consensus.cc:2468] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
W20260709 12:15:48.253762 14871 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.002s
I20260709 12:15:48.254678 15107 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:48.256230  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 74190.8us
I20260709 12:15:48.256999  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.257314 14927 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.217260 15212 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:48.260341 15212 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:48.260746 15212 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:48.263962  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.265868 15142 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:48.265305 15068 raft_consensus.cc:697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:48.267261 15210 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:15:48.267683 15068 consensus_queue.cc:237] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.268426  9619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34338 (request call id 1262) took 1129 ms. Trace:
I20260709 12:15:48.268829  9619 rpcz_store.cc:276] 0709 12:15:47.138989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.143130 (+  4141us) service_pool.cc:224] Handling call
0709 12:15:47.143498 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.143891 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.143924 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:47.144364 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:15:47.596129 (+451765us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:47.596170 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.596250 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:48.268221 (+671971us) raft_consensus.cc:1685] finished
0709 12:15:48.268240 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.268360 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1018,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5037,"thread_start_us":451439,"threads_started":1,"wal-append.queue_time_us":1010597}
I20260709 12:15:48.270465 15219 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.169267 14937 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.276631  8999 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:48.276559  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:48.280956  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.279915 15108 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:48.301654 15108 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.303210 15063 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:48.303791 15063 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.304461 15108 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.304819 15063 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.305732  8992 pending_rounds.cc:85] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 6
I20260709 12:15:48.306027  8992 pending_rounds.cc:107] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:15:48.306130 15063 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:48.306273  8992 raft_consensus.cc:2889] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:48.310086 15146 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.312628  8964 leader_election.cc:400] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:48.284597 15232 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:48.295785 15217 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:48.313774  8964 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.318459  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1258) took 2022 ms. Trace:
I20260709 12:15:48.320864  9000 rpcz_store.cc:276] 0709 12:15:46.295876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.296007 (+   131us) service_pool.cc:224] Handling call
0709 12:15:46.300749 (+  4742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.340618 (+ 39869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.340648 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:46.340694 (+    46us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:46.340732 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.318130 (+1977398us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5400171e54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:48.318201 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.318380 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91256192}
I20260709 12:15:48.322705  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.319015 14927 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.327943  8964 leader_election.cc:400] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:48.333317  8964 leader_election.cc:403] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:48.334710 15006 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:15:48.338562  9590 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.345611 15006 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:48.325379 15002 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:48.348543  8964 leader_election.cc:400] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:48.348548  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.352627  8964 leader_election.cc:403] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:15:48.352993  9068 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:15:48.353681  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58550 (request call id 2939) took 1084 ms. Trace:
I20260709 12:15:48.354063  9068 rpcz_store.cc:276] 0709 12:15:47.268801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.343222 (+1074421us) service_pool.cc:224] Handling call
0709 12:15:48.353609 (+ 10387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.328545 15232 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:15:48.331296 15202 consensus_meta.cc:287] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.004s
I20260709 12:15:48.356667  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:48.360715  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.360989  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.361469  9000 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
W20260709 12:15:48.360692  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 114352us
I20260709 12:15:48.369648  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:48.372414  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 196182us
I20260709 12:15:48.352264 15002 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:48.347497 15007 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.358444 15071 raft_consensus.cc:2804] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:15:48.331144  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 206122us
I20260709 12:15:48.362931 15107 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:48.357914 15006 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18.
I20260709 12:15:48.383757  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:48.381240  8923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47314 (request call id 2836) took 2712 ms (client timeout 1924 ms). Trace:
W20260709 12:15:48.396938  8923 rpcz_store.cc:269] 0709 12:15:45.664384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.665781 (+  1397us) service_pool.cc:224] Handling call
0709 12:15:48.376398 (+2710617us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000ca3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:48.376538 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675104000}
I20260709 12:15:48.387174  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:48.363047 15202 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.380822 15233 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:48.375583 15116 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.380944 14746 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.385207 15002 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:48.403205  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.413432  8923 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:48.402774  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.416318 15101 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:48.395195 15107 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:48.447650 14871 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:48.448446 14871 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.448913 14871 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.450914 14871 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.452181  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49082 (request call id 3444) took 1080 ms. Trace:
I20260709 12:15:48.400760 15071 raft_consensus.cc:697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:48.457998  8923 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:48.401823 15234 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:15:48.459625 15038 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:48.413332 14937 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.409808 15116 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:48.467065  8966 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.407562 15242 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:48.470537  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:48.453150  8991 rpcz_store.cc:276] 0709 12:15:47.371849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.372023 (+   174us) service_pool.cc:224] Handling call
0709 12:15:47.372378 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:47.376058 (+  3680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.376090 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:48.269986 (+893896us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b2c00011ed8. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:48.270606 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 12:15:48.382534 (+111928us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:48.382569 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.382634 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:48.451861 (+ 69227us) raft_consensus.cc:1685] finished
0709 12:15:48.451881 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.452113 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3238,"raft.queue_time_us":7723,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6551,"spinlock_wait_cycles":5488384,"thread_start_us":111540,"threads_started":1,"wal-append.queue_time_us":144726}
I20260709 12:15:48.471325  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.471449 15071 consensus_queue.cc:237] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:48.477236  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55513.6us
I20260709 12:15:48.484579  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.474056  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.453927 15107 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:48.476621  9615 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:48.477421  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.486160  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.480757  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.485960  8998 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:15:48.494311  8920 raft_consensus.cc:2393] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:48.527762  8996 raft_consensus.cc:2368] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:48.487316  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:48.530139  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 53718.3us
I20260709 12:15:48.477044 15242 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.476809 15219 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.410646 14746 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.536557 15108 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:48.555675 15108 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.557642 15108 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.558404 15204 raft_consensus.cc:3055] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:48.558957 15204 raft_consensus.cc:740] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:48.473212 15038 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.559980 15204 consensus_queue.cc:260] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.561285 15038 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.561720 15204 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.562027 15135 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:48.562668 15135 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.564901 15135 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.543920  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.565776  8920 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
W20260709 12:15:48.545331  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 59251.2us
I20260709 12:15:48.545521  8923 raft_consensus.cc:2468] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:48.567117  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.567169  9040 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.488065 15217 raft_consensus.cc:2804] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:48.551170 15002 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:48.551743 15087 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 1.057s	user 0.013s	sys 0.000s
I20260709 12:15:48.552829 15202 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:48.548626 15234 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:48.567687  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.568575  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.568589  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2542) took 1204 ms. Trace:
I20260709 12:15:48.578183  8920 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:48.568518  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.464305 15212 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.579282  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.578183  8918 rpcz_store.cc:276] 0709 12:15:47.364360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.604816 (+240456us) service_pool.cc:224] Handling call
0709 12:15:47.605184 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.168862 (+563678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.568359 (+399497us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540015ac54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:48.568519 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280146816}
I20260709 12:15:48.582213  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.584357  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.487720 15237 consensus_queue.cc:1059] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:15:48.587795  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.589036  8920 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:48.589512  8918 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.567941 15068 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.592298  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.590060  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.590749  9040 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.577513 15116 raft_consensus.cc:2804] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:48.594408  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.593914  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.549871 15242 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.584133 15230 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:15:48.582733 15217 raft_consensus.cc:697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.612478  8888 leader_election.cc:400] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17.
I20260709 12:15:48.614797  8923 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:48.612910  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.609110  8920 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:15:48.617846  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.619552  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.618976  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.591372 15215 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.625826  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.576674 15219 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:48.623723  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.626792  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:48.624125 15116 raft_consensus.cc:697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:48.631322  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.609793 15213 raft_consensus.cc:2804] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:48.629179  8918 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:48.633306  9622 raft_consensus.cc:2393] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:48.611313 15120 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:48.581880 15087 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.635614  8918 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:48.636268  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.621378 15106 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.646831  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.651798  9070 raft_consensus.cc:2368] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:48.647549  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.647460  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.626446 14871 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:48.654222  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.628300 14769 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:48.658053  9066 raft_consensus.cc:1275] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:48.662560  8994 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:48.641752 15120 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:48.665886 14769 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.672981 14769 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.659221 15223 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.673173 15002 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:48.667719 15149 consensus_meta.cc:287] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 12:15:48.653582 15125 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:48.664901 15142 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:48.673868 15149 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.674482 15212 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.676035 15087 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.676170 15149 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.651194 15213 raft_consensus.cc:697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:48.674109 15125 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.634361 15038 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:15:48.683951  9040 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:48.685268 15142 raft_consensus.cc:2804] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:48.685802 15142 raft_consensus.cc:697] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:48.686707 15142 consensus_queue.cc:237] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.676779 15116 consensus_queue.cc:237] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.689055 15125 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.677147 15120 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:48.710877  9619 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:48.711622 15213 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:48.713413  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.716862 15068 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:15:48.717811 15068 consensus_queue.cc:1243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer 4993160378a142a1bc21648120cbaebc log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:15:48.718889  9619 raft_consensus.cc:3055] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:48.719470  9619 raft_consensus.cc:740] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:48.720264  9619 consensus_queue.cc:260] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.720660 15139 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.721279  9619 raft_consensus.cc:3060] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:48.673803 15217 consensus_queue.cc:237] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.723449 15120 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.725215  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.727070  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.727293  9072 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
W20260709 12:15:48.728297  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.728703  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.730428  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.662770 14871 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.733791  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.735821  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.736052  9072 raft_consensus.cc:2376] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17. Re-sending same reply.
I20260709 12:15:48.737321  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.733410  9037 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:48.737512  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.739971  8918 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:48.732381  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.743297  9065 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:15:48.752866  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2526) took 3490 ms. Trace:
I20260709 12:15:48.753234  9619 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:15:48.753288  8917 rpcz_store.cc:276] 0709 12:15:45.262877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.263548 (+   671us) service_pool.cc:224] Handling call
0709 12:15:45.263928 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.692088 (+1428160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.743445 (+2051357us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400245754. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:48.752804 (+  9359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3233243392}
I20260709 12:15:48.754621  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.753813  9619 pending_rounds.cc:85] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 12
I20260709 12:15:48.755380  9619 pending_rounds.cc:107] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:15:48.755308  9065 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 14.
I20260709 12:15:48.755731  9619 raft_consensus.cc:2889] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:48.757891  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.758172 15068 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:48.759142  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.763336  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.763744  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.764417  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.765555  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.764410  9622 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:48.759528  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.768096  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:48.759018 14871 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.772286  8917 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:48.752079 15215 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:48.789079  9624 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:48.791894  8997 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:48.799186  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:48.800768  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:48.801452  8997 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 11.
I20260709 12:15:48.783809 15230 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:48.771883 15137 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:15:48.795058 15068 consensus_queue.cc:1059] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:15:48.819588  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:48.809326 15230 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:48.834188  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47330 (request call id 2539) took 1562 ms (client timeout 1622 ms). Trace:
W20260709 12:15:48.834662  8922 rpcz_store.cc:269] 0709 12:15:47.271863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.288643 (+ 16780us) service_pool.cc:224] Handling call
0709 12:15:48.834019 (+1545376us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54000cb2d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3f2fa 00007f398ac00b17 00007f398417b6d4 00007f398417b662 00007f398417b591 00007f398417b50c 00007f398417a7c2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:48.834130 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219551488}
I20260709 12:15:48.820218 15137 consensus_queue.cc:1243] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer fd11e77b4be14e658672599b30d51e76 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:15:48.859117 15107 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.859658 15219 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:48.860034  9073 raft_consensus.cc:1240] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:48.862105  9072 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:15:48.803915 15252 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:15:48.832931 15230 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:48.866889  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2536) took 1621 ms. Trace:
I20260709 12:15:48.878051  8919 rpcz_store.cc:276] 0709 12:15:47.245282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.528253 (+282971us) service_pool.cc:224] Handling call
0709 12:15:47.528518 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.178458 (+649940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.866293 (+687835us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400018954. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:48.866550 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493059840}
W20260709 12:15:48.868901 15267 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:15:48.871978 15245 log.cc:927] Time spent T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
W20260709 12:15:48.887641 15264 log.cc:927] Time spent T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:15:48.892731 15202 raft_consensus.cc:3055] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:48.893229 15202 raft_consensus.cc:740] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:48.894073 15202 consensus_queue.cc:260] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:48.898563  8889 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.695s (SENT)
I20260709 12:15:48.867116 15007 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:15:48.904067  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2854) took 1729 ms. Trace:
I20260709 12:15:48.906267  8889 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:15:48.907974  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 87581.9us
I20260709 12:15:48.904488  8916 rpcz_store.cc:276] 0709 12:15:47.174333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.176795 (+  2462us) service_pool.cc:224] Handling call
0709 12:15:47.474005 (+297210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.475074 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.903877 (+1428803us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540020f8d0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:48.904007 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682595584}
I20260709 12:15:48.912120  8889 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:48.913153  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.916148  8916 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:48.921705  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.922523  9074 raft_consensus.cc:2393] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:48.916230 15260 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:48.923328  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:48.915855 14999 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:15:48.923972 15107 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.924397  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.925123  8924 raft_consensus.cc:1275] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:48.920840 15148 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:48.908125 15263 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:15:48.926334  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.926994  9074 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:48.927935  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.930610  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.931378  9074 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:48.929253  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.932416  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.929208 15242 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.897987 15202 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:48.933732 15122 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.921684 15046 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.934527  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:48.935180  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:48.931892 15215 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:15:48.916651 15213 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:48.942721  9067 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:48.944640 15059 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:48.941061 15222 consensus_queue.cc:1048] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:15:48.947041 15213 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.947842 15002 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:48.948217 15002 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:48.948985 15002 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:48.951419  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:48.956887  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 120061us
I20260709 12:15:48.957222  8889 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:48.958220  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.960538  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.958375 15002 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:48.960763 15125 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.954725 15213 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:48.940029 15122 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:48.957064 15046 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:48.964471  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:48.968423  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.975512  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.986186 15120 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:48.989928  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:48.976111  8916 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:48.992480 15125 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:15:48.992936  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:48.993705 15125 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:48.994092  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:48.994880 15108 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:48.995635 15108 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:49.001209 14819 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.001751 14819 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:49.005293  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:49.006560  8889 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:49.010106  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:49.011199  8916 raft_consensus.cc:2393] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:49.020782 15230 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.025012 15230 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:49.027698 15057 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:49.009830 15242 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:49.022061 15254 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.477s	user 0.003s	sys 0.000s
I20260709 12:15:49.021246 15122 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:49.034304  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:49.015877 15108 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:15:49.046761 15279 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:15:49.003932 14819 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:49.018658 15125 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:49.018499 15046 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:49.048612  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:49.047914 15278 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:15:49.049993  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 187074us
I20260709 12:15:49.051458  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:49.057699  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:49.058169  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:49.061944  9070 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:49.049085 15125 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:49.075395  9000 raft_consensus.cc:1240] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:49.075549 15125 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:49.067498  9069 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:15:49.077083  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:49.078368  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:49.065446  9588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.068019  8924 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:49.080334  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.080996  9621 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:49.068398  9070 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:49.069068 15046 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:49.070518 15263 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:49.050736 15101 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:49.084164  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.081000 14979 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:49.100118 15101 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.104506  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.106598  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.100626 15101 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.111925 15101 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:49.112092 14927 raft_consensus.cc:3055] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:49.085897 14859 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:49.115161  8998 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:15:49.115648 15284 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:49.117364  9073 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:15:49.117799  8964 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Timed out: RequestConsensusVote RPC to 127.7.137.3:34547 timed out after 1.646s (SENT)
I20260709 12:15:49.118580  9073 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:49.119369 15224 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:49.119861 15224 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:49.122067 15224 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:49.122215 15125 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.124356 15125 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:49.128224  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.129377  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.129927  9067 raft_consensus.cc:3060] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:49.112495 14927 raft_consensus.cc:740] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:49.136768  8996 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:49.110028  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.102598 14979 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:49.154384  8916 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:15:49.139112 15108 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:49.166631 15120 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:49.167541  8919 raft_consensus.cc:1240] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:49.168011  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.173878 15010 consensus_queue.cc:1059] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:49.180528  8999 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:49.153381 14979 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:49.194176  8998 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:49.184485  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.175052 15010 raft_consensus.cc:3055] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:49.203209  9621 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:49.209553  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.208069  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.207407  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.217358  9070 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:49.220130  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.228518  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.243409  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.243597  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.244455  9618 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:49.245978  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.248097  9621 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18. Ops: []
W20260709 12:15:49.258097  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.248278  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.190899  9067 raft_consensus.cc:2468] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
W20260709 12:15:49.249392  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 130680us
I20260709 12:15:49.261082  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.263868  9067 raft_consensus.cc:1240] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:49.151225 15101 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:15:49.267992  9624 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 17. Current term is 18. Ops: []
W20260709 12:15:49.208811 15227 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.043s	user 0.001s	sys 0.001s
I20260709 12:15:49.275177  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.226392 15010 raft_consensus.cc:740] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:49.289359  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.289852  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.290640  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.290730  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.299551  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.300540  9616 raft_consensus.cc:1240] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:49.293062  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.294148  9067 raft_consensus.cc:2410] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:15:49.295588  9624 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
W20260709 12:15:49.287606  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 118834us
I20260709 12:15:49.172499 15281 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:15:49.210085 15252 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:49.219079 15059 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.299944  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:49.309257  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.311399  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.311426  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.312027  8999 raft_consensus.cc:3060] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:15:49.312278  9067 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:49.241691 15071 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:49.172072 15122 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.105s
I20260709 12:15:49.316731  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.317927  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.268803 15120 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:49.323287 15252 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.325421 15252 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:49.325934 15252 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:49.328118 15299 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:49.331092  8999 raft_consensus.cc:2468] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:49.331969  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.212386 15260 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:15:49.336966  9067 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:49.337802  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.338560  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.204643 15224 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:15:49.298869 15101 consensus_queue.cc:1243] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer 491a1127924f43d4a369f7d09c3a68db log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:49.345737  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.349536  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:49.351863  8916 raft_consensus.cc:2393] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:49.351737  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.352449  8993 raft_consensus.cc:3060] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:49.358330  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.359359  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.205052 14927 consensus_queue.cc:260] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.372897  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.364130  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:49.376189  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.380302  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.384660  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.385427  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.398155  9588 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.399973  9588 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.401275  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.401727 15214 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:49.402623  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.399978  9617 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:49.415007  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2861) took 2040 ms. Trace:
I20260709 12:15:49.421345  9619 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:49.331542 15059 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.415608  8921 rpcz_store.cc:276] 0709 12:15:47.374521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.601335 (+226814us) service_pool.cc:224] Handling call
0709 12:15:47.602104 (+   769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.602399 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.602438 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:47.607019 (+  4581us) log.cc:844] Serialized 26 byte log entry
0709 12:15:47.971739 (+364720us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:47.971777 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.971842 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:49.208178 (+1236336us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:49.365731 (+157553us) raft_consensus.cc:1685] finished
0709 12:15:49.365766 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.414926 (+ 49160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9426816,"thread_start_us":324751,"threads_started":1,"wal-append.queue_time_us":468151}
I20260709 12:15:49.415928  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.432442  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:49.433693  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 46502.1us
I20260709 12:15:49.440701  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:49.439180 15221 log.cc:927] Time spent T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 1.159s	user 0.000s	sys 0.003s
I20260709 12:15:49.346264 15010 consensus_queue.cc:260] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:49.431869 14769 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:49.431337 15141 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:49.444536 15222 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:49.395044 15146 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:49.447971  9620 raft_consensus.cc:2393] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:49.449229 15141 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:49.463928 15141 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:49.446288 15108 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:49.430992 15071 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:49.482023  8994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1269) took 3086 ms. Trace:
I20260709 12:15:49.482581  8994 rpcz_store.cc:276] 0709 12:15:46.385446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.618804 (+233358us) service_pool.cc:224] Handling call
0709 12:15:47.738944 (+1120140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.662989 (+924045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.470499 (+807510us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400262fd4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:49.471426 (+   927us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400262fd0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3a8ad 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6 00007f3983f7526f
0709 12:15:49.471572 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4699098112}
I20260709 12:15:49.484743  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:49.487022 15057 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:49.487612 15057 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:49.439915 14927 raft_consensus.cc:3060] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:49.431461 15073 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:49.431181 14819 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.436352 15224 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:49.449733  8964 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.511931  9620 raft_consensus.cc:1275] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:15:49.475605  8993 raft_consensus.cc:2468] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
W20260709 12:15:49.477885  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.515302  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65700.5us
I20260709 12:15:49.516089  8964 leader_election.cc:400] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:49.516379  8964 leader_election.cc:403] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:49.506225 14769 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:49.525563  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.517946 15136 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:49.522789 15066 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547) with higher term. Message: Invalid argument: T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17.
I20260709 12:15:49.513674 14819 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:49.533946 15214 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:49.554682  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 219276us
I20260709 12:15:49.559226  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:49.568976 15287 log.cc:927] Time spent T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:15:49.546859 15120 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:49.558432 15234 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:15:49.587651  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.582944 15148 consensus_queue.cc:1059] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:15:49.596536 15059 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:49.537699 15057 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:49.602180  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 372580us
I20260709 12:15:49.606055  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:49.614440  8993 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:49.607034  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:49.607201  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 235074us
W20260709 12:15:49.611279  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 208710us
I20260709 12:15:49.616047  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:49.616532  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.606948  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:49.621639  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:49.627650  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:49.594834 15141 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.580070 15222 consensus_queue.cc:1048] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.040s
W20260709 12:15:49.636168  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 105155us
I20260709 12:15:49.630435 14769 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:15:49.600180 14859 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:49.598189 15234 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:49.692771 15071 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:49.694276 15308 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:15:49.694664  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52307.9us
I20260709 12:15:49.694825 15059 consensus_queue.cc:1048] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:49.696074 14769 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:49.697090  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:49.709314  9618 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:49.631322 15073 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:49.734513  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 97363.9us
W20260709 12:15:49.744206  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47194.5us
I20260709 12:15:49.699568 14722 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:49.689141 15038 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:49.750451 14722 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:49.753258 15307 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:15:49.754223 15305 log.cc:927] Time spent T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:15:49.753587 14722 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.694700 15308 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:49.769062 15308 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.770781 15308 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:49.771502 15073 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:49.772039 15073 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:49.772536 15073 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:49.689666 14859 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:49.787948 14979 consensus_meta.cc:287] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 12:15:49.743925 15214 consensus_queue.cc:1048] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 12:15:49.796288  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 189404us
W20260709 12:15:49.789758  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.825788  8919 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:15:49.827064  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.831867  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:49.887668  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 55881.9us
I20260709 12:15:49.888710  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.890139  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.892199  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.893992  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:49.896099  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:49.897133  8921 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:49.759893 15234 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.907209  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:49.967000 14927 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:49.903004 15222 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:49.843263 15202 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:49.969825 15202 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:49.972069 15202 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:49.803910 15141 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:49.967773 14927 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:49.986785  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 350909us
I20260709 12:15:49.832090 15230 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:49.901932 15242 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:49.968436 15222 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:50.016016  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.023406  8923 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:50.027360  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.028051  8916 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:49.988770 15234 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:49.791373 14979 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.035676  8924 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:15:49.904821 15073 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.037523  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:50.038878  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 417336us
W20260709 12:15:49.992455  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 247330us
I20260709 12:15:49.994220 15141 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:15:50.051970 15317 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:50.052649 15319 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:50.054122  8924 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:50.055285 14979 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.014504 15230 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.061197  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.067859 14979 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:50.073819  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:50.078588  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.082947  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.085218 15073 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.074357 14979 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:50.070955 15141 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:15:50.081519 15313 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:50.088637 15252 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:50.092298 15313 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:50.105620 15252 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.107870 15252 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:50.108307  8921 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:50.110220  8921 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:50.116729 15212 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:50.117295 15212 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:50.119653 15313 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:50.118474 15252 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.090652 15230 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.090127 15314 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.118323 15212 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.090219 15301 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:50.135883  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.141780 15045 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:15:50.144680  8916 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:50.147832 15213 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:50.136791 15314 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.132488 15315 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:50.171934  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.173100 15252 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.175398 15252 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.176080 15202 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.175881 15252 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.176604  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.178103  9068 pending_rounds.cc:85] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 8
I20260709 12:15:50.178478  9068 pending_rounds.cc:107] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:15:50.178651 14927 raft_consensus.cc:493] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:50.179937  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:50.178721  9068 raft_consensus.cc:2889] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:50.173588  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 279664us
I20260709 12:15:50.169214 15212 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:50.182935  9037 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:50.178021 15252 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.176597 15202 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.192436 15222 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:50.169801 15219 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:50.201789 15219 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.204144 15219 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.163646 15296 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:50.204718 15296 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:50.205626 15296 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.206713 15296 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:50.194340 15213 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:50.207458 15219 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:50.198380 15314 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.189651 15299 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:50.196961 15202 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.207489 15252 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.179322 14927 raft_consensus.cc:515] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.211602  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.207557 15213 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.216514  9037 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.233485  9037 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.263921  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.265462  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.268256  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.232124 15202 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.272976 15202 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.279508 15326 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:50.215481 15222 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:50.283829 15327 log.cc:927] Time spent T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:50.284160 15222 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.270006 15325 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:50.272008 15317 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:50.235387 15219 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:50.180382 15315 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.292075 15315 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.186291 14979 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.271394 15215 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:50.296487 14927 leader_election.cc:290] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.294786 15313 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.210150 15252 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:50.355808  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 272897us
I20260709 12:15:50.275141 15202 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.286885 15242 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:15:50.371093  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 218500us
W20260709 12:15:50.373258  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.375842  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.376623  8916 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:50.360054  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:50.382248  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:50.386874  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.387007  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:50.387548  9072 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:50.366881 15213 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.401650 15252 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.403501  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.404064  9073 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:50.407052 14819 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.412770  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.412948  9073 raft_consensus.cc:2468] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
W20260709 12:15:50.414326 15324 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.362s	user 0.000s	sys 0.002s
I20260709 12:15:50.414247  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.415169 15234 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:50.415602 15234 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.415974 15234 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:50.416365  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:50.417196 15059 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:50.417698 15059 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:50.419869  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.417321  9073 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:15:50.389530  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:50.421567  8918 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:50.422029 15320 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:50.422456 15320 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:50.422806 15320 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:50.389041  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.397491  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.384773 15313 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.381134 15073 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:15:50.427865 14859 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.399839  9071 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:15:50.428397 14859 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:50.420632  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:50.428704  8918 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:50.433645 15234 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.392311  9072 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:15:50.435619 15320 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:50.438112  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 169939us
I20260709 12:15:50.428781 14859 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:50.443101  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.446103  9588 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:50.452082  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.383744 15302 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:50.459015  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.418484 15059 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.462711  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.469869  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.444520 15230 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:50.471174  9590 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.473595 15302 raft_consensus.cc:2804] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:50.475348 14859 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.480535 15234 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.471623 15242 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:50.485090 15242 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.485463 15120 raft_consensus.cc:3055] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:50.485992 15120 raft_consensus.cc:740] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:50.489310  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:50.489945  8918 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:50.489845  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.487051 15120 consensus_queue.cc:260] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.493160 14769 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:50.464013 15252 raft_consensus.cc:2804] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:50.464198 15328 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:15:50.497988  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.497936  8918 raft_consensus.cc:2468] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:50.499966  9040 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:50.467645 15301 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:15:50.472498 15059 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:50.496244 15230 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.496450 15242 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.519873 15214 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.520531 15214 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.522413  8999 raft_consensus.cc:1275] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:15:50.498158 15252 raft_consensus.cc:697] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:50.523785 15140 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.524298 15140 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.524183 15252 consensus_queue.cc:237] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:50.527595  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.528787  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.529227  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.522912 15214 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:50.529541  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.526552 15140 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.533129 15320 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.533237 15169 consensus_queue.cc:1059] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:50.535461 15224 raft_consensus.cc:3055] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:50.535982 15224 raft_consensus.cc:740] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:50.536980 15224 consensus_queue.cc:260] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.538132 15224 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:50.542230 15010 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:50.544714  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 92714.9us
I20260709 12:15:50.545015 15317 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:50.549957  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.551824  9073 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:50.552030  9070 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:50.552124  9067 raft_consensus.cc:1275] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:50.554740  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:50.552249  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52363.1us
I20260709 12:15:50.555066  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:50.561592  9073 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:50.562686  9073 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:50.562897  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.564574  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:50.567672  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 373688us
I20260709 12:15:50.568774  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.569542  8993 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:50.529567 15212 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.573074  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:50.573813  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.585322 15146 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:50.588485 15322 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.421s	user 0.004s	sys 0.000s
I20260709 12:15:50.590319 15214 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:50.590965 15214 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.593922 15214 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:50.594770 15318 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:50.595528 15318 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.598044 15318 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:50.605762  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.607067  8994 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:50.618739  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.620139  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.622520  8994 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:50.623515  8999 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:15:50.623978  8999 pending_rounds.cc:85] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 12
I20260709 12:15:50.624272  8999 pending_rounds.cc:107] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:15:50.624565  8999 raft_consensus.cc:2889] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:50.553776 15230 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.632885  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:50.601267 15317 raft_consensus.cc:2804] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:15:50.643296  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 147785us
I20260709 12:15:50.650511  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.650607  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.647660  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.652866  8994 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:50.654901  8992 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:50.655493  8992 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:50.658898  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.660158  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:50.621838 15214 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:50.621583 15242 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.579795 15140 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:15:50.665838  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.672883  8995 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:50.673121  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.671835  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.673992  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.656497  8992 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.678138  8992 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:50.679642  8916 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:50.661425  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.681041  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.687049  9618 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:50.688077  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.689529  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:50.621583 15212 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.677537 15242 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.702873  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:50.681821 15066 consensus_queue.cc:1048] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:15:50.760365  8998 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:50.671689 15317 raft_consensus.cc:697] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:50.663064 15146 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:15:50.682621 15303 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:50.705344 15108 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:50.666293 15233 consensus_queue.cc:1059] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:15:50.762933  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.775964  8992 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:15:50.778209  9587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.807585  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.785048  8964 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:50.787992  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.796988  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 304882us
I20260709 12:15:50.797423  8993 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:50.798525  8995 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:15:50.813779 15341 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:15:50.768989 15259 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.839254  9618 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 18. Current term is 19. Ops: []
W20260709 12:15:50.855116  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 161137us
W20260709 12:15:50.843912  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 58984.9us
W20260709 12:15:50.854907  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.769038 15213 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:15:50.859165  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 51659.7us
I20260709 12:15:50.861142  8998 raft_consensus.cc:1240] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:50.854358 15311 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:50.863380 15335 log.cc:927] Time spent T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:15:50.863476 15311 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:50.860483 15323 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:50.866937 15311 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.872390  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:50.873409  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.875850 15318 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:50.877398 15212 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:50.879269 15317 consensus_queue.cc:237] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:50.860175 15214 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:50.824250 15234 consensus_queue.cc:1048] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:15:50.882043  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.930737  9624 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:50.902948  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.826514 15120 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:50.906631  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:50.932210  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:50.932272  9620 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:15:50.933396  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:50.907498  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 381330us
I20260709 12:15:50.907753  8922 raft_consensus.cc:1240] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:50.936798  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 470814us
W20260709 12:15:50.938858  9069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.026s
I20260709 12:15:50.882197 15125 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.911588 14819 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:50.944914  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.948984  9072 raft_consensus.cc:1275] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:50.808408 15303 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:50.951153  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.949378  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:50.952826  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.941285  9069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.026s
W20260709 12:15:50.949982  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67501us
I20260709 12:15:50.902067 15213 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.938381 15122 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.881855 15259 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:50.949991  8963 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.000712  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:50.946133 15302 raft_consensus.cc:697] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:51.004419  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.005262  9617 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:50.963608 15299 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.016623  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:51.049707  8998 raft_consensus.cc:3060] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:51.017592  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.019810  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.020533 15071 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:50.949429 15125 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.023737  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:50.972813 15242 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:51.013733 15339 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:15:51.036326 15213 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.039496 15303 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:51.041066 15059 consensus_meta.cc:287] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.001s
I20260709 12:15:51.051338  9617 raft_consensus.cc:2393] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:15:51.022938 15343 log.cc:927] Time spent T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:51.069242  9622 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:51.006310 15122 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.054303 15299 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.089087 15259 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.089352 15125 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.090046 15299 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.079416 15302 consensus_queue.cc:237] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.134714 15225 raft_consensus.cc:3055] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:51.135438 15225 raft_consensus.cc:740] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:51.136561 15225 consensus_queue.cc:260] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.137948 15225 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:51.140159 15122 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.198812  8923 raft_consensus.cc:2393] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
W20260709 12:15:51.201382  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.204715  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58556 (request call id 3759) took 1028 ms. Trace:
I20260709 12:15:51.205405  9068 rpcz_store.cc:276] 0709 12:15:50.176539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.177604 (+  1065us) service_pool.cc:224] Handling call
0709 12:15:50.177896 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:50.187585 (+  9689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:50.187618 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:50.188190 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 12:15:50.442715 (+254525us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:50.553142 (+110427us) log.cc:844] Serialized 14 byte log entry
0709 12:15:51.203326 (+650184us) log.cc:844] Serialized 14 byte log entry
0709 12:15:51.203935 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.204087 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.204189 (+   102us) raft_consensus.cc:1685] finished
0709 12:15:51.204204 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.204458 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160874,"prepare.queue_time_us":275303,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":124815,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":21718,"thread_start_us":702910,"threads_started":2,"wal-append.queue_time_us":494763}
W20260709 12:15:51.208606  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:51.210227  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 260102us
W20260709 12:15:51.212373  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 298487us
I20260709 12:15:51.235909 15298 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:51.243999 15340 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.237308 15316 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.245365 15316 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:51.241067  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.216187  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:51.238483 15140 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:51.238060 15059 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:51.252653 15059 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.254812 15252 consensus_queue.cc:1059] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:51.235158 15169 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:51.256821 15328 raft_consensus.cc:3055] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:51.256522 15169 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.257318 15328 raft_consensus.cc:740] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:51.213565  8992 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 16. Current term is 17. Ops: []
W20260709 12:15:51.212913  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 249950us
I20260709 12:15:51.258826 15328 consensus_queue.cc:260] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.261209  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45518 (request call id 1100) took 1433 ms. Trace:
I20260709 12:15:51.264452  9066 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:15:51.237625 15299 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.266230 15299 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.215384  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.261730  8919 rpcz_store.cc:276] 0709 12:15:49.828475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.828762 (+   287us) service_pool.cc:224] Handling call
0709 12:15:49.829146 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:49.832439 (+  3293us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:15:50.540007 (+707568us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800447ee0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b30e07 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f39896333c7 00007f3985c459a7 00007f3985c550bf 00007f3985c55038
0709 12:15:50.904810 (+364803us) log.cc:844] Serialized 14 byte log entry
0709 12:15:51.201236 (+296426us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:51.202571 (+  1335us) log.cc:844] Serialized 26 byte log entry
0709 12:15:51.202917 (+   346us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:51.203029 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.203216 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.247455 (+ 44239us) raft_consensus.cc:1685] finished
0709 12:15:51.260735 (+ 13280us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.260960 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20832,"prepare.queue_time_us":1128262,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":21657,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":19464,"spinlock_wait_cycles":2610560,"thread_start_us":638690,"threads_started":2,"wal-append.queue_time_us":260126}
I20260709 12:15:51.283484 15169 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.284255 15328 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:51.290050  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.291361 15299 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.292936  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.293965  9618 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:51.316712 15059 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:15:51.319439 15202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.003s
W20260709 12:15:51.319960 15202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.003s
I20260709 12:15:51.322965  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:51.323822  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:51.335682  8995 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
W20260709 12:15:51.339972  9039 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.227198  8963 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.214553  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:51.355892  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.360682 15316 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.360412 15345 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:15:51.361892 14859 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:51.370054  8918 raft_consensus.cc:1275] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:15:51.381526 15169 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:51.388350  8998 raft_consensus.cc:2468] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
W20260709 12:15:51.391635  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.399598 15316 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.448674 15316 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:51.426798  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 199932us
I20260709 12:15:51.417789  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:51.438812  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.455685  9069 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:51.456315  9069 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:51.456786  8888 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:51.458323 15303 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:51.458758 15303 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.460317  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.461169  9622 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
W20260709 12:15:51.445268 15120 consensus_meta.cc:287] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.502s	user 0.015s	sys 0.000s
I20260709 12:15:51.447351 15298 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:51.441450  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.459138 15303 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:51.473803  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.472522  8923 raft_consensus.cc:606] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:51.469113 15316 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.470834 15298 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:51.485837  8923 raft_consensus.cc:614] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:51.486294  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.496717  9620 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:15:51.522898  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:51.550253  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:51.559446  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 67554.7us
I20260709 12:15:51.564764 15346 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:51.551064  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.576351  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:51.578138  9074 consensus_meta.cc:287] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.002s
I20260709 12:15:51.578527  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.578855  9070 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:15:51.581523 15066 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.583563 15212 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.489019 15169 consensus_queue.cc:1059] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
W20260709 12:15:51.584787  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 98745.2us
I20260709 12:15:51.605954  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.593706 15328 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:51.597823 15316 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:51.601989  8964 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.603356  9074 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:51.605211  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.615764 15066 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.620425 15066 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.615926 15316 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:51.635767 15316 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:51.643870 14769 consensus_queue.cc:1048] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:15:51.645190  8818 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 334) took 19750 ms (client timeout 15000 ms). Trace:
I20260709 12:15:51.644845 15212 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.647755  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.648499  9619 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:51.650195  9067 raft_consensus.cc:1240] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:15:51.652252  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.653038  9068 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:51.664825  8815 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:51.667498  8993 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:15:51.670483 15379 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:15:51.671641 15233 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:51.674027  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.673290  8815 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 7 to 14, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:51.675500 15148 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:51.676266 15148 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:51.677970  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76178.8us
I20260709 12:15:51.677911  8815 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:51.678771 15066 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:51.679040  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.679622 15202 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:51.679718 15066 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:51.680477 15202 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.680691 15066 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.681689 15328 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.683029 15122 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:51.684026 15066 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.684562 15328 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:51.684711 15066 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:51.684923  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:51.685804  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 80797.3us
I20260709 12:15:51.687088  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.687230 15233 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.688805 15233 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:51.688251  8815 catalog_manager.cc:5697] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 12 to 16, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:51.689383  8963 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.689601 15233 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:51.692030  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:51.692421  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.693158  9066 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:51.693619  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:51.696950  8924 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:15:51.697754 15298 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.699393 15233 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.699481 15320 consensus_queue.cc:1059] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:15:51.605531 15346 consensus_queue.cc:1048] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:15:51.700552  8815 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:51.701282 15320 raft_consensus.cc:3055] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:51.701746 15320 raft_consensus.cc:740] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:51.701656 14927 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:51.683796 15122 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:51.706619  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.655405 15212 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:51.678045 15382 log.cc:927] Time spent T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:15:51.702364  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.718967  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:51.719933  8924 raft_consensus.cc:606] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:51.720377  8924 raft_consensus.cc:614] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:51.702210  8815 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 10 to 13, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:51.738605  8815 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 4 to 15. New cstate: current_term: 15 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:51.645597  8818 rpcz_store.cc:269] 0709 12:15:31.894235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.894457 (+   222us) service_pool.cc:224] Handling call
0709 12:15:51.644913 (+19750456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:46.035329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:46.098604 (+ 63275us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:46.104765 (+  6161us) write_op.cc:435] Acquired schema lock
0709 12:15:46.106789 (+  2024us) tablet.cc:662] Decoding operations
0709 12:15:46.291740 (+184951us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:46.291829 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:46.291856 (+    27us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:15:46.294182 (+  2326us) tablet.cc:701] Row locks acquired
0709 12:15:46.294231 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:15:46.294408 (+   177us) write_op.cc:270] Start()
0709 12:15:46.294555 (+   147us) write_op.cc:276] Timestamp: P: 1783599346294343 usec, L: 0
0709 12:15:46.298129 (+  3574us) op_driver.cc:348] REPLICATION: starting
0709 12:15:46.349875 (+ 51746us) log.cc:844] Serialized 10455 byte log entry
0709 12:15:46.874344 (+524469us) op_driver.cc:464] REPLICATION: finished
0709 12:15:47.063101 (+188757us) write_op.cc:301] APPLY: starting
0709 12:15:47.063223 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:47.101121 (+ 37898us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:47.101240 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:47.198410 (+ 97170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:47.198829 (+   419us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 12:15:47.198884 (+    55us) write_op.cc:312] APPLY: finished
0709 12:15:47.258471 (+ 59587us) log.cc:844] Serialized 236 byte log entry
0709 12:15:47.270892 (+ 12421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:47.308594 (+ 37702us) write_op.cc:454] Released schema lock
0709 12:15:47.318988 (+ 10394us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:47.326618 (+  7630us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:47.326651 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5817,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":172696,"apply.run_cpu_time_us":34745,"apply.run_wall_time_us":265353,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117149,"num_ops":27,"prepare.queue_time_us":757000,"prepare.run_cpu_time_us":55317,"prepare.run_wall_time_us":596749,"raft.queue_time_us":107011,"raft.run_cpu_time_us":29252,"raft.run_wall_time_us":244106,"replication_time_us":516103,"thread_start_us":742382,"threads_started":4,"wal-append.queue_time_us":262554,"wal-append.run_cpu_time_us":23732,"wal-append.run_wall_time_us":1719685}]]}
I20260709 12:15:51.740893 15202 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:51.771754  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:15:51.773053  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 69302.3us
I20260709 12:15:51.776168  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.776639  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.777359  8992 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 15.
I20260709 12:15:51.777907  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:51.778834 15142 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:51.779554 14927 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:51.779965 14927 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:51.780323 14927 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:51.778682  8815 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 12 to 14, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 14 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:15:51.784157  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 47952.2us
I20260709 12:15:51.784104  8815 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:51.788393 15142 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:51.791802  8993 raft_consensus.cc:1240] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:51.741432  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.702740 15320 consensus_queue.cc:260] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.744529  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.793470  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:51.749086 15303 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.749563 15148 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.724887  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.765781  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.736272  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:51.804607  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.806682  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:51.806913  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:51.813889  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.814813  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.820228  8992 raft_consensus.cc:2410] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:15:51.821163  9037 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.821492 15142 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:51.821969 15142 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.822358 15142 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:51.822791  9037 leader_election.cc:304] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.824574 15213 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:51.825323 15213 raft_consensus.cc:2749] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.826063 15148 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:51.825970  9587 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:51.827762 14769 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.832247  8994 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.835309  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:51.835959  8916 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
I20260709 12:15:51.838395 15148 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:51.839519 15302 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:51.840409  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:51.847046  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 177826us
I20260709 12:15:51.848771  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:51.839809  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:51.855342  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 110941us
I20260709 12:15:51.857203  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.857985  9618 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:51.858690  9618 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:15:51.860013  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.843734  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:51.840018 15299 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.869544 15213 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:51.844276 15298 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.878338  8993 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:51.874403  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:51.886445  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60708.9us
I20260709 12:15:51.884910  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:51.883227  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 60514.4us
I20260709 12:15:51.861599 15302 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
W20260709 12:15:51.905200  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 47789.8us
I20260709 12:15:51.883759 15213 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:51.906468  9619 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:51.917084 14722 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:51.917577 14722 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:51.917984 14722 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:51.919325  8996 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:51.919651 15212 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:51.919900 15302 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.926549  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:51.928647  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:51.929661  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:51.930253  8921 raft_consensus.cc:606] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:51.932142  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 250835us
I20260709 12:15:51.908659 15298 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:15:51.934427  9589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.914407 15213 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:51.889995 15299 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:51.788403  8815 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 12 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:51.944408  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:51.947146  8966 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.945106  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:51.945139  8921 raft_consensus.cc:606] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:51.960547  9037 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:51.971335  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 86580.8us
I20260709 12:15:51.971164  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:51.978919  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 92983.1us
I20260709 12:15:51.963661 15303 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.983336  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:51.984030  8923 raft_consensus.cc:606] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:51.984372  8923 raft_consensus.cc:614] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:51.986236  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:51.974120 15316 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:51.988615  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:51.989694 15316 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:51.990554 15308 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:51.990965 15308 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.989728  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:51.991402 15308 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:51.992551 15299 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.006779 15320 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:52.007416 15388 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:52.011214  8997 raft_consensus.cc:3055] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:52.011795  8997 raft_consensus.cc:740] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:52.012975  8997 consensus_queue.cc:260] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.013973  8997 raft_consensus.cc:3060] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:52.016613 15317 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:52.030257  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 85324us
I20260709 12:15:52.032142  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:52.032583 14722 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.033869 15059 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:52.034468 15345 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:51.979148 15071 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:52.035619  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.046152  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.028388  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.025496 15142 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.047101 15059 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.052549  8888 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.053097 15120 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:52.054131 15281 raft_consensus.cc:993] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:52.028561 15388 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:52.058053 15122 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.061620  8815 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 9 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.088601 15140 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.089191 15140 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.090198 15122 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:52.090742 15122 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.091322 15140 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.066411 15345 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:52.070294 15059 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:15:52.093148  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47069.8us
W20260709 12:15:52.096311  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 148287us
I20260709 12:15:52.092345 15281 raft_consensus.cc:1081] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:52.086133 15202 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:52.094293 15066 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:52.079725 15169 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.109056 15169 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.111419 15169 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.112378 15202 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.115207 15202 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.117581 15142 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.123163 15122 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:52.121585 14722 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.124112  8964 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:52.128432  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.128717 15213 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.130405  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.120319  8815 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 11 to 12, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 12 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.096336 15316 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:15:52.131986  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.122543  8997 raft_consensus.cc:1275] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:15:52.133745 15393 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:52.133949 15140 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.134238 15393 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.134680 15393 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:52.140260  8815 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:15:52.140828  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 114601us
I20260709 12:15:52.141022 15345 consensus_queue.cc:1048] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:52.141762  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:52.143431 15169 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:52.143857 15169 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.144275 15169 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:15:52.145126 15225 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:15:52.131947  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.103466 14927 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.151768  9618 raft_consensus.cc:1240] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:52.151854  9617 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:52.152477 15120 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:52.161886  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 65588.1us
I20260709 12:15:52.146829 15316 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:52.166715  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 225722us
I20260709 12:15:52.169945  8888 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.172240 15148 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:52.174067  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:52.174371 15233 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.174940 15317 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:52.175479 15317 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:52.175026 15233 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.177429 15233 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.180236 15317 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.178290 15390 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.171044 15066 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.171150 15316 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:52.196020  9037 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:52.177868 15212 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:52.214080  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44236.6us
I20260709 12:15:52.215488  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:52.221138 15066 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:52.222389  8965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.222287 15317 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.223696 15066 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.223965 15169 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.224424 15317 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.224329 15066 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.181705  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:52.227936  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54495.8us
I20260709 12:15:52.245896  8918 raft_consensus.cc:1240] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:52.222380 15398 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:52.251792  9069 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:15:52.260195  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.261009  9067 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:52.184876 15390 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.192504 15308 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.265404  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.283982  9065 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:52.265688  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.221192  8815 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 9 to 18. New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.271355 15066 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.277856 15393 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.245298 15212 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.296254 15405 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.296787 15405 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.298768 15405 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.308727 15066 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.312055 15140 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:52.313299  8815 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 18 to 19, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 19 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:15:52.316088 15397 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:15:52.316934 15393 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.319578  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.264109 15213 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.325225  8921 raft_consensus.cc:2393] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:52.327057  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.327069  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.292889 15059 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.278914 14927 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.279153 15233 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.280020 15406 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.262341  8966 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.285969  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:52.287763  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 91887.8us
I20260709 12:15:52.290593  8924 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:52.329357  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.294436 15328 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.334263 15169 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.334187  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.335934  9071 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 7.
I20260709 12:15:52.339102  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.341836 15316 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.342939  8923 raft_consensus.cc:1275] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:52.343329 15066 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.343598 15328 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.343864 15066 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.345585  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.347230 15316 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.347930  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.349558  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.345796 15328 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.351203  8889 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.352468 15125 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:52.352840 15125 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.353163 15125 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.356389 15390 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.277854 15388 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:52.360256  9624 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:52.360484  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.361793 15308 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.362185  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:52.375818  9074 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:52.376631  9037 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.377377 15252 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.377810  9037 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.377905 15252 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.378654 15071 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:52.378764 15142 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:52.379225 15328 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:52.334846 15233 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.379272 15202 raft_consensus.cc:2749] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:52.379422 15213 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:52.367671 15340 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.379343 15071 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.382061 15212 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.367980  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.383821 15071 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.384280 15059 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:52.368494 15406 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.384755 15328 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.386535 15406 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.368008  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.387522  9069 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:52.387352 15317 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:52.388334 15252 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.379315 15142 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:52.381839 15340 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.388957 15142 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.381040 15345 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:52.390415 15340 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.345886 15066 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.390749  9617 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:52.381417 15233 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.390767 15345 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.391812 15328 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.393656  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.393761 15345 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.394299 15345 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:52.314898  8815 catalog_manager.cc:5697] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 12 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.394755  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.395627  9622 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 20: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:52.395877  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.396427  9066 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:52.396692  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.396214  8815 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.398188  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.398990  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.400488  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.404312  8919 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
I20260709 12:15:52.401859  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.409752  9065 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:52.408067  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:52.410981  8964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.411533  9620 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 20: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:52.411484  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.415380  9621 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:52.421063  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.408776 15281 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:52.426542  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.421409  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.429714  9065 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:52.425021  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.424338  9617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.430434  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.398627  8815 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:52.437897  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.440039  9071 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:52.447566  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.448028  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:52.451148  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 188888us
I20260709 12:15:52.454492  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.409437 15316 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:15:52.414480 15317 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.442742 15328 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:52.394775 15345 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.446786 15299 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.441788 15390 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:52.479305  8889 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.431703 15059 consensus_queue.cc:1059] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:15:52.482574  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.487987 15234 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:52.488690  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.488245  8815 catalog_manager.cc:5697] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:52.489739  8815 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 7 to 16, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:52.493461 15252 raft_consensus.cc:3055] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:52.493923 15252 raft_consensus.cc:740] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:52.482903  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.495003 15252 consensus_queue.cc:260] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.496472 15252 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:52.470906 15328 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.471287 15398 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:52.508190  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 56321.1us
I20260709 12:15:52.513471  9074 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:52.482895 15169 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:15:52.456374 15202 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:15:52.519496 14984 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:52.483413 15066 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.520499 15066 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.522689 15066 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.486486 15299 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.526388 15299 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.533111 14984 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:52.534866  9590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.538987 15059 consensus_queue.cc:1048] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:52.545989 15345 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.507874 15328 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:52.469215 15317 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.549804  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.550007 15316 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:52.551954 15317 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:52.553540  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.554595 15407 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.555176 15407 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.555631  9067 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:52.534521 15344 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:52.534284 14984 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.557837 15344 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:52.558300 15344 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:52.547077  9069 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
I20260709 12:15:52.514760  9040 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:52.563743  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53900.6us
W20260709 12:15:52.565306  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50633us
I20260709 12:15:52.570156  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:52.570916  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.570168  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:52.572373  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 56735.5us
I20260709 12:15:52.573613 15281 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.574043 15281 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:52.574590  9067 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:52.557264 15407 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.578321  9618 raft_consensus.cc:1240] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:52.578320 15066 raft_consensus.cc:493] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:52.579695 15066 raft_consensus.cc:515] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.581790 15066 leader_election.cc:290] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.579023  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.578236  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.577212  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.584163  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:52.584947  9617 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:15:52.587649  9619 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:52.514432 15142 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.590044 15142 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.590446  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.582460 15125 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.594094 15302 consensus_queue.cc:1059] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:52.594916 15302 raft_consensus.cc:3055] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:52.595264 15302 raft_consensus.cc:740] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:52.595470 15125 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:52.595690 15412 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.003s
I20260709 12:15:52.582551  8996 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:15:52.601166  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.575300 15398 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:52.607278 15202 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.607729 15398 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:52.607842 15202 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.608685 15398 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.609939 15202 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:52.606897  9618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.604245  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.612022  9618 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:52.605507  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.606887  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.617357  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.625051 15066 consensus_queue.cc:1059] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:52.626266 15066 raft_consensus.cc:3055] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:52.626705 15066 raft_consensus.cc:740] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:52.629328  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.630081  8923 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 12.
I20260709 12:15:52.577571 15344 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.631664 15344 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.632190 15066 consensus_queue.cc:260] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.633481 15066 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:52.637151  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.640041  9040 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.652841  8993 raft_consensus.cc:3060] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:52.634665 15328 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.666198  9623 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:15:52.666468 15125 consensus_queue.cc:1059] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:52.667304 15328 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:52.667806 15418 raft_consensus.cc:3055] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:52.663957  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:52.669592  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:52.670778  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 88486.3us
W20260709 12:15:52.671501  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 192282us
W20260709 12:15:52.672670  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.681461  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.684026  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.652117 15388 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:52.596231 15302 consensus_queue.cc:260] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.688228  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.689081  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.689275 15225 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.689987  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.690768 15406 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:52.691268 15403 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:52.691459  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.691974 15407 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:52.673825 15125 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:52.692842  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.698261  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.700397  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.701118  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.725418  8998 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.702950  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.681455 15148 consensus_queue.cc:1059] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:15:52.672369 15142 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:52.704419 15415 log.cc:927] Time spent T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 12:15:52.705543  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.708716  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.709028  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.711611  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.716209  9616 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:15:52.668268 15418 raft_consensus.cc:740] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:52.719444  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.724673  8922 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:52.720181  8889 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.736052  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.738831  8992 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:52.740356  8923 raft_consensus.cc:1240] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:52.742869  8924 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:52.747293  8889 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.748862  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.754158  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.724326 15406 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.756418  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.757604  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.758860  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.729878 15142 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.763478  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.764088  8997 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:52.765048  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.766098  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.766788  8995 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:52.767714  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.745932 15302 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:52.762154 15406 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:52.741010 15405 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:52.777217  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.774240  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.777774  8991 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:52.778105  9074 raft_consensus.cc:2393] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:52.778337  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:52.778596  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.780961  8997 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:52.756284 15298 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:52.751792 15125 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:52.776592  8992 raft_consensus.cc:2393] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:52.764619 15120 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:52.770380 15142 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.785735  9070 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 18: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:52.745098 15225 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:52.784829 15424 log.cc:927] Time spent T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:15:52.813057  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.813689  9074 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:52.817047  8966 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.810755  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.817926  8997 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 12.
I20260709 12:15:52.816672  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:52.821540  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:52.822738  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.822860 15299 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:52.823122  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.826026  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.827443  8998 raft_consensus.cc:2468] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:52.831306  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.832291  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:52.838469 15419 log.cc:927] Time spent T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:15:52.843384 15259 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:52.844347  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.774995 15407 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.849591 15407 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:52.851859 15388 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:52.811846 15418 consensus_queue.cc:260] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:52.853906  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.855968  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:52.857618  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:52.858413  8997 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:52.855083  8992 raft_consensus.cc:2393] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 17: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:52.819484 15120 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:52.867798  8992 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:15:52.868222 15120 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.824054 15405 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.881392  8966 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.882139 15344 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:52.884745  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:52.884907  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 124313us
I20260709 12:15:52.885394  8997 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:52.887714  8888 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:52.805215 15298 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:52.885033  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:52.897675  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.898065  9587 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.899042  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:52.899840  8916 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:52.907459 15148 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:52.907946 15148 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.908366 15148 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:52.911217 15071 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:52.912707  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 112612us
I20260709 12:15:52.907845  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:52.870957  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:52.926460  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 55655.5us
I20260709 12:15:52.932284  8995 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 16.
W20260709 12:15:52.947599  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48619us
I20260709 12:15:52.948688  9587 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.952471  8991 raft_consensus.cc:2410] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:15:52.953835  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ba05ad5deb4210a163e266631b3e67" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:52.896369 15345 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.924782 15388 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:52.950822 15122 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:52.978662  8997 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:52.970157 15388 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.957449 15066 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:53.013335 15298 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.965723 15346 raft_consensus.cc:2804] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:53.068282  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:52.957252 15252 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:52.964679 15125 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.086730  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.074214 15148 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:52.977097 15345 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.090499  8993 raft_consensus.cc:1275] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:15:52.968981  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 270769us
W20260709 12:15:53.077132 15281 consensus_meta.cc:287] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.503s	user 0.002s	sys 0.012s
I20260709 12:15:53.085474 15388 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.120532  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.122064  9616 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:53.080574  8997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:53.089277 15212 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:53.093879 15225 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.128650  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.119961  9619 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:53.128638  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.130502  9067 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.126333 15405 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.140909 15148 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.096413 15233 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.089423 15407 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:15:53.092867 15346 raft_consensus.cc:697] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:53.124006  8997 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:53.115904 15066 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.113688 15281 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.157166  8997 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.165854  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.159641 15435 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:53.119794 15169 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:53.181598 15122 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:53.182312 15122 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.165400 15406 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.184700 15122 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:53.184803  8999 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 18: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:53.186715 15345 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:53.187211  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:53.181821  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.142886 15142 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.193198  8992 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:15:53.196547  9065 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 12.
I20260709 12:15:53.200266  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.200932  8998 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 11.
I20260709 12:15:53.150846 15432 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:53.194896  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.210626 15317 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:53.211088 14984 raft_consensus.cc:3055] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:53.211323 15317 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:53.211632 14984 raft_consensus.cc:740] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:53.212069 15142 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:53.212770 14984 consensus_queue.cc:260] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.213938 14984 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:53.216986 15281 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:53.191407 15427 log.cc:927] Time spent T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:53.186754 15066 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.225454  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:53.212596 15317 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.225991  9067 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:53.283849  9616 raft_consensus.cc:1240] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:15:53.285909  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.292879  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:53.313766  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 227131us
I20260709 12:15:53.315302  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.319514  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:53.321691 15140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.021s
I20260709 12:15:53.325821  9624 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:15:53.326308  9624 pending_rounds.cc:85] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 14
I20260709 12:15:53.326804  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.327714 15233 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:53.318342  8997 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.335651  8999 raft_consensus.cc:1240] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:53.328933  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.317411 15066 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:53.326571  9624 pending_rounds.cc:107] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 19.15
W20260709 12:15:53.329275 15140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.007s	sys 0.021s
I20260709 12:15:53.342103  9624 raft_consensus.cc:2889] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:53.324810 15346 consensus_queue.cc:237] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:53.337277 15398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.028s	sys 0.048s
I20260709 12:15:53.348795  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.366350  8997 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:53.362603 15398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.029s	sys 0.048s
W20260709 12:15:53.369472  8888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.370688  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.348426 15390 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.380275  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.381179  8920 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 12.
W20260709 12:15:53.387468  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 263513us
I20260709 12:15:53.388371 15066 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.395370 15437 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:53.399443 15433 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:15:53.403679 15429 log.cc:927] Time spent T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.319s	user 0.000s	sys 0.003s
I20260709 12:15:53.422709 15125 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:15:53.441932 15388 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.443369  8991 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 in current term 13: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:53.449546  8963 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.450947 15066 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:53.451395 15066 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:53.451810 15066 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:53.452860 15320 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:53.453233 15418 raft_consensus.cc:3060] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.453629 15320 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.423581  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:53.458070  8924 raft_consensus.cc:2368] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:53.467334 15320 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.468895 15066 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.477319  9587 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:53.388129  8964 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:53.417078  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:53.419382  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:53.474743  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 246749us
W20260709 12:15:53.483795  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66847.2us
I20260709 12:15:53.481768  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:15:53.487984  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 99961us
I20260709 12:15:53.488920  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.496405  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.503788  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.506273  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.502941 15140 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:53.508877 15140 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:53.509182  9040 leader_election.cc:400] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:53.509306 15140 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.509537  9040 leader_election.cc:403] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:53.497782 15437 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.493232 15252 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:53.510946 15252 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.511432 15252 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.493062 14927 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.512041 14927 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.512583 15233 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:53.513700 15406 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.498703 15148 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:15:53.516305 15430 log.cc:927] Time spent T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.550s	user 0.000s	sys 0.002s
I20260709 12:15:53.528555  8888 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:53.535358  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.536566  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:53.536767  8921 raft_consensus.cc:1240] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 20. Current term is 21. Ops: []
I20260709 12:15:53.537497 15438 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.541164 15407 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:53.544333  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.544559  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.486395 15320 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.550624  8964 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.494534 15388 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.557250  9067 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:15:53.560222  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:53.562063  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.566181 15438 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:53.567886  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:53.568445  8925 raft_consensus.cc:3055] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:53.568763  8925 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:53.569464  8925 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.570324  8925 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.571610  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.575923  8918 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:53.576920  9070 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 13.
I20260709 12:15:53.578498  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:53.582719  8964 leader_election.cc:304] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:53.600620 15391 log.cc:927] Time spent T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.761s	user 0.005s	sys 0.000s
W20260709 12:15:53.605448  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44231.9us
I20260709 12:15:53.622629 15406 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.623176 15406 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.607535 15225 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.625869 15225 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.628135 15225 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.610882 15414 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:15:53.600644 15122 consensus_queue.cc:1059] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:15:53.612269 14927 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.575841 15437 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:53.598173 15390 raft_consensus.cc:2749] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:53.618561 15281 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:15:53.617861  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 89384.1us
I20260709 12:15:53.592891 15233 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:53.625056 15299 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:53.630319  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:53.669631  8925 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:53.630820  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:53.631786  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.633129  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.672676  8993 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:53.632908  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:53.673765  8992 raft_consensus.cc:2368] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:53.639341  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.639655  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.640048  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.640630  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.646656  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:53.646777  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.647017  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:53.641371 15405 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:53.677753  8918 raft_consensus.cc:2393] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 12: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:53.675707  9624 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:53.630476 15169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49430 (request call id 0) took 1782 ms. Trace:
I20260709 12:15:53.633774 15406 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.679970 15281 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:53.693660  8889 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:53.679546 15320 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.663501 15433 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.709936  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.710183  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.708235  9074 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:53.712090  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.713572 15281 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.714172  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.714825  9069 raft_consensus.cc:3060] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.715488  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.716071  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:53.716711 15453 log.cc:927] Time spent T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:15:53.720414 15344 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.721017 15344 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.720345  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:53.734417  9623 raft_consensus.cc:1240] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:53.733505 15393 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:53.754664 15393 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:53.704398 15405 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.755306  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.763049  9066 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:53.764441  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.765343 15302 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:53.765775 15302 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.766074  8992 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:53.766238 15302 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.741225  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.768229 15390 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:53.768600 15390 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.768932 15390 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.723121 15344 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.755836 15393 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:53.746121 15452 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:15:53.756705  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 63139.7us
I20260709 12:15:53.681661 15169 rpcz_store.cc:276] 0709 12:15:51.811326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.813307 (+  1981us) service_pool.cc:224] Handling call
0709 12:15:51.868820 (+ 55513us) log.cc:844] Serialized 487 byte log entry
0709 12:15:53.593686 (+1724866us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12414,"raft.queue_time_us":13294,"raft.run_cpu_time_us":1583,"raft.run_wall_time_us":1578,"thread_start_us":115462,"threads_started":1,"wal-append.queue_time_us":220763,"wal-append.run_cpu_time_us":1687,"wal-append.run_wall_time_us":1003770}
I20260709 12:15:53.724716  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.748907  9000 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:15:53.773818  8994 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:53.773910  9000 pending_rounds.cc:85] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Aborting all ops after (but not including) 9
I20260709 12:15:53.774374  9000 pending_rounds.cc:107] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:15:53.774641  9000 raft_consensus.cc:2889] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:53.776095  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:53.776793  9623 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:53.780474  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.756994 15405 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.734953 15416 raft_consensus.cc:3055] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:15:53.725384  9065 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 13: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:53.728403  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.800709  9069 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:53.727898  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.806214  9067 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:53.724392  9621 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: []
I20260709 12:15:53.726999 15066 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.760165 15120 raft_consensus.cc:993] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:53.760710  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.762360  9074 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:53.795939  8966 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:53.666895 15140 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.804517  8917 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:53.805541  9623 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:53.829830  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:53.745249  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:53.816109  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 104074us
I20260709 12:15:53.792344  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.830440  8924 raft_consensus.cc:606] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:53.831719  9037 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.832234  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.837886  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:53.841696  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 49424.1us
I20260709 12:15:53.842720  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:53.804628 15416 raft_consensus.cc:740] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:53.829162  9073 raft_consensus.cc:2955] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:53.850379  8997 raft_consensus.cc:1240] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:53.811101 15298 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:15:53.840265 15405 raft_consensus.cc:2804] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:53.843205 15059 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:53.844664 15148 raft_consensus.cc:1081] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:53.725885 15433 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.846495 15417 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:53.846457 15202 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:53.847290 15066 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:53.844065 15437 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.865790  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:15:53.866360 15413 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:15:53.867096 15399 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:53.868532 15140 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.873085  8917 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:15:53.848443 15122 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:15:53.879710  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
W20260709 12:15:53.898856  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 63240.5us
I20260709 12:15:53.882385 15438 consensus_queue.cc:1059] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:15:53.897390 15281 consensus_queue.cc:1059] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:15:53.889449  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:53.880755 15417 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:53.901286 15252 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.899708  9620 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:15:53.892437 15066 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:53.879577 15405 raft_consensus.cc:697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:53.871313 15398 consensus_queue.cc:1048] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:15:53.877825 15418 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:15:53.893365 15416 consensus_queue.cc:260] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:53.903208 15454 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:15:53.910100 15148 raft_consensus.cc:3055] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:53.938935 15148 raft_consensus.cc:740] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:53.939792 15148 consensus_queue.cc:260] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.941124 15148 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.910524 15417 raft_consensus.cc:3060] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.944828  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.945858 15406 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:53.946285 15406 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.946679 15406 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:53.910941 14927 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:15:53.951385 15140 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:53.952059  8999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:53.952024 15140 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.952889  8999 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:53.953398  8999 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:53.952562 15439 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:53.954041 15439 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:53.954734 15140 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.956039  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:53.956722  9072 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 15.
I20260709 12:15:53.957175  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:53.957306  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:53.954946 15439 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.957618  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:53.957866  9616 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:53.958240 15439 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:53.915400  9615 raft_consensus.cc:2368] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:15:53.959327  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:53.959852  9588 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:53.960116  8916 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:53.916342 15066 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:53.912075 15437 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.917657 15252 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:53.923118  9070 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:53.924029  9066 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:15:53.962822 15437 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:53.928104 15433 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:53.963869 15434 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:53.928968 15405 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:53.935741 15416 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:53.936726  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:53.970274  8918 raft_consensus.cc:606] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:53.970572  8918 raft_consensus.cc:614] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:53.964334 15434 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.915482 15432 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:15:53.957877  8994 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.972800  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:53.979705 15259 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:53.971813 15434 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:53.981766 15259 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:53.985821 15390 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:53.993830  8963 leader_election.cc:400] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:15:54.038914  8963 leader_election.cc:403] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:53.994278 15437 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:54.046262 15437 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:54.046803 15437 raft_consensus.cc:3060] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:53.995712  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:53.998087  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:54.047591  8918 raft_consensus.cc:606] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:54.002269  8991 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:54.047956  8918 raft_consensus.cc:614] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:54.022946  8994 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:54.047708  9615 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:54.024326  8995 raft_consensus.cc:1275] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:15:54.029467  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.030398  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.052410  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:54.053054  8918 raft_consensus.cc:606] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:54.052335  8916 raft_consensus.cc:3060] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:54.055409 15302 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.057897 15302 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:54.059623  8924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "617ce264333c4b249320780af77038ce"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:54.060249  8924 raft_consensus.cc:606] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:54.060567 15140 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.061070 15140 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.061687  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:54.063601 15140 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:54.065938  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:54.066351  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 72696us
I20260709 12:15:54.066602  9073 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:54.069535  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:54.070642  8995 raft_consensus.cc:3060] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:54.070025  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:53.911933  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
W20260709 12:15:54.077093  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 165351us
I20260709 12:15:54.078105  9037 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.080612 15417 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.086221  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:54.086905  8916 raft_consensus.cc:2468] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:15:54.092741  9587 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:54.092141  9073 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:54.087674  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:54.075779  8999 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.101023  9588 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:54.101853  8997 raft_consensus.cc:1240] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:15:54.102769  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.106953  8995 raft_consensus.cc:2468] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:54.110018  9037 leader_election.cc:400] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 12 election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 12. Current term is 13.
I20260709 12:15:54.110008  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.114238  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.115191  8917 raft_consensus.cc:3055] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:54.115600  8917 raft_consensus.cc:740] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:54.075351 15403 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071) with higher term. Message: Invalid argument: T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for earlier term 12. Current term is 13.
I20260709 12:15:54.098282 14927 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:54.083016 15417 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:54.120105  8999 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:54.104501 15213 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:54.104372 15432 raft_consensus.cc:2804] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:54.069525 15434 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.108402 15407 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:54.111610 15122 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:54.126464  8917 consensus_queue.cc:260] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.122673  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.137321  8917 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:54.114039 15344 raft_consensus.cc:2804] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:54.156876 15344 raft_consensus.cc:697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:54.157989 15344 consensus_queue.cc:237] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.127117 14927 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.103933 15345 consensus_queue.cc:1048] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:15:54.138309 15407 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.146018 15406 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.155589 15066 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.166409  8917 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
W20260709 12:15:54.168519  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.176842 15066 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:54.177047  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 60320us
I20260709 12:15:54.179419 15398 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:54.126453 15413 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:15:54.183753  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.184681  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.185881 15437 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.190637  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.168387 14927 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:54.196895  9616 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:54.196882  8918 raft_consensus.cc:2468] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:15:54.198796  8992 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:54.170212 15407 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:54.168038 15432 raft_consensus.cc:697] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:54.203286  8997 raft_consensus.cc:1240] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:15:54.204368  8964 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:54.204535  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:54.210708 15403 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:54.211050 15437 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.211489 15434 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:54.214094  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.200858  8966 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:54.192648 15066 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:54.219202 14984 raft_consensus.cc:993] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:15:54.224062 14984 raft_consensus.cc:1081] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:15:54.219110  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:54.219635 15403 raft_consensus.cc:2804] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:54.225759 15403 raft_consensus.cc:697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:54.226648 15403 consensus_queue.cc:237] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.227958 15432 consensus_queue.cc:237] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.221151  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:54.208742 15405 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.208089 15140 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:15:54.209686  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:54.247813  9037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.259076  9615 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:54.261660  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:54.270605  9616 raft_consensus.cc:2468] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
W20260709 12:15:54.278818  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 69203us
I20260709 12:15:54.279646  8964 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.279701  8963 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:54.289295  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:54.291342  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:54.292856  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:54.314697  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48143.7us
I20260709 12:15:54.326056  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:54.326869  9070 raft_consensus.cc:3060] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:54.312498 15474 raft_consensus.cc:2804] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:54.261730 15169 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:54.281780 15212 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:54.332978 15474 raft_consensus.cc:697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:54.281957 15225 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.312309 15122 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:15:54.281944 15447 consensus_queue.cc:1059] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.088s
W20260709 12:15:54.411067  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.367906  9070 raft_consensus.cc:2468] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:54.354396  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.372575  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.414292  9615 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:54.360105 15407 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.436239  9000 raft_consensus.cc:1240] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:54.437637 15407 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.450335 15447 raft_consensus.cc:3055] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:15:54.450874 15447 raft_consensus.cc:740] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:54.451761 15447 consensus_queue.cc:260] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.453186 15447 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:54.355589 15474 consensus_queue.cc:237] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.368564 15406 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.342216 15390 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:54.462242  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 281192us
W20260709 12:15:54.471640  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 153778us
I20260709 12:15:54.395887 15212 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:54.334412 15140 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 12:15:54.440830 15437 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:54.505666  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.487534  9073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "617ce264333c4b249320780af77038ce"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:15:54.498471  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.506790  9073 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:54.507208  9073 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:54.510650  9066 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:54.521133  8924 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 19: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:54.522993  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.531440  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.532284  8917 raft_consensus.cc:2393] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 16: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:54.474201 15413 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.539516  9073 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.370355 15169 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:54.547006  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 234976us
W20260709 12:15:54.534754 15478 log.cc:927] Time spent T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:54.559235  9073 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:54.563207  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.566656  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:54.567386  8917 raft_consensus.cc:3055] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:54.567787  8917 raft_consensus.cc:740] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:54.550902 15413 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.557618 15140 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:15:54.558061 15122 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:54.558825 15414 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:15:54.591522  8917 consensus_queue.cc:260] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.734321  8917 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:54.747325 15299 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:54.747994 15299 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.750777 15299 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.752877 15169 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.729727 15212 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.589969  9040 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:15:54.660565  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 162160us
I20260709 12:15:54.758042  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.085292  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:54.761374  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:54.780925  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 191076us
I20260709 12:15:54.787220  9065 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:15:54.786348  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:54.792284  9069 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:15:54.794173  8924 raft_consensus.cc:2410] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:15:54.796224  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:54.798096  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:54.809222  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 264655us
I20260709 12:15:54.782507 15407 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:54.821419  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:54.822290  8995 raft_consensus.cc:3060] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:54.794667 15484 raft_consensus.cc:2804] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:54.832954  8917 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:54.671350 15122 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:54.839160  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 293119us
I20260709 12:15:54.841748 15484 raft_consensus.cc:697] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:15:54.841504 14927 consensus_meta.cc:287] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.002s
I20260709 12:15:54.855799  8918 raft_consensus.cc:1275] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:15:54.856076  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:54.842331  8817 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:54.867106  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:54.869216  8995 raft_consensus.cc:2468] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:54.872932 15066 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:54.873399 15066 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:54.874271 15066 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.875754  8922 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:15:54.877045 15474 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:54.847584 15413 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.881242  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:54.881465 15407 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:54.881865 15225 consensus_queue.cc:1048] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:54.882907 15407 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:54.885021 15122 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:54.888551 15066 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:54.894413 15484 consensus_queue.cc:237] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.871662 14927 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:54.899395  9068 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 16: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:54.881590  8964 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:54.899832  8817 catalog_manager.cc:5697] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 17 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:54.918779  8817 catalog_manager.cc:5697] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 14, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.920496  8817 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 12 to 16, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.922266  8817 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 18, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 18 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:54.924270 14927 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:54.925261  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 43742.8us
I20260709 12:15:54.921085  9073 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:15:54.907305  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:54.928711  9066 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:54.937433  9037 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:54.942778 15439 raft_consensus.cc:2804] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:54.943356 15439 raft_consensus.cc:697] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:54.944308 15439 consensus_queue.cc:237] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:54.936667 15403 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:15:54.948568  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 66464.3us
W20260709 12:15:54.948979  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 132598us
I20260709 12:15:54.958540  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:54.960175  8995 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:54.963070  9072 raft_consensus.cc:1240] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 18. Current term is 19. Ops: []
I20260709 12:15:54.964661  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:54.965302  9616 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 20: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:54.968508  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:54.969195  9616 raft_consensus.cc:2393] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 16: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:54.973102  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:54.974588  8993 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:54.974952  8995 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:54.986184  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:54.963208 15494 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:15:54.991356 15299 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:15:55.040189 15390 raft_consensus.cc:3055] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:15:54.984565 15308 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:15:54.991503 15399 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.061671  9619 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:15:55.062132  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.995713 15473 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:55.068447  8963 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
W20260709 12:15:55.069819  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 50322us
I20260709 12:15:55.074700  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.076285 15474 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:55.079582 15320 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.080135 15320 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.082831 15320 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:54.989347 15432 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:15:55.088753 15473 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.089205 15473 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:55.070953 15481 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.090276 15481 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.099383  9588 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:55.100910  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.012274 15302 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:15:55.081914 15492 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 12:15:55.113108  8917 raft_consensus.cc:1275] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:55.116513 15481 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.110105 15320 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.067526 15390 raft_consensus.cc:740] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:55.111824 15140 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:15:54.998883 15212 consensus_queue.cc:1059] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 12:15:55.137745 15302 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.145653  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.156623  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.150241  9071 raft_consensus.cc:1275] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:55.152881  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.098476 15225 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:55.167032  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.167737  9615 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:55.168144  9065 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:15:55.182667  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.183348  9068 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:55.187920  9068 raft_consensus.cc:2410] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 12:15:55.210650  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.219550  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.220149  9615 raft_consensus.cc:1813] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Handling vote request from an unknown peer 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:55.226047  9000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49092 (request call id 2089) took 1024 ms. Trace:
I20260709 12:15:55.226581  9000 rpcz_store.cc:276] 0709 12:15:54.201222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.201497 (+   275us) service_pool.cc:224] Handling call
0709 12:15:54.219702 (+ 18205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:54.436628 (+216926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.225746 (+789118us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002f5b54. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:55.225973 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497579392}
I20260709 12:15:55.234265 15498 consensus_queue.cc:1059] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:55.188819 15281 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.247368  9615 raft_consensus.cc:2393] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 20: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:55.175772 15225 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:55.254379  8963 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:55.276347 15302 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:55.257754 15140 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:55.218027 15212 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.317085  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:55.319835 15504 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:15:55.305230 15212 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:55.322495 15212 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:55.248749 15473 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.330588  8924 raft_consensus.cc:2368] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 20. Current term is 21.
I20260709 12:15:55.256477 15345 consensus_queue.cc:1048] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:15:55.332367 15390 consensus_queue.cc:260] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.334064 15390 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:55.340107  8817 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:55.341326 15473 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.341763  8817 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:55.252595 15281 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.346632 15281 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.317905  9071 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 21.
I20260709 12:15:55.367959  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:55.368916  9065 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:15:55.378832  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:55.383860  8817 catalog_manager.cc:5697] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 12 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 19 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:55.396407  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:55.388176 15493 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:55.406335  9065 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 21.
I20260709 12:15:55.407670  8889 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:55.390661 15413 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.428050  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.428709  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
W20260709 12:15:55.430356  8966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.432523  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.442901  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.436851  8995 raft_consensus.cc:1240] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:55.441847  8966 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:55.414414 14984 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:55.455953  8999 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:55.415591 15493 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:55.418670 15500 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.465255  8996 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:15:55.447872 15281 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:15:55.456903 15491 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.465629 15493 raft_consensus.cc:3060] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:55.507694 15496 raft_consensus.cc:3055] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:55.508308 15496 raft_consensus.cc:740] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:55.430480 15413 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.514277 15496 consensus_queue.cc:260] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.515818 15498 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.481606 15480 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.475397 15500 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.538940 15500 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.493427 15437 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:15:55.501538 15281 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:55.544330  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 102576us
I20260709 12:15:55.540781 15498 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.562431 15498 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:55.568463  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 103480us
I20260709 12:15:55.502133 15491 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.588532 15474 consensus_queue.cc:1048] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:55.588982 15516 log.cc:927] Time spent T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:15:55.591823  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:55.592422  9619 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:55.598372 15225 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:55.603359  9619 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 21.
I20260709 12:15:55.609026 15281 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.540661 15480 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.627713  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.628942  9073 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:15:55.630993  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.631749  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.633836  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.634140 15413 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.636235 15491 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.637638  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.633909  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:55.643747  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.652290  8917 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:55.655786  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.656709  9616 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:55.658712  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:55.659516  8925 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 21: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:55.668671  8924 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:55.673871  9040 leader_election.cc:400] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 20. Current term is 21.
I20260709 12:15:55.674357  9040 leader_election.cc:403] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:55.677981  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.679373  8916 raft_consensus.cc:1275] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:55.689419  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:55.692315  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.695080  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.695327  8994 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:15:55.698341  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.695735  9620 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:55.700520  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:55.700829  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.701627  8994 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:15:55.703725  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.704579  9620 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:55.707826  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:55.708590  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.709363  8996 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:15:55.709671  8924 raft_consensus.cc:1275] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:15:55.672941 15344 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:15:55.713761  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.683348 15302 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:55.694136 15417 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db for earlier term 20. Current term is 21.
I20260709 12:15:55.699776 15480 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.729715  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:55.705210 15474 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:15:55.750658  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 46470.9us
I20260709 12:15:55.718690 14984 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.758421 14984 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.721354 15225 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:15:55.759182 15202 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:15:55.760241 15417 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.763463 15417 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.758953 15390 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:55.765681 15417 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:55.760655 14984 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:55.752717  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 47455.7us
I20260709 12:15:55.770512  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:55.755654  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 52124.2us
I20260709 12:15:55.775693  9621 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:55.777851 15120 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:55.778586 15477 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:55.780364 15390 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:55.743525 15406 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.781877  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:55.739871 15302 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.785153  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.785763  8992 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 18.
I20260709 12:15:55.786310 15302 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:55.754858 15498 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:55.786998 15498 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.787374 15498 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:55.787905  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:55.745565 15474 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.792935  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:55.755190 15140 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:55.811206  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:55.812024  8998 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:55.811273  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:55.782842 15493 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.793893 15474 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:55.815456 15477 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.819353 14984 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:55.808534 15438 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:15:55.838058 15491 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:55.877534  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:55.821808 15308 consensus_queue.cc:1048] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:15:55.895156  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:55.853156 14984 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.898286 14984 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:55.854691 15477 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.854432 15524 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:55.875389 15120 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:55.911348  9074 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 19: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:55.907665 15496 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:55.914695  8916 raft_consensus.cc:2393] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 21: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:55.925034  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:55.919881 15140 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:55.880532 15491 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:55.939198  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:55.922729 15522 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.019703 15488 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.020406 15488 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:56.023803 15541 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:15:56.024456 15252 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.025000 15252 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:55.935757 15212 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.026996 15252 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:55.940135 15493 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.054229  9074 raft_consensus.cc:2468] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 21.
W20260709 12:15:56.060228 15532 log.cc:927] Time spent T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:15:56.065799 14984 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:56.077243  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.003254 15550 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:56.008920 15390 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.202059 15390 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:15:56.095737 15527 log.cc:927] Time spent T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:15:56.049736 15212 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.013628 15494 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.004902 15140 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.035318 15522 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:55.911000  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:56.205575 15543 log.cc:927] Time spent T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.171s	user 0.000s	sys 0.005s
I20260709 12:15:56.293907  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.294668  8993 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 16.
I20260709 12:15:56.296406  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:56.203258 15550 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:56.301064  9040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.289294 15477 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.366036 15550 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.396682 15140 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.269469 15494 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.399785 15494 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.401749 15212 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.403422 15390 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.405727 15320 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:56.406248 15320 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.406704 15320 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:56.408077 15544 log.cc:927] Time spent T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.150s	user 0.000s	sys 0.005s
I20260709 12:15:56.295270 15488 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.435597  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.441736  9620 raft_consensus.cc:2410] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:15:56.417877 14984 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:15:56.434401 15496 consensus_meta.cc:287] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:15:56.461066  9588 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:56.498842  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:15:56.497066 15498 consensus_meta.cc:287] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.002s
W20260709 12:15:56.498371 15474 consensus_meta.cc:287] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.004s
W20260709 12:15:56.499125 15549 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:15:56.532235  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:56.497949 15547 log.cc:927] Time spent T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:15:56.502470 15535 raft_consensus.cc:2804] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:15:56.587700 15535 raft_consensus.cc:697] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:56.590562 15308 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:56.567667 15212 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.591166 15308 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.591750 15212 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.593420 15308 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.593838 15212 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.595019  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.595726  9619 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:56.502398 15498 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.601632 15498 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.611681  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:56.612385  8996 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.531975 15403 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.567814 15390 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.622634  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.569321 15522 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.622269  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.612428 15125 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:56.571208 15474 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.590853 15535 consensus_queue.cc:237] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.626372 15390 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.645040 15555 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.648528 15555 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.648881  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:56.649482  9621 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.650830 15555 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.625247 15403 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.656351 15542 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:56.656880 15542 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.658972 15542 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.660719 15485 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.635651 15125 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.663071 15320 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.667115 15403 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.669273 15390 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.671141  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.696192  9619 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:15:56.696794  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.697908  9623 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:15:56.682416  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.685436  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:56.647800 15474 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.687255 15485 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.706252 15485 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.688306  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.707579 15320 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.699568  9615 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.708578 15125 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.709584 15120 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:56.710026 15120 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:56.687412 15550 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.713999 15550 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.701074  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.719825  9620 raft_consensus.cc:2393] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 17: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:56.721765  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.722304  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.719837  9621 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:56.725994  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.728667  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.738441  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:56.739109  9065 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 21.
I20260709 12:15:56.742357  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:56.743409 15405 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:56.743791 15405 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.744134 15405 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:56.746325  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:56.747313  8963 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:56.746402  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47314 (request call id 2945) took 1141 ms. Trace:
I20260709 12:15:56.747313 15393 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:56.753742  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.755990 15437 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:56.756428 15437 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.756763 15437 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:56.761945  9615 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:56.768357  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:56.752187  8920 rpcz_store.cc:276] 0709 12:15:55.604799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.607301 (+  2502us) service_pool.cc:224] Handling call
0709 12:15:55.607649 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.608015 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:15:55.795833 (+187818us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.908743 (+112910us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:56.735938 (+827195us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:56.736337 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:15:56.736495 (+   158us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:56.736534 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.736613 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.746147 (+  9534us) raft_consensus.cc:1685] finished
0709 12:15:56.746234 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.746346 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1785,"prepare.queue_time_us":429,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":173,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":4559,"spinlock_wait_cycles":2056960,"thread_start_us":250172,"threads_started":2,"wal-append.queue_time_us":193950}
I20260709 12:15:56.771970  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.751811 15556 raft_consensus.cc:476] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Not starting pre-election -- already a leader
I20260709 12:15:56.763736 15474 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:56.773572 15474 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.764295 15477 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:15:56.777949  8996 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 19.
I20260709 12:15:56.759876 15500 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:56.780332  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.783818  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:56.784107  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.785851  9071 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 19: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:56.786721  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:56.790153  9073 raft_consensus.cc:2393] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 19: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:15:56.786916  8916 raft_consensus.cc:2368] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:56.796952  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.798645  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.799377  8997 raft_consensus.cc:2368] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:56.776500 15474 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.808908  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:56.809257  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:56.809023 15317 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.812177  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.812845 15317 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.813997  8991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60214 (request call id 1348) took 1382 ms. Trace:
I20260709 12:15:56.828331  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:56.829607  8966 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:56.820629  9587 leader_election.cc:400] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:56.823858  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:56.831059  9073 raft_consensus.cc:2410] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd11e77b4be14e658672599b30d51e76 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:15:56.831204  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.830264  9587 leader_election.cc:403] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:56.814990 15317 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:56.838326  9588 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:15:56.835839  8992 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 19.
I20260709 12:15:56.814368  8991 rpcz_store.cc:276] 0709 12:15:55.431594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.431825 (+   231us) service_pool.cc:224] Handling call
0709 12:15:55.466326 (+ 34501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:55.635362 (+169036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.635395 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:55.635995 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:15:55.709941 (+ 73946us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:15:55.743459 (+ 33518us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.851326 (+107867us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.852791 (+  1465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.813619 (+960828us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000f64d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba4571 00007f3985c3be01 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2 00007f3983f7648c 00007f3983f758c6
0709 12:15:56.813662 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.813785 (+   123us) raft_consensus.cc:1685] finished
0709 12:15:56.813797 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.813922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39708,"prepare.queue_time_us":49091,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":20587,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":8611,"spinlock_wait_cycles":387618688,"thread_start_us":169880,"threads_started":2,"wal-append.queue_time_us":130140}
I20260709 12:15:56.805863 15500 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:56.816591 15435 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:56.821000 15475 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:56.848503  9071 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:15:56.849727  9616 raft_consensus.cc:1240] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:56.837122 15438 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.835979 15474 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:56.839212 15059 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:56.860864 15438 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.845989  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:56.862177 15059 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:56.868124  9587 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:56.841092  8888 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:56.857486  8963 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:56.850466 15320 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:15:56.871321 15320 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:56.871896 15320 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:56.868387 15475 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:56.875083 15406 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:56.874782 15500 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.877238 15491 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.878953 15120 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.880302  8921 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 19. Current term is 20. Ops: []
W20260709 12:15:56.871222  9037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.023s	sys 0.030s
I20260709 12:15:56.881850  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:56.883390  8916 raft_consensus.cc:606] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:56.883769  8916 raft_consensus.cc:614] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:56.889420  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 48622us
W20260709 12:15:56.891054  9037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.024s	sys 0.030s
W20260709 12:15:56.891626  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 1.19108e+06us
I20260709 12:15:56.893707  8991 raft_consensus.cc:1275] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:56.893695  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.896773  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:56.896701  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.897555  8997 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.897975  9620 raft_consensus.cc:2393] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 19: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:56.863093 15438 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:56.901108 15552 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:56.903410 15298 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:56.907341  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.908005  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.917618  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:56.923442  9620 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:56.919170  8817 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:56.920562  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:56.920965  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.927444  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:56.928123  8991 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:15:56.874285 15475 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:56.933558  8997 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
W20260709 12:15:56.963263  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58223.3us
I20260709 12:15:57.003343  8921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
W20260709 12:15:57.006182  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 84617.7us
I20260709 12:15:57.004067  8921 raft_consensus.cc:606] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:57.002876  8817 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
W20260709 12:15:57.013779  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 84099us
I20260709 12:15:57.029971  8889 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.010428  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:56.858237 15435 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:56.936324 15498 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:57.007498 15298 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
W20260709 12:15:57.076371  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 66031.4us
I20260709 12:15:57.080143  9590 leader_election.cc:400] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Vote denied by peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023) with higher term. Message: Invalid argument: T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 18. Current term is 19.
I20260709 12:15:57.083349  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.050752  8817 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:56.934885 15438 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.022459 15540 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.086071  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:56.933266 15405 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.092914  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:57.008787 15491 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:57.011915 15494 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:57.022208 15552 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:57.044373 15281 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:15:57.104818  8817 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.052918 15120 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.124490  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.126443  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.144845  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.128403  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.132803 15405 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.132828  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.135454  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.137884  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:57.147513  9070 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:57.147619  9066 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:57.141780  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.094800 15473 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:57.140151  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:15:57.150908  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.106106 15542 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:15:57.179013  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60553.2us
I20260709 12:15:57.091002 15498 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.180454  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:57.200776  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2696) took 1275 ms. Trace:
I20260709 12:15:57.201242  9621 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:57.181603 15572 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:57.183291  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.183965  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:57.209569  9065 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:57.153630 15487 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:57.186772 15281 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 12:15:57.187769  8815 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 322) took 21643 ms (client timeout 15000 ms). Trace:
I20260709 12:15:57.224591  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.191075 15435 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.148252 15494 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.195709 15552 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.197223 15539 consensus_queue.cc:1048] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:57.102483 15414 consensus_queue.cc:1059] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:15:57.180464  8817 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 16, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 16 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.199501 15298 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.106374 15437 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.201217  8925 rpcz_store.cc:276] 0709 12:15:55.925592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.925722 (+   130us) service_pool.cc:224] Handling call
0709 12:15:55.926040 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.926344 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.926376 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:56.821224 (+894848us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b18000bc860. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240
0709 12:15:56.821640 (+   416us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b18000bc860. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b1c2a6 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a
0709 12:15:56.822105 (+   465us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b2c00000f48. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3984534a11 00007f3984544372 00007f3985c76a01 00007f3985c3b43a 00007f3985c3a83e 00007f398abff419 00007f3984176bd4 00007f3984176b62 00007f3984176a91 00007f3984176a0c 00007f3984175cc2
0709 12:15:56.822474 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.077658 (+255184us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:57.077712 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.077812 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.200546 (+122734us) raft_consensus.cc:1685] finished
0709 12:15:57.200568 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.200722 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8519,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5245,"spinlock_wait_cycles":159405440,"thread_start_us":254771,"threads_started":1,"wal-append.queue_time_us":281944}
I20260709 12:15:57.106223 15540 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.104382 15438 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.238866  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.175485 15346 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:57.219846 15406 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:57.115655 15491 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.221231 15487 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.180788 15405 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:57.252454  9072 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:15:57.253888  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.257624 15437 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.258208 15487 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.258425  8998 raft_consensus.cc:2368] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20.
I20260709 12:15:57.246277 15346 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.261341 15346 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.261770 15491 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.262126  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.262840  8999 raft_consensus.cc:2468] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 9.
I20260709 12:15:57.263304 15498 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:57.245824 15066 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:15:57.233376 15474 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:57.264770 15474 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.220872 15320 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:57.224575  8815 rpcz_store.cc:269] 0709 12:15:35.544285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.544526 (+   241us) service_pool.cc:224] Handling call
0709 12:15:57.187680 (+21643154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:52.711008 (+     0us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f3982b310ac 00007f398b98b9a9 00007f3982b4d69b 00007f3982b4b93f 00007f3982b4b455 00007f398967016c
0709 12:15:53.136465 (+425457us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:53.324718 (+188253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:53.336620 (+ 11902us) write_op.cc:435] Acquired schema lock
0709 12:15:53.339970 (+  3350us) tablet.cc:662] Decoding operations
0709 12:15:53.429105 (+ 89135us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:53.429227 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:53.429268 (+    41us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:15:53.463828 (+ 34560us) tablet.cc:701] Row locks acquired
0709 12:15:53.463887 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:15:53.464149 (+   262us) write_op.cc:270] Start()
0709 12:15:53.464466 (+   317us) write_op.cc:276] Timestamp: P: 1783599353464070 usec, L: 0
0709 12:15:53.464514 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:15:53.465499 (+   985us) log.cc:844] Serialized 7735 byte log entry
0709 12:15:53.952177 (+486678us) op_driver.cc:464] REPLICATION: finished
0709 12:15:53.956364 (+  4187us) write_op.cc:301] APPLY: starting
0709 12:15:53.956457 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:53.979171 (+ 22714us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:53.979213 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:54.004484 (+ 25271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:54.004882 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:15:54.004953 (+    71us) write_op.cc:312] APPLY: finished
0709 12:15:54.005517 (+   564us) log.cc:844] Serialized 180 byte log entry
0709 12:15:54.012545 (+  7028us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:54.012802 (+   257us) write_op.cc:454] Released schema lock
0709 12:15:54.012904 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:54.025940 (+ 13036us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:54.025972 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":391170,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":3953,"apply.run_cpu_time_us":26746,"apply.run_wall_time_us":69539,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":457362,"prepare.run_cpu_time_us":26098,"prepare.run_wall_time_us":385229,"raft.queue_time_us":13746,"raft.run_cpu_time_us":3894,"raft.run_wall_time_us":6132,"replication_time_us":487490,"spinlock_wait_cycles":38476544,"thread_start_us":432313,"threads_started":4,"wal-append.queue_time_us":126346,"wal-append.run_cpu_time_us":5237,"wal-append.run_wall_time_us":1414421}]]}
I20260709 12:15:57.262130  9620 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:15:57.270038 15320 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.202080 15542 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.271564 15540 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.272992 15542 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.274291  9065 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:57.247064  8817 catalog_manager.cc:5697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 17 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.276324  8817 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.270987  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:57.274518  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 91775.5us
I20260709 12:15:57.209692  9066 raft_consensus.cc:2410] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:15:57.278010  8817 catalog_manager.cc:5697] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 12 to 15, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 15 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:15:57.280598  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.243417  9621 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:15:57.284495  9069 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:15:57.283984  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:57.286023  9620 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:15:57.287329  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.287679  8963 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:57.289635  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.290242  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:15:57.296972  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 183513us
I20260709 12:15:57.299840  9620 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
I20260709 12:15:57.303160  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.217847 15572 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.303874  8817 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 15, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 15 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.307705  8963 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:57.246047 15573 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:57.309783  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.310917  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.309314  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.313834  9588 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:57.311038  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:57.299396 15437 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:57.301577 15480 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:57.321794  8817 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.307229 15542 consensus_queue.cc:1048] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:15:57.319321 15308 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:57.325304  8817 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.279714 15405 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.306972 15320 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:57.332195  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.301227 15346 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:15:57.324352 15480 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.361712 15559 raft_consensus.cc:3055] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:57.362013 15480 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:57.362254 15559 raft_consensus.cc:740] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:57.332844 15491 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:57.327836 15571 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:57.338069  8817 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 16, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 16 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.363453 15491 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:57.363168 15559 consensus_queue.cc:260] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.364344 15491 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.364596  8817 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 12 to 13, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.347967 15413 raft_consensus.cc:993] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:57.348264 15438 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.319443 15573 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.367269 15413 raft_consensus.cc:1081] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:57.368475 15281 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:15:57.368961 15573 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:57.370672 15405 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.332371 15498 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:57.371642 15498 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.372002 15498 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:57.366125  8817 catalog_manager.cc:5697] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 13, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 13 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.381084  8817 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 16, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.359542 15572 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:57.359894 15494 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.388182  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:57.388180  8817 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:15:57.390578 15480 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.391004  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.392645 15480 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.334275 15540 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:15:57.365391 15546 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 1.078s	user 0.000s	sys 0.015s
I20260709 12:15:57.349648 15524 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:57.383108 15474 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.384570  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.384935  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.386137  9620 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 21. Current term is 22. Ops: []
W20260709 12:15:57.356505 15575 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 12:15:57.338227 15320 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.442237  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.444738  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "4993160378a142a1bc21648120cbaebc"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:57.364617 15559 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:57.445333  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:57.436538  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 115384us
I20260709 12:15:57.453096  8925 raft_consensus.cc:1275] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:15:57.472905  8919 raft_consensus.cc:606] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.476954  8919 raft_consensus.cc:614] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:57.478824  8889 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:57.481758 15545 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:57.482340 15545 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.484549 15545 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.489331 15320 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:57.452279 15524 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
W20260709 12:15:57.495810  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 188204us
I20260709 12:15:57.496037  8925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:57.496793  8925 raft_consensus.cc:606] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
W20260709 12:15:57.507632  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 196647us
I20260709 12:15:57.508605  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.511029  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.514446  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.514631  9590 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.520432  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.518525  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.522405  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47330 (request call id 2694) took 1727 ms. Trace:
I20260709 12:15:57.521636  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:57.523779  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.460947 15540 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.522878  8922 rpcz_store.cc:276] 0709 12:15:55.794871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.795069 (+   198us) service_pool.cc:224] Handling call
0709 12:15:55.795520 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.795930 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.795973 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:55.810473 (+ 14500us) log.cc:844] Serialized 26 byte log entry
0709 12:15:55.921865 (+111392us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:55.921909 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.921985 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.364839 (+1442854us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:57.513415 (+148576us) raft_consensus.cc:1685] finished
0709 12:15:57.513434 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.522345 (+  8911us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4129,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4446,"spinlock_wait_cycles":4122368,"thread_start_us":102307,"threads_started":1,"wal-append.queue_time_us":226618}
I20260709 12:15:57.639420  9587 leader_election.cc:400] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20.
I20260709 12:15:57.642338  9587 leader_election.cc:403] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:57.508458 15560 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:15:57.646100  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 122406us
I20260709 12:15:57.612403  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:57.637419  9038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.557392  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.534097  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:57.652241  8919 raft_consensus.cc:606] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:57.652689  8919 raft_consensus.cc:614] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:57.532541 15536 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:57.602567 15148 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 12:15:57.589710 15259 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:57.654533 15259 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.593084 15498 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.646056 15059 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20.
I20260709 12:15:57.651036 15557 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:57.657495 15498 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.657541 15557 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.659529 15259 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.523430 15545 consensus_queue.cc:1048] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.137s
I20260709 12:15:57.517885 15345 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:57.662796 15540 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.664933  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:57.667085  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:57.668112  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.667739 15437 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:57.671270 15437 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:57.650753 15500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.008s
W20260709 12:15:57.673996 15500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.008s	sys 0.008s
I20260709 12:15:57.552773 15524 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.522570 15573 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:57.526340 15438 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:15:57.693883  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 61948.2us
I20260709 12:15:57.689587  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.532598 15551 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:15:57.651823 15496 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:57.699688  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.665854 15435 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:57.694597 15580 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
W20260709 12:15:57.718279  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 68883us
I20260709 12:15:57.719774  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.720830  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.721773  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:57.722604  8963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.723145  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:57.723713  8991 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:57.724112  8991 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:57.724929 15588 log.cc:927] Time spent T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:15:57.723515 15524 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:57.728924  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.729452  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.730578  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.735095  8922 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Rejecting Update request from peer 2fec7bba20864beea35ba1b33132e47d for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:57.735127  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.735881  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.736596  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:57.702754 15438 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:57.741350  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.742414  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.746526  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.746837  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:57.747098  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:57.747390  8994 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:57.747704  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:57.749265  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:57.747725  9072 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:57.753800  8991 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:57.755365  8997 raft_consensus.cc:1240] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:57.726153 15587 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:57.769215  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:57.770078  9616 raft_consensus.cc:2393] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 20: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:15:57.770956  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8552a23b53d0499abefc4f4a5af10c93" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:57.772179 15438 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.773568  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:15:57.771111 15589 log.cc:927] Time spent T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:15:57.782752  9619 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:57.783402  8994 raft_consensus.cc:2468] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
I20260709 12:15:57.784607  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:57.785205  8994 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:57.733628 15584 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:57.789988  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:57.788111  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.790146  9072 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
I20260709 12:15:57.788792  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.789486  8991 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:57.798039  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.800506  8994 raft_consensus.cc:2468] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:15:57.805960  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.754588 15557 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:57.816339  8964 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.855201  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:57.857576  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 53603.9us
I20260709 12:15:57.876114  8964 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:57.896302  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 109063us
I20260709 12:15:57.897876  8889 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:57.901538 15414 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:57.912882  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.811201 15403 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:57.852293 15474 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:57.904575 15437 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:57.925166  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:57.805764 15584 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:57.916159 15281 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:15:57.851636 15120 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 12:15:57.912403 15585 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:57.969187  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:57.962016 15500 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:57.989145  9623 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:15:57.964411 15281 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:58.007228  9073 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:58.008834  8964 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.015879  8998 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20. Ops: []
I20260709 12:15:58.021387  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.027757  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.023048  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:58.044010  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 77673.7us
I20260709 12:15:58.052537  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.054800  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:58.052454  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.064345  8922 raft_consensus.cc:3055] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:58.064955  8922 raft_consensus.cc:740] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:58.025736 15583 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:58.025792 15491 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:58.071215  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:15:58.096818  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 74051.6us
I20260709 12:15:58.098260  8966 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.099081 15607 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:58.102341  8966 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.104067 15500 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.109539  8994 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:15:58.134198 15559 consensus_meta.cc:287] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.007s
I20260709 12:15:58.134497 15281 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.041674 15437 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:58.136315  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 65227.4us
I20260709 12:15:58.139671  9037 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.024287 15345 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:15:58.151422  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:58.154351  9073 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:58.047187 15595 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:58.254781  9073 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:58.258893 15584 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:58.136551 15573 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.189493  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.031075 15225 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 12:15:58.267846  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.149052 15542 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:58.273212  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 83826.8us
I20260709 12:15:58.274648  9037 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.285372  9037 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.247421 15585 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:58.247865 15602 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:58.299489 15474 raft_consensus.cc:493] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:58.304548 15345 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:58.319931 15474 raft_consensus.cc:515] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.320093 15345 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.322045 15474 leader_election.cc:290] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:58.312153 15578 raft_consensus.cc:2804] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:58.322099 15345 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:58.325205  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:15:58.313237 15599 log.cc:927] Time spent T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:15:58.325804  8998 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 20.
I20260709 12:15:58.281363 15579 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:58.331543  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:58.332958 15345 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:15:58.333348 15345 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:15:58.333741 15345 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:58.335440 15481 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.272043 15308 consensus_queue.cc:1059] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:15:58.294118 15498 raft_consensus.cc:2804] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:58.362212  8922 consensus_queue.cc:260] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:58.363669  8922 raft_consensus.cc:3060] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:58.375694  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 90412us
W20260709 12:15:58.384270 15610 log.cc:927] Time spent T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:15:58.387580 15498 raft_consensus.cc:697] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:58.388623 15498 consensus_queue.cc:237] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.331354 15578 raft_consensus.cc:697] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:58.391552 15578 consensus_queue.cc:237] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.394584  8964 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:58.397519 15390 raft_consensus.cc:2804] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:58.398151 15390 raft_consensus.cc:697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:58.400939  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.424134  8922 raft_consensus.cc:2468] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:15:58.399001 15390 consensus_queue.cc:237] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:58.423489 15302 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:58.432168 15302 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.433254 15536 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:58.434020 15536 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.438557  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.439883  9073 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:15:58.442854  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae12ea4362164b50bece754b6f6bd834" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:58.443953  8996 raft_consensus.cc:2368] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:58.455168  9587 leader_election.cc:400] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:58.455637  9587 leader_election.cc:403] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:58.452585 15493 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:58.462128 15493 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.465078 15493 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:58.480011 15595 raft_consensus.cc:3060] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:58.481577 15474 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:15:58.487223  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 349946us
I20260709 12:15:58.487375  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.451990 15302 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:58.491665  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfeb6de89004568abc3f47eb68ee5bf" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:58.500383  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:58.506784  9616 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:15:58.517874 15595 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) with higher term. Message: Invalid argument: T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for earlier term 15. Current term is 16.
I20260709 12:15:58.518096 15476 raft_consensus.cc:993] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:58.518617 15120 raft_consensus.cc:1081] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:58.521343 15585 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.522202  8888 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:58.522028 15585 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.524840 15120 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.531107 15120 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:58.533665 15345 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.536679  8996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:58.537309  8996 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.537664  8996 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:58.543542  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.546789  8996 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:58.536849 15345 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:58.555404 15585 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:58.556986  8963 leader_election.cc:304] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.559859 15536 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:58.562000  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.565582  8963 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.562170 15585 raft_consensus.cc:2749] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:58.566937 15585 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.569180 15585 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:15:58.590121 15281 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:58.604712  9621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:58.605594  9621 raft_consensus.cc:2410] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d for term 20 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:15:58.607497  9621 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 21. Current term is 22. Ops: []
I20260709 12:15:58.615515 15489 raft_consensus.cc:3055] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:58.616076 15489 raft_consensus.cc:740] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:58.616873 15489 consensus_queue.cc:260] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.617996 15489 raft_consensus.cc:3060] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:58.624132  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.636257  8993 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:58.637593 15437 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:15:58.639305 15438 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:58.639822 15414 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:15:58.640686 15414 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.642796  8996 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:58.642974 15414 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:58.647468  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:58.648240  8922 raft_consensus.cc:3055] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:15:58.648618  8922 raft_consensus.cc:740] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:58.649372  8922 consensus_queue.cc:260] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:58.650405  8922 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:58.681316  9072 raft_consensus.cc:1240] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:15:58.689726 15552 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:15:58.690392 15552 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.692891 15552 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:58.703596  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 61948us
I20260709 12:15:58.710410  8922 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 22.
I20260709 12:15:58.711061  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:58.711685  8966 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:58.712639  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:15:58.717870 15614 log.cc:927] Time spent T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.003s
I20260709 12:15:58.716204  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:58.722839 15474 raft_consensus.cc:2804] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:15:58.723417 15474 raft_consensus.cc:697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:58.724355 15474 consensus_queue.cc:237] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:58.727952  9071 raft_consensus.cc:3060] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:58.732905  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.752370  8993 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 20.
I20260709 12:15:58.754191  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:58.755540 15320 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:15:58.756287 15320 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:58.757483 15320 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.763115 15572 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:58.765276 15552 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.766005 15552 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:58.772739  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:58.773466  8993 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:58.775146  9587 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:15:58.775354  9615 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:15:58.788529  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:58.792091  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:58.769032 15552 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:58.795580  9069 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:15:58.801553  9069 pending_rounds.cc:85] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 11
I20260709 12:15:58.802110  9069 pending_rounds.cc:107] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:15:58.802518  9069 raft_consensus.cc:2889] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:58.807159  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.807467  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.810904  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:58.812150  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.815968  8919 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 20: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:15:58.793010 15344 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:58.828930  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.799472 15611 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:15:58.834259  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:58.837641  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 17.
I20260709 12:15:58.823441 15344 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.847529  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:58.864382  9071 raft_consensus.cc:2468] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 22.
I20260709 12:15:58.852586 15344 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:58.861838 15281 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:58.876915  9590 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.881266  9590 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.861690 15225 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:15:58.884820  9590 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:15:58.893770  8999 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:58.898645  8998 raft_consensus.cc:1240] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 21. Current term is 22. Ops: []
I20260709 12:15:58.899725 15302 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:58.880045 15308 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:58.909667 15498 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:58.891160 15435 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:58.970458  8991 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:15:58.971843 15633 log.cc:927] Time spent T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:15:58.972725 15498 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:58.983793  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:58.994431  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.039983  9623 raft_consensus.cc:1275] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:15:59.040490  9623 pending_rounds.cc:85] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Aborting all ops after (but not including) 12
I20260709 12:15:59.011179 15578 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:59.041745  8923 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:59.040763  9623 pending_rounds.cc:107] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:15:59.044498  9623 raft_consensus.cc:2889] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:59.068826 15498 consensus_queue.cc:1048] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:59.107851  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 49423.9us
I20260709 12:15:59.116297 15225 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:59.140631  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:59.141366  8923 raft_consensus.cc:606] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:59.067023 15344 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.082538 15578 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.162338  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:59.163021  8923 raft_consensus.cc:606] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:59.163389  8923 raft_consensus.cc:614] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:59.166313  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:59.166917  8923 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:59.170324  8925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:59.170912  8925 raft_consensus.cc:606] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:15:59.172524  8925 raft_consensus.cc:614] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:59.173063 15344 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:15:59.178679  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:59.179368  8925 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:59.184623  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:59.185434  8991 raft_consensus.cc:3060] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:59.194700  8923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:15:59.195400  8923 raft_consensus.cc:606] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:15:59.195727  8923 raft_consensus.cc:614] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:59.199877 15631 log.cc:927] Time spent T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
I20260709 12:15:59.199985  9623 raft_consensus.cc:1275] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:59.200978  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:59.202945  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:59.203795  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:59.210891  8921 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:15:59.218039 15578 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:59.219681  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:59.245996  9623 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 22: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:59.206835 15498 consensus_queue.cc:1048] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:15:59.222488  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:59.247327  8922 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 22.
I20260709 12:15:59.248616  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:59.250510 15498 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:15:59.250968 15498 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:15:59.251422 15498 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:15:59.271943  8991 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:59.286597  8925 raft_consensus.cc:2468] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:15:59.290409  9590 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:59.291374 15435 raft_consensus.cc:2804] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:59.291977 15435 raft_consensus.cc:697] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:59.293207 15435 consensus_queue.cc:237] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.295689 15403 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:59.309930 15557 raft_consensus.cc:993] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:59.310470 15560 raft_consensus.cc:1081] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:59.312744  8991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:59.313633  8991 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:59.314162  8991 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.331404  9069 raft_consensus.cc:1275] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:59.331549  8991 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:59.346727 15481 consensus_queue.cc:1048] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:15:59.352674 15498 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.365383  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:59.366096  8919 raft_consensus.cc:3055] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:59.366466  8919 raft_consensus.cc:740] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:15:59.367223  8919 consensus_queue.cc:260] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:59.368323  8919 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.377547  8991 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:59.397223 15498 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:59.408732  9069 raft_consensus.cc:1275] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:15:59.413168  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:15:59.413810  9069 raft_consensus.cc:3060] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.422508 15298 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.423116 15298 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.424871  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:59.425698  9615 raft_consensus.cc:2393] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 22: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:15:59.426081  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:15:59.426724  8999 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 20.
I20260709 12:15:59.428037 15225 consensus_queue.cc:1048] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:59.428946  8999 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:15:59.430491  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:59.430313 15435 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:15:59.431274  8921 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:15:59.432052 15559 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:59.432531 15559 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.432966 15559 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:59.422909  9069 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:59.441936  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:15:59.442879 15298 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:59.453419  8919 raft_consensus.cc:2468] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:15:59.454430  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:15:59.454865  8964 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:15:59.447618 15435 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:15:59.471676 15320 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.470981 15403 raft_consensus.cc:2804] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:59.506269  8921 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 22.
I20260709 12:15:59.508287  9040 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 4993160378a142a1bc21648120cbaebc
I20260709 12:15:59.502539 15559 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.498708 15320 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:59.518222  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 57295.5us
I20260709 12:15:59.515600 15403 raft_consensus.cc:697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:15:59.551074 15606 raft_consensus.cc:993] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
W20260709 12:15:59.626236  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 138485us
W20260709 12:15:59.631395 15643 log.cc:927] Time spent T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:15:59.683442 15320 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:59.628559 15403 consensus_queue.cc:237] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:59.684669 15281 raft_consensus.cc:1081] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:15:59.541303 15438 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:15:59.689426  8921 raft_consensus.cc:1240] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Rejecting Update request from peer 4993160378a142a1bc21648120cbaebc for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:15:59.692535 15559 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:15:59.708523 15438 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:15:59.710005 15438 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:15:59.712791  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 149327us
I20260709 12:15:59.759910  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:15:59.760617  8919 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 22.
I20260709 12:15:59.766659  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:15:59.763115  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:15:59.785022 15545 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:15:59.787226 15545 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.787601 15545 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:15:59.793489  8998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49082
I20260709 12:15:59.794054  8998 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:59.794374  8998 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.797333  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:15:59.763612 15435 consensus_queue.cc:1059] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:15:59.821467  8997 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:59.825043  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:15:59.840857  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:15:59.842245 15559 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:15:59.820789  8998 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:15:59.873986  8998 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:15:59.879215  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 77405.7us
W20260709 12:15:59.886730  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 60680.8us
W20260709 12:15:59.917021  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 121583us
I20260709 12:15:59.945389  8817 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 335) took 9360 ms. Trace:
I20260709 12:15:59.946583 15344 raft_consensus.cc:3055] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:15:59.947162 15344 raft_consensus.cc:740] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:15:59.948318 15344 consensus_queue.cc:260] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:15:59.954013 15545 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:00.013731 15545 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:15:59.945818  8817 rpcz_store.cc:276] 0709 12:15:50.585293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.585587 (+   294us) service_pool.cc:224] Handling call
0709 12:15:59.945299 (+9359712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:57.700447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:57.701023 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:57.701085 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:15:57.701104 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:57.947009 (+245905us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:57.964853 (+ 17844us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:57.967803 (+  2950us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:15:58.340833 (+373030us) tablet.cc:701] Row locks acquired
0709 12:15:58.340854 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:15:58.340992 (+   138us) write_op.cc:270] Start()
0709 12:15:58.341137 (+   145us) write_op.cc:276] Timestamp: P: 1783599358340945 usec, L: 0
0709 12:15:58.341163 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:15:58.467652 (+126489us) log.cc:844] Serialized 9269 byte log entry
0709 12:15:58.715971 (+248319us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982a74c85 00007f3982a756a2 00007f39857e71db 00007f39857e2aaf 00007f39857d686e 00007f39857d5bb6 00007f39857d57d8 00007f39857df221 00007f39857df1d9 00007f39857df169
0709 12:15:58.754469 (+ 38498us) op_driver.cc:464] REPLICATION: finished
0709 12:15:58.869081 (+114612us) write_op.cc:301] APPLY: starting
0709 12:15:58.869168 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:58.965075 (+ 95907us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:58.965098 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:59.215746 (+250648us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:59.216147 (+   401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:15:59.216202 (+    55us) write_op.cc:312] APPLY: finished
0709 12:15:59.216723 (+   521us) log.cc:844] Serialized 212 byte log entry
0709 12:15:59.223092 (+  6369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:59.223340 (+   248us) write_op.cc:454] Released schema lock
0709 12:15:59.223411 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:59.223852 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:59.223888 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3442451,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":114341,"apply.run_cpu_time_us":35083,"apply.run_wall_time_us":354742,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104591,"num_ops":24,"prepare.queue_time_us":256187,"prepare.run_cpu_time_us":12947,"prepare.run_wall_time_us":806520,"raft.queue_time_us":35263,"raft.run_cpu_time_us":74370,"raft.run_wall_time_us":101784,"replication_time_us":413151,"spinlock_wait_cycles":2470272,"thread_start_us":363866,"threads_started":4,"wal-append.queue_time_us":82517}]]}
I20260709 12:16:00.020203 15344 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:00.030620  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 182409us
I20260709 12:16:00.033593  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:00.034250  9067 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:00.065508  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 176812us
I20260709 12:16:00.065805  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:00.067147  8919 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:00.067627  8919 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:16:00.068555  8919 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:00.071923  9067 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:16:00.072746  9074 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:00.106014  8919 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:00.145045  8925 raft_consensus.cc:1275] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:00.101975 15552 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 12:16:00.151865  8807 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 8
W20260709 12:16:00.169634  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 57971.9us
I20260709 12:16:00.170387  8964 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:00.172153 15474 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:00.172676 15474 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:00.173534 15474 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:00.190439  9616 raft_consensus.cc:1240] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 FOLLOWER]: Rejecting Update request from peer 491a1127924f43d4a369f7d09c3a68db for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:00.206477 15496 consensus_queue.cc:1059] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:16:00.208055 15661 raft_consensus.cc:3055] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:16:00.208750 15661 raft_consensus.cc:740] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:00.209951 15661 consensus_queue.cc:260] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:00.211894 15661 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:00.225168  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:00.231487  8919 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
W20260709 12:16:00.253998  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 105855us
W20260709 12:16:00.266326  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 95090.8us
I20260709 12:16:00.280390  8823 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 11 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 12 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:00.282512  8823 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 11 to 12, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 12 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:00.296031  8925 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:16:00.307015  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 163538us
I20260709 12:16:00.313898  9073 raft_consensus.cc:2410] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:16:00.313709  8823 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 8 to 10, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 10 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:00.310678 15344 consensus_queue.cc:1048] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:16:00.329578  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:00.330212  8919 raft_consensus.cc:3060] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:00.332527  8823 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 9 to 11, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:00.339195  8823 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 13 to 14, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:00.343902  8919 raft_consensus.cc:2468] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 23.
I20260709 12:16:00.349251  9066 raft_consensus.cc:1275] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:00.356952 15675 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:16:00.359637  8807 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 747c26453321457087376c5a57b2b7bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 8
W20260709 12:16:00.361419  8821 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 320) took 70572 ms (client timeout 15000 ms). Trace:
W20260709 12:16:00.362118  8821 rpcz_store.cc:269] 0709 12:14:49.788761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.789098 (+   337us) service_pool.cc:224] Handling call
0709 12:16:00.361178 (+70572080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377629,"reported_tablets":49}
I20260709 12:16:00.393091 15609 consensus_queue.cc:1048] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:00.418727  9590 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.426273 15648 raft_consensus.cc:2804] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:00.437031  8991 raft_consensus.cc:1240] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Rejecting Update request from peer fd11e77b4be14e658672599b30d51e76 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:00.445171 15648 raft_consensus.cc:697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:16:00.465909 15648 consensus_queue.cc:237] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:00.654505  9073 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:00.660827 15403 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:00.699839  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:00.786276  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:16:00.786888  8919 raft_consensus.cc:606] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.798396  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:16:00.799052  8919 raft_consensus.cc:606] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.799415  8919 raft_consensus.cc:614] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:00.805089  8919 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:00.806488 15667 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:00.809507  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:16:00.810081  8919 raft_consensus.cc:606] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.818424  8919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:35278
I20260709 12:16:00.819032  8919 raft_consensus.cc:606] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.819396  8919 raft_consensus.cc:614] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:00.856563  9066 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 23 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:16:00.856931  9066 pending_rounds.cc:85] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting all ops after (but not including) 16
I20260709 12:16:00.857141  9066 pending_rounds.cc:107] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:16:00.857353  9066 raft_consensus.cc:2889] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:00.859620 15606 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:00.863945 15606 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:00.874020  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:00.882084 15670 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:16:00.886181  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:00.896137  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:00.867075 15606 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:00.910854  8888 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:00.924307  8921 raft_consensus.cc:1275] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:16:00.927515 15559 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:00.945062 15577 raft_consensus.cc:993] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:00.945621 15615 raft_consensus.cc:1081] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:00.955032  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "284fe781057a4484a4910b55152f99af"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:16:00.955677  9066 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:00.956045  9066 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:00.985357  9066 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:00.990319  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:00.990945  8919 raft_consensus.cc:3055] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:00.991281  8919 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:16:00.991995  8919 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:00.993086  8919 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:01.004877  8919 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
W20260709 12:16:01.007845  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 81712.6us
I20260709 12:16:01.008288  9066 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:01.009220  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:01.009815  8995 raft_consensus.cc:3060] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:01.010102  9040 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:16:01.011675 15670 consensus_queue.cc:1048] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:16:01.013219 15654 raft_consensus.cc:2804] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:01.013782 15654 raft_consensus.cc:697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:01.014715 15654 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:01.017655  8995 raft_consensus.cc:2468] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:16:01.022616  8821 catalog_manager.cc:5697] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.030450  8991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6874650616d4242a2b161a9a22a07ad"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:43398
I20260709 12:16:01.031145  8991 raft_consensus.cc:606] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:01.031512  8991 raft_consensus.cc:614] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:01.032784  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:01.043359  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.044304  8821 catalog_manager.cc:5697] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.045974  8821 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index 3 to 8, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 7 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.047706  8821 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.053649  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.130424  8821 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.133066  8821 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 18, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 18 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.198007 15554 raft_consensus.cc:993] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:01.201383 15695 raft_consensus.cc:1081] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:01.208595  9066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58556
I20260709 12:16:01.209194  9066 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:01.209538  9066 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:01.216483  8821 catalog_manager.cc:5697] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 9 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 19 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.218014  8821 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.223388  9066 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:01.219929  8821 catalog_manager.cc:5697] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 21 to 22, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 22 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.226056  8821 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 17 to 19, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 19 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.227881  8821 catalog_manager.cc:5697] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 17 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.229823  8821 catalog_manager.cc:5697] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.226061  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:01.232048  8919 raft_consensus.cc:3055] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:01.232486  8919 raft_consensus.cc:740] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:16:01.232838  9066 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:01.233502  8919 consensus_queue.cc:260] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:01.235216  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:01.243021  8995 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:01.252436  8995 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:16:01.253715  9037 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:01.254593 15571 raft_consensus.cc:2804] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:01.255375 15571 raft_consensus.cc:697] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:01.256294 15571 consensus_queue.cc:237] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:01.260238  8919 raft_consensus.cc:3060] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:01.241726  8821 catalog_manager.cc:5697] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 16, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.267715  8821 catalog_manager.cc:5697] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 18 to 20, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 20 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.271782  8821 catalog_manager.cc:5697] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:01.265239  8823 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 321) took 48850 ms (client timeout 15000 ms). Trace:
I20260709 12:16:01.275992  8821 catalog_manager.cc:5697] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 12 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.294834  8821 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 17 to 18, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 18 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.301574  8919 raft_consensus.cc:2468] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:16:01.300246  8821 catalog_manager.cc:5697] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.302693  8821 catalog_manager.cc:5697] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 18, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 18 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.304293  8821 catalog_manager.cc:5697] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:01.279832  8823 rpcz_store.cc:269] 0709 12:15:12.414893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.418907 (+  4014us) service_pool.cc:224] Handling call
0709 12:16:01.265172 (+48846265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:00.558398 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:00.559094 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:00.559153 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:16:00.559177 (+    24us) tablet.cc:662] Decoding operations
0709 12:16:00.559939 (+   762us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:00.560032 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:00.560070 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:16:00.560661 (+   591us) tablet.cc:701] Row locks acquired
0709 12:16:00.560682 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:16:00.560836 (+   154us) write_op.cc:270] Start()
0709 12:16:00.560957 (+   121us) write_op.cc:276] Timestamp: P: 1783599360560784 usec, L: 0
0709 12:16:00.560985 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:16:00.561726 (+   741us) log.cc:844] Serialized 2100 byte log entry
0709 12:16:00.788245 (+226519us) op_driver.cc:464] REPLICATION: finished
0709 12:16:00.934264 (+146019us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b180021a0c0. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f398ba16ab1 00007f398ba23281 00007f3982b4e3f3 00007f3982b507c1 00007f3982b50779 00007f3982b50709 00007f3982b506d1 00007f3982b4f9cd 0000000000388634 0000000000388479 00007f3982b3183a
0709 12:16:00.934392 (+   128us) write_op.cc:301] APPLY: starting
0709 12:16:00.934482 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:00.937626 (+  3144us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:00.937654 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:00.942311 (+  4657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:00.942542 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:16:00.942591 (+    49us) write_op.cc:312] APPLY: finished
0709 12:16:00.942838 (+   247us) log.cc:844] Serialized 57 byte log entry
0709 12:16:00.943014 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:00.943140 (+   126us) write_op.cc:454] Released schema lock
0709 12:16:00.943188 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:00.943629 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:00.943657 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":97095,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":71691,"apply.run_cpu_time_us":7574,"apply.run_wall_time_us":9183,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":199494,"prepare.run_cpu_time_us":20468,"prepare.run_wall_time_us":40127,"raft.queue_time_us":159543,"raft.run_cpu_time_us":24011,"raft.run_wall_time_us":85295,"replication_time_us":220088,"spinlock_wait_cycles":135181184,"thread_start_us":362209,"threads_started":4,"wal-append.queue_time_us":43422}]]}
I20260709 12:16:01.314946  8821 catalog_manager.cc:5697] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.347069  8821 catalog_manager.cc:5697] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.360270  8821 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 17, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 17 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.434258  8821 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 19, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 19 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.469821  8821 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 20, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 20 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.484525  8821 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 18, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 18 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.491842  8821 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 15 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 16 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.516891  8821 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.544597  8821 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 19, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 19 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.585814  8995 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:01.587867  8921 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:01.589160  8821 catalog_manager.cc:5697] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.590041 15662 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:01.591828  8821 catalog_manager.cc:5697] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 17 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.594002  8821 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 14 to 19, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 19 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:01.605926  8821 catalog_manager.cc:5697] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 19 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:01.677009 15474 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:01.678045 15474 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:01.689064  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:01.690187  9616 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 21.
I20260709 12:16:01.697763  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:16:01.698930  8925 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 21: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:16:01.684887 15474 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:01.754150 15700 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:01.759372  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:01.761209 15403 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:01.761685 15403 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:01.762104 15403 raft_consensus.cc:3060] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:01.831385  8997 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:01.837316 15403 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:01.840811  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:01.841630  8919 raft_consensus.cc:2393] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 21: Already voted for candidate fd11e77b4be14e658672599b30d51e76 in this term.
I20260709 12:16:01.844921  8919 raft_consensus.cc:1275] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:01.848747 15571 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:01.860898 15403 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:01.867085  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:01.921146  9615 raft_consensus.cc:2468] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 21.
I20260709 12:16:01.929193 15653 consensus_queue.cc:1048] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:01.944916  8963 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:01.949812 15403 raft_consensus.cc:2804] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:01.958834 15403 raft_consensus.cc:697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 21 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:01.962476 15403 consensus_queue.cc:237] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:02.262615  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 747c26453321457087376c5a57b2b7bb with delete_type TABLET_DATA_TOMBSTONED (TS fd11e77b4be14e658672599b30d51e76 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46176
I20260709 12:16:02.266790  8820 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 8 to 11, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.275416  8820 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 10 to 11, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 11 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.272795  8821 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54654 (request call id 336) took 1876 ms. Trace:
I20260709 12:16:02.283407  8821 rpcz_store.cc:276] 0709 12:16:00.396214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.396711 (+   497us) service_pool.cc:224] Handling call
0709 12:16:02.272679 (+1875968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:01.970399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:01.971094 (+   695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:01.971138 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:16:01.971175 (+    37us) tablet.cc:662] Decoding operations
0709 12:16:01.973713 (+  2538us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:01.973830 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:01.973858 (+    28us) tablet.cc:685] Acquiring locks for 33 operations
0709 12:16:02.012729 (+ 38871us) tablet.cc:701] Row locks acquired
0709 12:16:02.012783 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:16:02.012959 (+   176us) write_op.cc:270] Start()
0709 12:16:02.013113 (+   154us) write_op.cc:276] Timestamp: P: 1783599362012896 usec, L: 0
0709 12:16:02.013158 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:16:02.013963 (+   805us) log.cc:844] Serialized 12671 byte log entry
0709 12:16:02.083991 (+ 70028us) op_driver.cc:464] REPLICATION: finished
0709 12:16:02.118234 (+ 34243us) write_op.cc:301] APPLY: starting
0709 12:16:02.118328 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:02.178007 (+ 59679us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:02.178148 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:02.200038 (+ 21890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:02.200710 (+   672us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 12:16:02.200788 (+    78us) write_op.cc:312] APPLY: finished
0709 12:16:02.201521 (+   733us) log.cc:844] Serialized 284 byte log entry
0709 12:16:02.201746 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.202005 (+   259us) write_op.cc:454] Released schema lock
0709 12:16:02.202123 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:02.207404 (+  5281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.207460 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104979,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":33928,"apply.run_cpu_time_us":44816,"apply.run_wall_time_us":89118,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142265,"num_ops":33,"prepare.queue_time_us":79852,"prepare.run_cpu_time_us":21137,"prepare.run_wall_time_us":68032,"raft.queue_time_us":34008,"raft.run_cpu_time_us":7693,"raft.run_wall_time_us":48302,"replication_time_us":70663,"spinlock_wait_cycles":49024,"thread_start_us":142754,"threads_started":4,"wal-append.queue_time_us":24250}]]}
I20260709 12:16:02.302574  8820 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 12 to 13, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 13 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:02.332792  8820 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 11 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 14 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:02.390261  8821 catalog_manager.cc:5697] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 18, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 18 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.403949  8821 catalog_manager.cc:5697] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 17 to 18, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:02.406864  8821 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } }
I20260709 12:16:02.411677 15716 tablet_replica.cc:333] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:02.423297  8925 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:16:02.428440 15716 raft_consensus.cc:2243] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.429381 15716 raft_consensus.cc:2272] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:02.433151 15716 ts_tablet_manager.cc:1916] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:02.445191 15474 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:16:02.459707  8821 catalog_manager.cc:5697] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 20 to 21, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 21 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:02.475981  8820 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 211) took 36225 ms (client timeout 15000 ms). Trace:
W20260709 12:16:02.476435  8820 rpcz_store.cc:269] 0709 12:15:26.309774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.403431 (+ 93657us) service_pool.cc:224] Handling call
0709 12:16:02.475887 (+36072456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:02.338485 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:02.339153 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:02.339191 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:16:02.339213 (+    22us) tablet.cc:662] Decoding operations
0709 12:16:02.339943 (+   730us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:02.340015 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:02.340050 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:16:02.340548 (+   498us) tablet.cc:701] Row locks acquired
0709 12:16:02.340573 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:16:02.340747 (+   174us) write_op.cc:270] Start()
0709 12:16:02.340897 (+   150us) write_op.cc:276] Timestamp: P: 1783599362340689 usec, L: 0
0709 12:16:02.340926 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:16:02.341677 (+   751us) log.cc:844] Serialized 1723 byte log entry
0709 12:16:02.348533 (+  6856us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b540029eb20. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba5090 00007f3985bb26b8 00007f3985bb22fa 00007f3985c36965 00007f3985c36e09 00007f3989671581 00007f3989670d58 00007f39896759f1 00007f39896759a9 00007f3989675939 00007f3989675901
0709 12:16:02.349199 (+   666us) op_driver.cc:464] REPLICATION: finished
0709 12:16:02.350518 (+  1319us) write_op.cc:301] APPLY: starting
0709 12:16:02.350626 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:02.353217 (+  2591us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:02.353241 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:02.355891 (+  2650us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:02.356089 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:16:02.356138 (+    49us) write_op.cc:312] APPLY: finished
0709 12:16:02.356370 (+   232us) log.cc:844] Serialized 49 byte log entry
0709 12:16:02.357209 (+   839us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.357318 (+   109us) write_op.cc:454] Released schema lock
0709 12:16:02.357363 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:02.359419 (+  2056us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.359451 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1683624,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":1057,"apply.run_cpu_time_us":6533,"apply.run_wall_time_us":7188,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":6888,"prepare.run_wall_time_us":10289,"replication_time_us":8095,"spinlock_wait_cycles":2829568}]]}
I20260709 12:16:02.495997  9616 raft_consensus.cc:1275] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:16:02.503170 15474 consensus_queue.cc:1048] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:16:02.629621  8814 catalog_manager.cc:5697] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 16 to 17, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 17 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.630632 15474 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.631330 15474 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:02.639987 15716 ts_tablet_manager.cc:1929] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:16:02.642378 15716 log.cc:1199] T 747c26453321457087376c5a57b2b7bb P fd11e77b4be14e658672599b30d51e76: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/wals/747c26453321457087376c5a57b2b7bb
I20260709 12:16:02.643935  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:02.645629  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 747c26453321457087376c5a57b2b7bb (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:16:02.647600  8814 catalog_manager.cc:5697] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 11 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 16 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.651710  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:02.651968 15474 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:02.653352  8963 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:02.654439 15667 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:02.655988  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.667227  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 21 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd11e77b4be14e658672599b30d51e76" is_pre_election: true
I20260709 12:16:02.650429  8814 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.683283  8814 catalog_manager.cc:5697] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 11 to 13, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 13 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.702885  8814 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 14 to 21, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 21 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:02.704970  8814 catalog_manager.cc:5697] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 14 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.706699  8814 catalog_manager.cc:5697] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.720060  8814 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index 3 to 10, term changed from 14 to 19, leader changed from 4993160378a142a1bc21648120cbaebc (127.7.137.4) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1), VOTER 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) evicted. New cstate: current_term: 19 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.848701  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:16:02.849465  9066 raft_consensus.cc:606] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Received request to transfer leadership to TS fd11e77b4be14e658672599b30d51e76
I20260709 12:16:02.856889  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
mode: GRACEFUL
new_leader_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:16:02.857648  9066 raft_consensus.cc:606] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Received request to transfer leadership to TS 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:02.859136  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:02.865608  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:02.865370  8984 tablet_service.cc:1558] Processing DeleteTablet for tablet 123584ad57374d41b689f4592fe92d4d with delete_type TABLET_DATA_TOMBSTONED (TS 2fec7bba20864beea35ba1b33132e47d not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49430
I20260709 12:16:02.867359  8814 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 308) took 10559 ms. Trace:
I20260709 12:16:02.867576  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 747c26453321457087376c5a57b2b7bb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46176
I20260709 12:16:02.869570  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 747c26453321457087376c5a57b2b7bb (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:16:02.867854  8814 rpcz_store.cc:276] 0709 12:15:52.307952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.308227 (+   275us) service_pool.cc:224] Handling call
0709 12:16:02.867270 (+10559043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:02.737086 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:02.737649 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:02.737685 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:16:02.737700 (+    15us) tablet.cc:662] Decoding operations
0709 12:16:02.738617 (+   917us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:02.738683 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:02.738713 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:16:02.739449 (+   736us) tablet.cc:701] Row locks acquired
0709 12:16:02.739469 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:16:02.739627 (+   158us) write_op.cc:270] Start()
0709 12:16:02.739743 (+   116us) write_op.cc:276] Timestamp: P: 1783599362739576 usec, L: 0
0709 12:16:02.739773 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:16:02.740445 (+   672us) log.cc:844] Serialized 3170 byte log entry
0709 12:16:02.747372 (+  6927us) op_driver.cc:464] REPLICATION: finished
0709 12:16:02.747825 (+   453us) write_op.cc:301] APPLY: starting
0709 12:16:02.747903 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:02.752118 (+  4215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:02.752215 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:02.767047 (+ 14832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:02.767276 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:16:02.767327 (+    51us) write_op.cc:312] APPLY: finished
0709 12:16:02.767629 (+   302us) log.cc:844] Serialized 81 byte log entry
0709 12:16:02.784680 (+ 17051us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.784808 (+   128us) write_op.cc:454] Released schema lock
0709 12:16:02.784868 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:02.788072 (+  3204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.795113 (+  7041us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6437,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":10437,"apply.run_wall_time_us":38180,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33488,"num_ops":8,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":3679,"prepare.run_wall_time_us":5403,"replication_time_us":7438}]]}
I20260709 12:16:02.923056 15571 raft_consensus.cc:993] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:16:02.923578 15571 raft_consensus.cc:1081] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Signalling peer 2fec7bba20864beea35ba1b33132e47d to start an election
I20260709 12:16:02.928094  8994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
 from {username='slave'} at 127.0.0.1:49092
I20260709 12:16:02.928815  8994 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.929183  8994 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:02.925947  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.940342  8994 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:02.957937  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:02.958580  9066 raft_consensus.cc:3055] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:02.958873  9066 raft_consensus.cc:740] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:02.959687  9066 consensus_queue.cc:260] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:02.960822  9066 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:02.963346  8994 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:02.963577  8906 tablet_service.cc:1558] Processing DeleteTablet for tablet 747c26453321457087376c5a57b2b7bb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46176
I20260709 12:16:02.963712  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:02.964339  9616 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:02.965451  8810 catalog_manager.cc:5028] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): tablet 747c26453321457087376c5a57b2b7bb (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:16:02.945349 15722 tablet_replica.cc:333] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:02.968883 15722 raft_consensus.cc:2243] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:02.970005 15722 pending_rounds.cc:70] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Trying to abort 1 pending ops.
I20260709 12:16:02.988298  8818 catalog_manager.cc:5697] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.989914  8818 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 12 to 19, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 19 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:02.970311 15722 pending_rounds.cc:77] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Aborting op as it isn't in flight: id { term: 14 index: 9 } timestamp: 7305622824651046912 op_type: NO_OP noop_request { }
I20260709 12:16:02.996538 15722 raft_consensus.cc:2889] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:02.997040 15722 raft_consensus.cc:2272] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.006386 15722 ts_tablet_manager.cc:1916] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:16:03.008606  8816 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54642 (request call id 307) took 33959 ms (client timeout 15000 ms). Trace:
I20260709 12:16:03.022352  9616 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
W20260709 12:16:03.022967  8816 rpcz_store.cc:269] 0709 12:15:29.053730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.056001 (+  2271us) service_pool.cc:224] Handling call
0709 12:15:30.092957 (+1036956us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b5400260110. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16b71 00007f3982b170b2 00007f398ba90759 00007f398ba28a76 00007f398b9f9d58 00007f398baf804e 00007f3989fb92a4 00007f3989fb9232 00007f3989fb9161 00007f3989fb90dc
0709 12:16:03.008401 (+32915444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286734,"reported_tablets":48,"spinlock_wait_cycles":77937920}
I20260709 12:16:03.023898  8963 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:03.024888 15403 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:03.025388 15403 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:03.026319 15403 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:03.016731  9066 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
I20260709 12:16:03.057282  8816 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 19 to 20, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 20 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.081070 15700 raft_consensus.cc:993] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: : Instructing follower fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:16:03.081605 15700 raft_consensus.cc:1081] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Signalling peer fd11e77b4be14e658672599b30d51e76 to start an election
I20260709 12:16:03.085850  8919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653"
dest_uuid: "fd11e77b4be14e658672599b30d51e76"
 from {username='slave'} at 127.0.0.1:47330
I20260709 12:16:03.086437  8919 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:03.086786  8919 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.096351 15722 ts_tablet_manager.cc:1929] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:16:03.097822 15722 log.cc:1199] T 123584ad57374d41b689f4592fe92d4d P 2fec7bba20864beea35ba1b33132e47d: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/wals/123584ad57374d41b689f4592fe92d4d
I20260709 12:16:03.113631  8919 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:03.102809  8807 catalog_manager.cc:5028] TS 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): tablet 123584ad57374d41b689f4592fe92d4d (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
I20260709 12:16:03.118304  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:03.118985  9066 raft_consensus.cc:3055] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:03.119335  9066 raft_consensus.cc:740] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:03.120149  9066 consensus_queue.cc:260] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:03.121340  9066 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.123857  8814 catalog_manager.cc:5697] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 19 to 21, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 21 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:03.139786  8818 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54660 (request call id 323) took 11169 ms. Trace:
I20260709 12:16:03.140316  8818 rpcz_store.cc:276] 0709 12:15:51.970148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.970372 (+   224us) service_pool.cc:224] Handling call
0709 12:16:03.035631 (+11065259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:03.035664 (+    33us) write_op.cc:454] Released schema lock
0709 12:16:03.139716 (+104052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:03.016098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:03.016662 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:03.016700 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:16:03.016717 (+    17us) tablet.cc:662] Decoding operations
0709 12:16:03.017131 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:03.017188 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:03.017222 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:16:03.017553 (+   331us) tablet.cc:701] Row locks acquired
0709 12:16:03.017569 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:16:03.017716 (+   147us) write_op.cc:270] Start()
0709 12:16:03.017842 (+   126us) write_op.cc:276] Timestamp: P: 1783599363017670 usec, L: 0
0709 12:16:03.017861 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:16:03.018492 (+   631us) log.cc:844] Serialized 907 byte log entry
0709 12:16:03.020627 (+  2135us) op_driver.cc:464] REPLICATION: finished
0709 12:16:03.021055 (+   428us) write_op.cc:301] APPLY: starting
0709 12:16:03.021139 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:03.022460 (+  1321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:03.022555 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:03.023876 (+  1321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:03.024043 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:16:03.028172 (+  4129us) write_op.cc:312] APPLY: finished
0709 12:16:03.028387 (+   215us) log.cc:844] Serialized 33 byte log entry
0709 12:16:03.028550 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:03.028641 (+    91us) write_op.cc:454] Released schema lock
0709 12:16:03.028681 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":11807,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":3865,"apply.run_wall_time_us":7926,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":2683,"prepare.run_wall_time_us":2696,"replication_time_us":2592}]]}
I20260709 12:16:03.151948  8919 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Requested vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:03.154835  9066 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
I20260709 12:16:03.157892  8814 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:03.162726  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:03.163321  9616 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.164198  8814 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 18 to 20, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 20 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:03.159408  8889 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
W20260709 12:16:03.161721  8819 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 209) took 83027 ms (client timeout 15000 ms). Trace:
W20260709 12:16:03.167553  8819 rpcz_store.cc:269] 0709 12:14:40.134542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.134791 (+   249us) service_pool.cc:224] Handling call
0709 12:14:40.450407 (+315616us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b540016f3d4. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f3985ba5090 00007f3985c43f3a 00007f398b9f9e9c 00007f398baf804e 00007f3989fb92a4 00007f3989fb9232 00007f3989fb9161 00007f3989fb90dc 00007f3989fb8392 00007f3983f7648c 00007f3983f758c6
0709 12:16:03.161508 (+82711101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137541,"reported_tablets":35,"spinlock_wait_cycles":102564096}
I20260709 12:16:03.169036 15554 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:03.166311  8814 catalog_manager.cc:5697] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 21 to 23, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 23 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:03.169623 15554 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Becoming Leader. State: Replica: fd11e77b4be14e658672599b30d51e76, State: Running, Role: LEADER
I20260709 12:16:03.171218 15554 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:03.171675  9616 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd11e77b4be14e658672599b30d51e76 in term 17.
W20260709 12:16:03.262871  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 70525.5us
I20260709 12:16:03.283767  8814 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 reported cstate change: term changed from 16 to 17, leader changed from 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) to fd11e77b4be14e658672599b30d51e76 (127.7.137.1). New cstate: current_term: 17 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:03.333146  8822 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52726 (request call id 212) took 15743 ms (client timeout 15000 ms). Trace:
W20260709 12:16:03.333757  8822 rpcz_store.cc:269] 0709 12:15:47.585674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.590561 (+  4887us) service_pool.cc:224] Handling call
0709 12:16:03.324968 (+15734407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1383823,"reported_tablets":35}
W20260709 12:16:03.340726  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 114999us
I20260709 12:16:03.588263  9620 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:16:03.592150 15726 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:03.605101  9066 raft_consensus.cc:1275] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:16:03.611047 15726 consensus_queue.cc:1048] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:03.664336  9073 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:03.667359 15695 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:03.703733  9615 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:03.717401 15695 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:16:03.784569  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44916.7us
I20260709 12:16:04.062424  8925 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:16:04.082218  8888 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64324fda988042f2a6200271577d02a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:04.085561  9067 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:04.087210  8991 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:04.090879 15577 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:04.092557  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.097270 15554 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:04.134037 15577 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.140295  8994 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.187451  8820 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:16:04.197487  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49747.4us
I20260709 12:16:04.212855  9066 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.223644  8994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
mode: GRACEFUL
new_leader_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:43398
I20260709 12:16:04.224268  8994 raft_consensus.cc:606] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Received request to transfer leadership to TS 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:04.231595  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:04.235845  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.238583  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:04.266727  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 44641.8us
I20260709 12:16:04.306478  8994 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:04.322907  8925 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:16:04.324035  8963 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 996aff69fd874168bec179a4292ac2e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:04.326335  9066 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:04.328581 15720 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:04.330432 15720 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:04.377447 15743 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.390982  9066 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.405124  8919 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.491499  8814 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 18 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
W20260709 12:16:04.499969  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54058us
I20260709 12:16:04.520434 15760 ts_tablet_manager.cc:933] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023)
I20260709 12:16:04.568576 15760 tablet_copy_client.cc:323] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.1:41023
I20260709 12:16:04.571973  8935 tablet_copy_service.cc:140] P fd11e77b4be14e658672599b30d51e76: Received BeginTabletCopySession request for tablet 64324fda988042f2a6200271577d02a9 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:45518)
I20260709 12:16:04.572523  8935 tablet_copy_service.cc:161] P fd11e77b4be14e658672599b30d51e76: Beginning new tablet copy session on tablet 64324fda988042f2a6200271577d02a9 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:45518: session id = 4993160378a142a1bc21648120cbaebc-64324fda988042f2a6200271577d02a9
I20260709 12:16:04.588147  9066 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
W20260709 12:16:04.605906  9037 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 284fe781057a4484a4910b55152f99af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:04.607899  8994 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:04.615024 15751 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:04.627292  8919 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:04.628516 15403 raft_consensus.cc:993] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: : Instructing follower 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:04.629027 15403 raft_consensus.cc:1081] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Signalling peer 491a1127924f43d4a369f7d09c3a68db to start an election
I20260709 12:16:04.629237 15749 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:04.634567  8935 tablet_copy_source_session.cc:215] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:04.635922  9073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62"
dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
 from {username='slave'} at 127.0.0.1:58550
I20260709 12:16:04.656883  9073 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.657312  9073 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.647588 15748 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.650779  8925 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.693251  9073 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:04.706260 15760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64324fda988042f2a6200271577d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:04.708694  9073 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:04.710218  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:04.713968  8991 raft_consensus.cc:3055] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:04.714365  8991 raft_consensus.cc:740] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:04.715219  8991 consensus_queue.cc:260] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:04.716534  8991 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.718305  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "fd11e77b4be14e658672599b30d51e76"
I20260709 12:16:04.718952  8919 raft_consensus.cc:3060] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.726951  8991 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:16:04.727173  8919 raft_consensus.cc:2468] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:16:04.738986  9040 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76; no voters: 
I20260709 12:16:04.742269 15748 raft_consensus.cc:2804] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:04.742978 15748 raft_consensus.cc:697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:04.743983 15748 consensus_queue.cc:237] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:04.749497  9066 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:04.757753  8995 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.750527  8814 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 reported cstate change: config changed from index -1 to 10, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.789321 15760 tablet_copy_client.cc:806] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:04.790006 15760 tablet_copy_client.cc:670] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:04.795469  8991 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:16:04.801621  8919 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:16:04.804251 15760 tablet_copy_client.cc:538] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:16:04.822858  9037 consensus_peers.cc:597] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db -> Peer 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071): Couldn't send request to peer 4993160378a142a1bc21648120cbaebc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e90ec1fa86446378a1fdff46884228e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:04.824419  8820 catalog_manager.cc:5697] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 16 to 17, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.831123 15760 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:16:04.831303 15700 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:04.846186 15748 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:04.863480 15751 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.876907  8995 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:04.924432  8820 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.976027 15771 ts_tablet_manager.cc:933] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:05.004211 15760 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:05.013254 15760 tablet_bootstrap.cc:492] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:16:05.019886 15760 ts_tablet_manager.cc:1403] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.189s	user 0.031s	sys 0.015s
I20260709 12:16:05.028646 15771 tablet_copy_client.cc:323] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.2:35539
I20260709 12:16:05.024740  8919 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 4993160378a142a1bc21648120cbaebc (127.7.137.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } } }
I20260709 12:16:05.036486  9010 tablet_copy_service.cc:140] P 2fec7bba20864beea35ba1b33132e47d: Received BeginTabletCopySession request for tablet 996aff69fd874168bec179a4292ac2e2 from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:60214)
I20260709 12:16:05.037140  9010 tablet_copy_service.cc:161] P 2fec7bba20864beea35ba1b33132e47d: Beginning new tablet copy session on tablet 996aff69fd874168bec179a4292ac2e2 from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:60214: session id = 4993160378a142a1bc21648120cbaebc-996aff69fd874168bec179a4292ac2e2
I20260709 12:16:05.044512 15760 raft_consensus.cc:359] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.045593 15760 raft_consensus.cc:740] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:16:05.053387 15760 consensus_queue.cc:260] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.051206  9010 tablet_copy_source_session.cc:215] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:05.060588 15760 ts_tablet_manager.cc:1434] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:16:05.076896  8935 tablet_copy_service.cc:342] P fd11e77b4be14e658672599b30d51e76: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-64324fda988042f2a6200271577d02a9 received from {username='slave'} at 127.0.0.1:45518
I20260709 12:16:05.077366  8935 tablet_copy_service.cc:434] P fd11e77b4be14e658672599b30d51e76: ending tablet copy session 4993160378a142a1bc21648120cbaebc-64324fda988042f2a6200271577d02a9 on tablet 64324fda988042f2a6200271577d02a9 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:16:05.077912 15771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996aff69fd874168bec179a4292ac2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.151543 15771 tablet_copy_client.cc:806] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:05.152285 15771 tablet_copy_client.cc:670] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:05.158798 15771 tablet_copy_client.cc:538] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:05.158969 15760 ts_tablet_manager.cc:933] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:05.177027 15760 tablet_copy_client.cc:323] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:16:05.180909  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 284fe781057a4484a4910b55152f99af from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:16:05.181565  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 284fe781057a4484a4910b55152f99af from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-284fe781057a4484a4910b55152f99af
I20260709 12:16:05.193835  8922 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:05.197585 15571 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:05.210708 15771 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:16:05.295940  8991 raft_consensus.cc:1275] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:05.300175  9083 tablet_copy_source_session.cc:215] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:05.316982 15571 consensus_queue.cc:1048] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:05.327023 15760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284fe781057a4484a4910b55152f99af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:05.389533  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 103434us
I20260709 12:16:05.416584 15780 ts_tablet_manager.cc:933] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Initiating tablet copy from peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:05.432220  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.463201  9620 raft_consensus.cc:1217] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:16:05.499871 15780 tablet_copy_client.cc:323] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: tablet copy: Beginning tablet copy session from remote peer at address 127.7.137.3:34547
I20260709 12:16:05.552474  9083 tablet_copy_service.cc:140] P 491a1127924f43d4a369f7d09c3a68db: Received BeginTabletCopySession request for tablet 6e90ec1fa86446378a1fdff46884228e from peer 4993160378a142a1bc21648120cbaebc ({username='slave'} at 127.0.0.1:59490)
I20260709 12:16:05.553131  9083 tablet_copy_service.cc:161] P 491a1127924f43d4a369f7d09c3a68db: Beginning new tablet copy session on tablet 6e90ec1fa86446378a1fdff46884228e from peer 4993160378a142a1bc21648120cbaebc at {username='slave'} at 127.0.0.1:59490: session id = 4993160378a142a1bc21648120cbaebc-6e90ec1fa86446378a1fdff46884228e
W20260709 12:16:05.556507  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 120468us
I20260709 12:16:05.554919 15760 tablet_copy_client.cc:806] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:05.578130 15760 tablet_copy_client.cc:670] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:05.603324 15760 tablet_copy_client.cc:538] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:05.624732  9083 tablet_copy_source_session.cc:215] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:05.635201 15771 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:05.664463 15771 tablet_bootstrap.cc:492] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:16:05.658324  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
W20260709 12:16:05.667918  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 96049.1us
I20260709 12:16:05.674685  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:05.675534  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.679855 15771 ts_tablet_manager.cc:1403] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.469s	user 0.063s	sys 0.022s
I20260709 12:16:05.662600 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e90ec1fa86446378a1fdff46884228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.661911 15760 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:16:05.714579 15771 raft_consensus.cc:359] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.715534 15771 raft_consensus.cc:740] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:16:05.716197 15771 consensus_queue.cc:260] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.745007 15780 tablet_copy_client.cc:806] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:05.745779 15780 tablet_copy_client.cc:670] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:05.747608 15771 ts_tablet_manager.cc:1434] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.001s
I20260709 12:16:05.749344  9010 tablet_copy_service.cc:342] P 2fec7bba20864beea35ba1b33132e47d: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-996aff69fd874168bec179a4292ac2e2 received from {username='slave'} at 127.0.0.1:60214
I20260709 12:16:05.749797  9010 tablet_copy_service.cc:434] P 2fec7bba20864beea35ba1b33132e47d: ending tablet copy session 4993160378a142a1bc21648120cbaebc-996aff69fd874168bec179a4292ac2e2 on tablet 996aff69fd874168bec179a4292ac2e2 with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:16:05.759938 15780 tablet_copy_client.cc:538] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:05.779175 15780 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Bootstrap starting.
I20260709 12:16:05.808058  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.832440  9620 raft_consensus.cc:1217] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:16:05.897509 15760 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:05.898514 15760 tablet_bootstrap.cc:492] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:16:05.899291 15760 ts_tablet_manager.cc:1403] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.238s	user 0.050s	sys 0.016s
I20260709 12:16:05.905305 15760 raft_consensus.cc:359] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.905959 15780 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:05.908780 15760 raft_consensus.cc:740] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:16:05.909538 15780 tablet_bootstrap.cc:492] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Bootstrap complete.
I20260709 12:16:05.909600 15760 consensus_queue.cc:260] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.910512 15780 ts_tablet_manager.cc:1403] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Time spent bootstrapping tablet: real 0.132s	user 0.045s	sys 0.008s
I20260709 12:16:05.913705 15780 raft_consensus.cc:359] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.914552 15780 raft_consensus.cc:740] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Initialized, Role: LEARNER
I20260709 12:16:05.915220 15780 consensus_queue.cc:260] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:05.912228 15760 ts_tablet_manager.cc:1434] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:05.918257  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-284fe781057a4484a4910b55152f99af received from {username='slave'} at 127.0.0.1:59490
I20260709 12:16:05.918722  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-284fe781057a4484a4910b55152f99af on tablet 284fe781057a4484a4910b55152f99af with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:16:05.957754 15780 ts_tablet_manager.cc:1434] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 12:16:05.977421  9083 tablet_copy_service.cc:342] P 491a1127924f43d4a369f7d09c3a68db: Request end of tablet copy session 4993160378a142a1bc21648120cbaebc-6e90ec1fa86446378a1fdff46884228e received from {username='slave'} at 127.0.0.1:59490
I20260709 12:16:05.977954  9083 tablet_copy_service.cc:434] P 491a1127924f43d4a369f7d09c3a68db: ending tablet copy session 4993160378a142a1bc21648120cbaebc-6e90ec1fa86446378a1fdff46884228e on tablet 6e90ec1fa86446378a1fdff46884228e with peer 4993160378a142a1bc21648120cbaebc
I20260709 12:16:06.102754 15745 raft_consensus.cc:1064] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:16:06.105818 15745 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:06.119585  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
W20260709 12:16:06.131181  8966 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 12:16:06.136531  9067 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:06.139256  9620 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 LEARNER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:06.142026 15776 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:06.144625 15776 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:16:06.222674  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 72541.1us
W20260709 12:16:06.227074  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.240291  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 109243us
W20260709 12:16:06.243289  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 104183us
I20260709 12:16:06.247753  8991 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Refusing update from remote peer fd11e77b4be14e658672599b30d51e76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:16:06.259599  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.265256  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.268365 15776 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:06.276145  9615 raft_consensus.cc:1217] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
W20260709 12:16:06.319480  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.324402  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.326489  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.331442  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.314281  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.353881  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57204.5us
W20260709 12:16:06.357116  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.357828  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.359229  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.367054 15791 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:06.368767  9066 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:06.391902  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.399899  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 57014.5us
W20260709 12:16:06.402299  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.406555  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.407162  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.452239  8820 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "fd11e77b4be14e658672599b30d51e76" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:06.471338  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.474123  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 66157.8us
W20260709 12:16:06.477259  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 67053.6us
W20260709 12:16:06.474674  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.507978 15720 raft_consensus.cc:1064] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:16:06.510624 15720 consensus_queue.cc:237] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:06.516686  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.517318  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 132276us
W20260709 12:16:06.547267  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.553591  9620 raft_consensus.cc:1217] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
W20260709 12:16:06.559834  9040 consensus_peers.cc:597] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.567935  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.571815  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.568578  9620 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:06.589787  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 112802us
I20260709 12:16:06.637215  8995 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:06.735507  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 89476.8us
W20260709 12:16:06.779592  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.787846  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 107595us
W20260709 12:16:06.844748  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 88306.5us
W20260709 12:16:06.865423  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.865075  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:06.870949  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.900682  9615 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 LEARNER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:16:06.915548  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:06.943878 15808 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:16:06.995796  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 218741us
I20260709 12:16:07.007284  9067 raft_consensus.cc:1275] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:16:07.026542  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:07.027913  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:07.028498  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:07.050266  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:07.068058 15810 consensus_queue.cc:1048] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:16:07.073606  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:07.074234  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:07.080261 15830 raft_consensus.cc:1064] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:16:07.081404 15788 raft_consensus.cc:1064] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: attempting to promote NON_VOTER 4993160378a142a1bc21648120cbaebc to VOTER
I20260709 12:16:07.082772 15830 consensus_queue.cc:237] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.084739 15788 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.110357 15776 raft_consensus.cc:493] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.110960 15776 raft_consensus.cc:515] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.129137 15776 leader_election.cc:290] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.139755 15804 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.142181  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.140125  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8cdabd573f46e28a22e367d9de5201" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.166617 15838 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.167204 15838 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.169427 15838 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.140314 15804 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.175434 15804 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.182528  9615 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:07.183147  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.184058  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.184762 15825 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.185344 15825 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.187575  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d273c2182c4f4d86d85935b864463c" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.188331  8888 leader_election.cc:304] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.187633  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.189221 15837 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:07.194052  8888 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.192107  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.193466 15807 raft_consensus.cc:2749] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.199291  9623 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 LEARNER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:07.199960  8994 raft_consensus.cc:1275] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:07.204741  8888 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.207849 15776 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.210235 15838 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:07.212553  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:07.209715 15802 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.227344 15825 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.231592 15838 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.232170 15838 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.232403  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f04df98e77b4f7a85750662c7bcaf22" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.234241 15838 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.235401 15776 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.235889 15776 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.236338  8888 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.236817  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.237680 15825 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:07.238049 15776 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.238335 15825 raft_consensus.cc:493] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.238564 15776 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.238876 15825 raft_consensus.cc:515] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.240947 15825 leader_election.cc:290] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.241488  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.239073 15776 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.242992  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.243484 15776 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.244979  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.245402 15838 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.245942 15838 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.250497 15838 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.247267  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.255545  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.256327  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:16:07.256590  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 49857.7us
I20260709 12:16:07.256822 15788 consensus_queue.cc:1048] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:16:07.261943 15839 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:16:07.256990  9040 consensus_peers.cc:597] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:07.274813  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c56340353dd41d9a99bb2e22fe8c536" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.275991  8888 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.276382 15838 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.276940 15838 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.277276  8888 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.277880 15807 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:07.278595 15807 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.279060 15838 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.280942 15776 raft_consensus.cc:493] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.272707  9072 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.281481 15776 raft_consensus.cc:515] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.284735  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.285538  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f07e4a3742b455d9d586fda2b111e62" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.287132  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.288506  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dde2f9282d04104a95b6e08dc322ad4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.290205  8994 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:07.291188  8888 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.300979 15837 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:07.303113  8888 leader_election.cc:304] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.299974 15804 raft_consensus.cc:493] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.306013  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.317629  8888 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.305733 15825 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.340363  8888 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.330209 15838 raft_consensus.cc:493] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.350937  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24627c251054d5eb5c50b970605e2b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.319777 15787 raft_consensus.cc:2749] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.317333 15804 raft_consensus.cc:515] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.352353 15829 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.352885 15807 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:07.354039 15804 leader_election.cc:290] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.357775  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.361481 15806 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.361773  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eae6c679d7f4d4a9422d66f842d1d7d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.365307 15838 raft_consensus.cc:515] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.345289 15776 leader_election.cc:290] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.393982  8888 leader_election.cc:304] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.383893 15804 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.396080  8888 leader_election.cc:304] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.385391 15825 raft_consensus.cc:493] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:16:07.402900  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 101218us
I20260709 12:16:07.394897 15806 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.409879  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.411558 15838 leader_election.cc:290] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.401054 15804 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.401804 15825 raft_consensus.cc:515] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.428810 15826 raft_consensus.cc:2749] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.429544 15805 raft_consensus.cc:2749] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:07.421543 15807 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.435840 15776 raft_consensus.cc:493] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.436640 15838 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.436380 15776 raft_consensus.cc:515] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.353041 15829 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.411314 15806 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.437255 15807 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.459995 15807 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.439109 15787 raft_consensus.cc:493] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
W20260709 12:16:07.460959  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): ChangeConfig:REMOVE_PEER RPC failed for tablet 64324fda988042f2a6200271577d02a9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:07.461213 15787 raft_consensus.cc:515] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.462471 15805 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.463006 15805 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.465049 15805 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.468999 15787 leader_election.cc:290] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:07.477628  8888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 51887.6us
I20260709 12:16:07.481436 15806 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.484905  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.494362 15806 raft_consensus.cc:493] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.494963 15806 raft_consensus.cc:515] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:07.494763 15837 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.497161 15806 leader_election.cc:290] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.499106 15829 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.500087 15825 leader_election.cc:290] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.437209 15838 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.506706  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.509621 15852 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.517594  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:07.515924 15852 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.518281 15776 leader_election.cc:290] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.518661 15804 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.519546 15852 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.521242  7716 tablet_replica.cc:333] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.523377 15827 raft_consensus.cc:493] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.523903 15827 raft_consensus.cc:515] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.528236  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.516674  9620 raft_consensus.cc:2955] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.532590  7716 raft_consensus.cc:2243] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.514413  8999 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.534947  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.538547 15838 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.545434 15827 leader_election.cc:290] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.552062 15829 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.553145  7716 raft_consensus.cc:2272] T 617ce264333c4b249320780af77038ce P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.557179  7716 tablet_replica.cc:333] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.558187  7716 raft_consensus.cc:2243] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.560456  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.560925  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.561632  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56979e1608d4fcc873d5537e8345d33" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.562616 15829 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:07.564968 15829 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.565987  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.559059  7716 raft_consensus.cc:2272] T f4167a86c30a432d84c12cddcaef4f30 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.577381  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47609ef9e5d4514945afe81e24e790d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.581532  9615 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.583359  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.584488  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.585503  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4285e23e73840659806e00d6213792a" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.589257 15826 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.589876 15826 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:07.590858  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.592149 15826 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.592065  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.593161  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.593420  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daf2fc07a0041229724f51fb6f5fc01" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.594586  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ad3d29ddad476c8f02ee13b8dbe1b5" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.596690  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.600554  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.600562 15826 raft_consensus.cc:493] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.601578 15826 raft_consensus.cc:515] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.602046  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.602268  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9093f0f82b7942b39a479d2142fc6b1f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.603811 15826 leader_election.cc:290] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.604609  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.605877  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d515be0508e478dbeaa4e7bf253d48d" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.609942  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b3fa87be744c6a1d2a811af614ebc" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.611056 15826 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.611212  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023d28c087e64377a9e2790180949da6" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.611677 15826 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.613809 15826 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.615389  8819 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.617589  8819 catalog_manager.cc:5697] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 11 to 12, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.620465 15827 raft_consensus.cc:493] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
W20260709 12:16:07.621104  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 49286.5us
I20260709 12:16:07.621029 15827 raft_consensus.cc:515] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:07.623283  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 47806.2us
I20260709 12:16:07.624315 15837 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.626749  8888 leader_election.cc:304] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.629107  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9e57d64a28430bb24c6a130105d58e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.632776  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.636458  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.639431 15827 leader_election.cc:290] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.635828 15829 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:07.643023 15829 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.645139 15829 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.636991 15826 raft_consensus.cc:2749] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:07.667954  7716 tablet_replica.cc:333] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.669000  7716 raft_consensus.cc:2243] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.668860  8995 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.677044  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.679411  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e90ec1fa86446378a1fdff46884228e" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.682168  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.695425  8888 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.705250  7716 raft_consensus.cc:2272] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.706032  8888 leader_election.cc:304] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.707862 15852 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:07.709889 15829 raft_consensus.cc:2749] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.709995  8888 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.711334  8888 leader_election.cc:304] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.715607  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.706983  8889 leader_election.cc:304] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.724931  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8de493054d15b198c2f7ddeb70b4" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.712795 15838 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.735289 15829 raft_consensus.cc:2749] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:07.719544 15826 raft_consensus.cc:2749] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.701812 15827 raft_consensus.cc:493] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:07.736668 15827 raft_consensus.cc:515] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.737107  8889 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.734251  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.738709 15827 leader_election.cc:290] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:07.740242  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbd74f835814289a7dddc3be9b40dbf" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.741380  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d6970fddb4442a12d0adcf1a1980b" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.742986 15829 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.744266  7716 tablet_replica.cc:333] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.743281  8889 leader_election.cc:304] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.745167  7716 raft_consensus.cc:2243] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.745261 15858 raft_consensus.cc:2749] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:07.746299  7716 raft_consensus.cc:2272] T f774722c966e4c2b94851308244cbffd P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.745954  8888 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.747337 15858 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:07.729115  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.749799  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be7ce502f794156a9be9d258ca1e04f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.753499  8889 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.755442 15826 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:07.757725  8889 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.758559 15826 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:07.761835  7716 tablet_replica.cc:333] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.762759  7716 raft_consensus.cc:2243] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.763609  8888 leader_election.cc:304] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.765297  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:07.766006 15826 raft_consensus.cc:2749] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:07.758898  8889 leader_election.cc:304] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.767683  8888 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
W20260709 12:16:07.768602  8889 raft_consensus.cc:2686] T c98b3fa87be744c6a1d2a811af614ebc P fd11e77b4be14e658672599b30d51e76: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:16:07.769133 15858 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.769598  8889 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.771443 15826 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.773651  8889 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.774662 15826 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.774966  8889 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.776378 15827 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:07.777999  8889 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.779145  7716 raft_consensus.cc:2272] T 3f07e4a3742b455d9d586fda2b111e62 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.786688  7716 tablet_replica.cc:333] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.787710  7716 raft_consensus.cc:2243] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.781628 15827 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:07.796463  7716 raft_consensus.cc:2272] T 566f7a1027e341e88b14a77db605c154 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.797099  8888 leader_election.cc:304] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.806779  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a9c1b9c42c4bd88c49949bf6c32d9f" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.800643 15826 raft_consensus.cc:2749] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.805948  9616 raft_consensus.cc:2955] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.820307  8889 leader_election.cc:304] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:07.822021 15826 raft_consensus.cc:2749] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.823805 15827 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:07.825627 15827 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: NON_VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: true } }
I20260709 12:16:07.827754 15827 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:07.845207  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:07.856093  7716 tablet_replica.cc:333] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.857183  7716 raft_consensus.cc:2243] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.864933  7716 raft_consensus.cc:2272] T 2d1d6970fddb4442a12d0adcf1a1980b P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.865530  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284fe781057a4484a4910b55152f99af" candidate_uuid: "fd11e77b4be14e658672599b30d51e76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:07.871659  7716 tablet_replica.cc:333] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.873131  8889 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd11e77b4be14e658672599b30d51e76; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:07.874184 15858 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:07.876487  7716 raft_consensus.cc:2243] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.877210  7716 raft_consensus.cc:2272] T 996aff69fd874168bec179a4292ac2e2 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.879810  7716 tablet_replica.cc:333] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.880553  7716 raft_consensus.cc:2243] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.887388  7716 raft_consensus.cc:2272] T f24528c4e0f24715985149f6366da832 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.893908  7716 tablet_replica.cc:333] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.895388  7716 raft_consensus.cc:2243] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.896270  7716 raft_consensus.cc:2272] T 2f9e57d64a28430bb24c6a130105d58e P fd11e77b4be14e658672599b30d51e76 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.899175  7716 tablet_replica.cc:333] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.899917  7716 raft_consensus.cc:2243] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.900504  7716 raft_consensus.cc:2272] T 30cab06a8b964cdc84cf62efa5868208 P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.904608  7716 tablet_replica.cc:333] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.906543  7716 raft_consensus.cc:2243] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.907168  7716 raft_consensus.cc:2272] T 9093f0f82b7942b39a479d2142fc6b1f P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.910068  7716 tablet_replica.cc:333] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.910761  7716 raft_consensus.cc:2243] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.911799  7716 raft_consensus.cc:2272] T 7cc6b85fd0864fe18832be4b2550889d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.914355  7716 tablet_replica.cc:333] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.915086  7716 raft_consensus.cc:2243] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.915725  7716 raft_consensus.cc:2272] T db8cdabd573f46e28a22e367d9de5201 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.918409  7716 tablet_replica.cc:333] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.921444  9070 consensus_queue.cc:237] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:07.923527  7716 raft_consensus.cc:2243] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:07.924607  7716 raft_consensus.cc:2272] T e5bea2f56e504744b5355171d4aae5f3 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.932806  8822 catalog_manager.cc:5697] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db reported cstate change: config changed from index 10 to 11, 4993160378a142a1bc21648120cbaebc (127.7.137.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.936340  8995 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:16:07.942019  9616 raft_consensus.cc:1275] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:16:07.943795  7716 tablet_replica.cc:333] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.944762  7716 raft_consensus.cc:2243] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.945323  7716 raft_consensus.cc:2272] T 703a24767eb84ead9befa5c1beff0063 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.947947  7716 tablet_replica.cc:333] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.948786  7716 raft_consensus.cc:2243] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:07.949349  7716 raft_consensus.cc:2272] T 13d273c2182c4f4d86d85935b864463c P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:07.942062 15861 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:16:07.951647 15839 consensus_queue.cc:1048] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:07.963388  7716 tablet_replica.cc:333] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:07.964457 15830 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.981381  9616 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:07.994050  8995 raft_consensus.cc:2955] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:08.004586  7716 raft_consensus.cc:2243] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.005962  7716 raft_consensus.cc:2272] T 9e996a3dae284298bc7fecf1e8fdc675 P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.011912  8808 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e90ec1fa86446378a1fdff46884228e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:08.014616  8822 catalog_manager.cc:5697] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 12 to 13, VOTER fd11e77b4be14e658672599b30d51e76 (127.7.137.1) evicted. New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:08.029242  7716 tablet_replica.cc:333] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.052924  7716 raft_consensus.cc:2243] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.058729  7716 raft_consensus.cc:2272] T 5dde2f9282d04104a95b6e08dc322ad4 P fd11e77b4be14e658672599b30d51e76 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.061498  7716 tablet_replica.cc:333] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.062273  7716 raft_consensus.cc:2243] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.062913  7716 raft_consensus.cc:2272] T 422d007cdc2c44f4b486ca22b87c8dd8 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.065476  7716 tablet_replica.cc:333] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.066208  7716 raft_consensus.cc:2243] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.114410  7716 raft_consensus.cc:2272] T 447f05dcf4904c71bfa27d72667dc990 P fd11e77b4be14e658672599b30d51e76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.189670  7716 tablet_replica.cc:333] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.190533  7716 raft_consensus.cc:2243] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.204497  7716 raft_consensus.cc:2272] T 4febe4c7f30f402a93c27138f2b4c778 P fd11e77b4be14e658672599b30d51e76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.222893  7716 tablet_replica.cc:333] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.228034  7716 raft_consensus.cc:2243] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.235014  7716 raft_consensus.cc:2272] T 0daf2fc07a0041229724f51fb6f5fc01 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.238018  7716 tablet_replica.cc:333] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.248024  7716 raft_consensus.cc:2243] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.252239  7716 raft_consensus.cc:2272] T 4eae6c679d7f4d4a9422d66f842d1d7d P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.258208  7716 tablet_replica.cc:333] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.275970  7716 raft_consensus.cc:2243] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.282616  7716 raft_consensus.cc:2272] T a4285e23e73840659806e00d6213792a P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.290608  7716 tablet_replica.cc:333] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.291870  7716 raft_consensus.cc:2243] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.296073  7716 raft_consensus.cc:2272] T c47609ef9e5d4514945afe81e24e790d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.300995  7716 tablet_replica.cc:333] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.308941  7716 raft_consensus.cc:2243] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.320003  7716 raft_consensus.cc:2272] T 3f04df98e77b4f7a85750662c7bcaf22 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.326535  7716 tablet_replica.cc:333] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.333420  7716 raft_consensus.cc:2243] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.335611  7716 raft_consensus.cc:2272] T e24627c251054d5eb5c50b970605e2b5 P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.338405  7716 tablet_replica.cc:333] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.345597  7716 raft_consensus.cc:2243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.346242  7716 raft_consensus.cc:2272] T c8a9c1b9c42c4bd88c49949bf6c32d9f P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.355156  7716 tablet_replica.cc:333] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.356038  7716 raft_consensus.cc:2243] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.358453  7716 raft_consensus.cc:2272] T 123584ad57374d41b689f4592fe92d4d P fd11e77b4be14e658672599b30d51e76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.362025  7716 tablet_replica.cc:333] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.362812  7716 raft_consensus.cc:2243] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.363492  7716 raft_consensus.cc:2272] T 309f8de493054d15b198c2f7ddeb70b4 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.366218  7716 tablet_replica.cc:333] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.366971  7716 raft_consensus.cc:2243] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.367597  7716 raft_consensus.cc:2272] T 023d28c087e64377a9e2790180949da6 P fd11e77b4be14e658672599b30d51e76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.370170  7716 tablet_replica.cc:333] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.371048  7716 raft_consensus.cc:2243] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.372205  7716 raft_consensus.cc:2272] T cca28c4486a64eceb7e839d2891ef357 P fd11e77b4be14e658672599b30d51e76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.374830  7716 tablet_replica.cc:333] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.375628  7716 raft_consensus.cc:2243] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.376257  7716 raft_consensus.cc:2272] T 2c2c8c51a5344057978683f2249e4fab P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.378883  7716 tablet_replica.cc:333] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.379684  7716 raft_consensus.cc:2243] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.380323  7716 raft_consensus.cc:2272] T 284fe781057a4484a4910b55152f99af P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.382863  7716 tablet_replica.cc:333] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.392797  7716 raft_consensus.cc:2243] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.397413  7716 raft_consensus.cc:2272] T 64324fda988042f2a6200271577d02a9 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.407615  7716 tablet_replica.cc:333] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.408529  7716 raft_consensus.cc:2243] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.409689  7716 raft_consensus.cc:2272] T 2ee1ce8134fc4f7e9ce1860cf467105b P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.417251  7716 tablet_replica.cc:333] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.418148  7716 raft_consensus.cc:2243] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.418799  7716 raft_consensus.cc:2272] T 4be7ce502f794156a9be9d258ca1e04f P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.428045  7716 tablet_replica.cc:333] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.428850  7716 raft_consensus.cc:2243] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.429517  7716 raft_consensus.cc:2272] T 6e90ec1fa86446378a1fdff46884228e P fd11e77b4be14e658672599b30d51e76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.440549  7716 tablet_replica.cc:333] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.441351  7716 raft_consensus.cc:2243] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.441908  7716 raft_consensus.cc:2272] T 6c56340353dd41d9a99bb2e22fe8c536 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.444464  7716 tablet_replica.cc:333] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.445247  7716 raft_consensus.cc:2243] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.445807  7716 raft_consensus.cc:2272] T 1d515be0508e478dbeaa4e7bf253d48d P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.453368  7716 tablet_replica.cc:333] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.454165  7716 raft_consensus.cc:2243] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.454772  7716 raft_consensus.cc:2272] T f56979e1608d4fcc873d5537e8345d33 P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.457644  7716 tablet_replica.cc:333] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.458431  7716 raft_consensus.cc:2243] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.459050  7716 raft_consensus.cc:2272] T ea78b632dcc844fabe1d6e7b6012f9ff P fd11e77b4be14e658672599b30d51e76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.461864  7716 tablet_replica.cc:333] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.462594  7716 raft_consensus.cc:2243] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:08.483820  7716 raft_consensus.cc:2272] T b9be656547ea464996d40fcd3eb6a653 P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.486600  7716 tablet_replica.cc:333] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.487354  7716 raft_consensus.cc:2243] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.487921  7716 raft_consensus.cc:2272] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P fd11e77b4be14e658672599b30d51e76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.490859  7716 tablet_replica.cc:333] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.491565  7716 raft_consensus.cc:2243] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.492110  7716 raft_consensus.cc:2272] T 030add77af8944519fa93baf328b3e4a P fd11e77b4be14e658672599b30d51e76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:08.494850  7716 tablet_replica.cc:333] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76: stopping tablet replica
I20260709 12:16:08.503605  7716 raft_consensus.cc:2243] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:08.504403  7716 raft_consensus.cc:2272] T 6bbd74f835814289a7dddc3be9b40dbf P fd11e77b4be14e658672599b30d51e76 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:08.512981  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.622001  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.632647  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.644263  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6e90ec1fa86446378a1fdff46884228e: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:16:08.652046  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.657397  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:08.682883 15839 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:08.683527 15839 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:08.692104  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.693172  9040 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:08.702301 15839 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:08.703943  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:08.705741  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:08.708757 15839 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:08.727766  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.733238  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.753679  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.789460  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:08.789673 15817 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:08.790303 15817 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:08.791543  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:08.793704 15817 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:08.793932  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:16:08.798194  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.798971  9590 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:08.799592  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:08.803653 15817 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:08.813369  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.849606  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.894254  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:08.944808  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:08.955963 15837 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:08.956600 15837 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:08.962751  9040 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:08.967429  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:08.969058  9037 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:08.970332 15839 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:08.971226 15837 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:09.032042  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.068225  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.078665 15809 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.079382 15809 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.084061 15870 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.084692 15870 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.086855 15870 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.087354 15870 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.087791 15870 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.088068 15809 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:09.089725  8966 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.090091  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.090728  9616 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:16:09.091887  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.097941  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.098646  9067 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:16:09.099099 15743 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:09.100131  8966 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.100885  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.101490  9067 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:16:09.101763  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.103354 15870 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.103909 15870 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:09.104259 15870 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.104625 15870 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.109474 15864 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.110006 15864 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.113703  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:09.114593 15809 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:09.115077 15809 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.115528 15809 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:09.099574 15743 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.116986 15743 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:09.131789 15870 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.133942 15870 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:09.127203  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 81572.9us
W20260709 12:16:09.140796  8966 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.143638  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 51833.8us
I20260709 12:16:09.136492 15864 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.159528  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4167a86c30a432d84c12cddcaef4f30" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.160123  9067 raft_consensus.cc:3060] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.162694 15839 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.187755 15839 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.190148 15839 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.197638  9067 raft_consensus.cc:2468] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:16:09.202049  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:16:09.204051  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.204586  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.213826 15743 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.215890  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.217756  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f774722c966e4c2b94851308244cbffd" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:09.218364  8964 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:09.218506  9616 raft_consensus.cc:3060] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:09.210458  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.219648 15876 raft_consensus.cc:2804] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:09.220225 15876 raft_consensus.cc:697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.221112 15876 consensus_queue.cc:237] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.224191  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.224668  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.225041  9040 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.225406  9040 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.233363  9616 raft_consensus.cc:2468] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 20.
I20260709 12:16:09.234822  8963 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:09.236565 15877 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:09.237174  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.241463  8966 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.242221  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.242558  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.227267 15743 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:09.248952  9040 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.251382 15873 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.252223 15873 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.254668 15865 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.255277 15865 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.258255  9040 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.240162 15872 raft_consensus.cc:2804] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:09.260366 15870 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.270633 15870 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.273088 15870 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.279734 15879 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.280285 15879 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.281096  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.275609 15872 raft_consensus.cc:697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.283480 15872 consensus_queue.cc:237] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.277372 15837 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:09.287547  8966 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.239255 15809 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.290120 15809 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:09.293396  8966 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.296046  8966 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.308212 15873 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.309713 15865 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.313050 15879 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.313608  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.314698  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f24528c4e0f24715985149f6366da832" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.314823  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.315326  9074 raft_consensus.cc:3060] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:09.315518  9065 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 16.
I20260709 12:16:09.323576  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.324626  9070 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:16:09.326336  9074 raft_consensus.cc:2468] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:16:09.329753  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:16:09.330536  9590 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.331687  8964 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.332756 15872 raft_consensus.cc:2749] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:09.333732  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.334908  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:09.335729 15872 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:09.336113 15872 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.336190 15865 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:09.336514 15872 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:09.337322 15839 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.337878 15839 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.340157 15839 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:09.346299  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.346853  8966 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.347581  8966 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.351394  9040 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.353751  8822 catalog_manager.cc:5697] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 14 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.350469  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.359750 15876 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:09.360195 15876 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.360577 15876 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:09.362486  8964 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.363446 15879 raft_consensus.cc:2804] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:09.363934 15879 raft_consensus.cc:697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.364780 15879 consensus_queue.cc:237] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.377746  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.378456  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
W20260709 12:16:09.385386  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:09.387430  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.381170 15876 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.393958 15876 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.395399 15873 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.409443 15873 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.411641 15873 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.412150 15839 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.412670 15839 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.414767 15839 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:09.418735  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.419371 15809 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.419909 15809 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:09.422367  9040 leader_election.cc:336] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.422786 15809 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.423580  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.424220  9616 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 18.
I20260709 12:16:09.425643  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:16:09.423728  8966 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.431416 15809 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:09.431823 15809 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.432215 15809 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:09.434899  8966 leader_election.cc:336] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.441285  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.443572  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bea2f56e504744b5355171d4aae5f3" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.444110  9074 raft_consensus.cc:3060] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:09.444123 15839 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:09.444689 15839 raft_consensus.cc:493] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.444970  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.445142 15839 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:09.447625  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.449080 15865 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.449640 15865 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.452497  9074 raft_consensus.cc:2468] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:16:09.452996 15839 raft_consensus.cc:515] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.453555  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.457532 15839 leader_election.cc:290] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:09.460740  9590 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.465353  9590 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.465198 15872 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.464381  9040 leader_election.cc:336] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.464849 15865 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.466692 15817 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:09.474669 15809 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:09.479667  8966 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.480367 15837 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.480696  9037 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.480964 15837 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.481542 15864 raft_consensus.cc:2749] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:09.482427  8964 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:09.490679  9040 leader_election.cc:336] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.483978  8964 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.487411 15879 raft_consensus.cc:2749] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:09.483115 15837 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:09.485088  8966 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.491956 15876 raft_consensus.cc:2804] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:09.492626 15876 raft_consensus.cc:697] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.493620 15876 consensus_queue.cc:237] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.494133  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.494201  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b85fd0864fe18832be4b2550889d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:09.494848  9070 raft_consensus.cc:3060] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:09.494940  8995 raft_consensus.cc:3060] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:09.498122  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.498775  8996 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 15.
I20260709 12:16:09.499987  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.500722 15837 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:09.501114 15837 raft_consensus.cc:493] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.501469 15837 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:09.505609  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e996a3dae284298bc7fecf1e8fdc675" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:09.506300  9616 raft_consensus.cc:3060] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:09.489288 15872 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.516512  9616 raft_consensus.cc:2468] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 19.
I20260709 12:16:09.516561  9070 raft_consensus.cc:2468] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 17.
I20260709 12:16:09.517534 15809 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.519560  8964 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.521648  8995 raft_consensus.cc:2468] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:16:09.519402  8963 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:09.522922  9037 leader_election.cc:304] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.524231 15873 raft_consensus.cc:2804] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:09.524835 15839 raft_consensus.cc:2804] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:09.527637 15873 raft_consensus.cc:697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.528275 15839 raft_consensus.cc:697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:09.528887 15873 consensus_queue.cc:237] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.529083 15839 consensus_queue.cc:237] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.530368  8966 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.523418 15879 raft_consensus.cc:2804] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:09.545756 15879 raft_consensus.cc:697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:09.547758 15865 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.548336 15865 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.548434 15879 consensus_queue.cc:237] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.551723 15865 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.554764  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.555449  9070 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 20.
I20260709 12:16:09.556818  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:09.518324 15837 raft_consensus.cc:515] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.565793  9590 leader_election.cc:336] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.561162 15824 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:09.567288 15824 raft_consensus.cc:493] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.567675 15824 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:09.593045 15824 raft_consensus.cc:515] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:09.602990  9590 leader_election.cc:336] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.609679  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447f05dcf4904c71bfa27d72667dc990" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.610286  9074 raft_consensus.cc:3060] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:09.611366  8819 catalog_manager.cc:5697] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 18 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 19 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:09.615157 15824 leader_election.cc:290] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.620671  9074 raft_consensus.cc:2468] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 21.
I20260709 12:16:09.622352  9588 leader_election.cc:304] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.623872 15824 raft_consensus.cc:2804] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:09.624692 15824 raft_consensus.cc:697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:16:09.625573 15824 consensus_queue.cc:237] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.608479 15839 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.629969 15839 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.632679 15839 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.608251 15878 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.616328 15865 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.638365  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.638810 15878 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.638938 15865 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.640950 15878 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.641104 15865 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.641673  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.642809  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.644044  9620 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 21.
I20260709 12:16:09.644414  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.649531 15837 leader_election.cc:290] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.651647  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4febe4c7f30f402a93c27138f2b4c778" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:09.652220  8995 raft_consensus.cc:3060] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:09.666100  8822 catalog_manager.cc:5697] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 19 to 20, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 20 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.667457  8822 catalog_manager.cc:5697] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 18 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 19 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.668102  8995 raft_consensus.cc:2468] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 16.
I20260709 12:16:09.669446  8822 catalog_manager.cc:5697] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 18 to 19, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 19 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.670534  8822 catalog_manager.cc:5697] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 17 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.671367  9037 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:09.673492 15864 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:09.673137  8822 catalog_manager.cc:5697] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 16 to 17, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 17 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.674481  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:09.680657 15891 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:09.681102 15891 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.681481 15891 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:09.683811  9037 leader_election.cc:304] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: 
I20260709 12:16:09.684111  9074 raft_consensus.cc:1275] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:16:09.685153 15878 raft_consensus.cc:2804] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:09.685693 15878 raft_consensus.cc:697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:09.686565 15878 consensus_queue.cc:237] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.693964 15876 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.694519 15876 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.696563 15873 consensus_queue.cc:1048] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:09.700380 15876 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.702721 15891 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.704917 15891 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:09.706460  9590 leader_election.cc:336] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.706934  9590 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:09.707574  8966 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.709489  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.710141  9070 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
I20260709 12:16:09.726958 15872 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.729219  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123584ad57374d41b689f4592fe92d4d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:09.729920  9620 raft_consensus.cc:3060] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:09.717917 15894 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:09.735330  9040 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.736197  9040 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.736877  9040 leader_election.cc:336] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:09.750133  9040 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.751744  9620 raft_consensus.cc:2468] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 22.
W20260709 12:16:09.750250  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 93909us
I20260709 12:16:09.728174 15872 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.758172 15872 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.759166 15817 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.759801 15817 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.762511 15817 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:09.763459  8966 leader_election.cc:336] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.766680  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.767319  8996 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
I20260709 12:16:09.768905  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:09.779980  9620 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 13.
W20260709 12:16:09.782418  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:09.797107  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.797962  9074 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 13.
W20260709 12:16:09.803682  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44696.3us
I20260709 12:16:09.806018  9037 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.807116  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:09.808236  8822 catalog_manager.cc:5697] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 20 to 21, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 21 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:09.821375  9588 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
W20260709 12:16:09.829322  9590 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.829828 15891 raft_consensus.cc:2804] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:16:09.846807 15891 raft_consensus.cc:697] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 22 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:09.847951 15891 consensus_queue.cc:237] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.833757 15837 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.850311 15837 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
W20260709 12:16:09.850948  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.852900 15837 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.834700  8822 catalog_manager.cc:5697] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 15 to 16, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 16 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:09.857707  9040 leader_election.cc:336] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.836531 15824 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:09.864823  8964 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:09.866456  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): ChangeConfig:REMOVE_PEER RPC failed for tablet 64324fda988042f2a6200271577d02a9: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.866906  8963 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.866228 15824 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.874099 15876 raft_consensus.cc:2749] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:09.870792 15837 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.877422 15824 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.880686 15837 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.880899  9615 raft_consensus.cc:1275] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:16:09.888757  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.872996 15906 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
W20260709 12:16:09.894903  9040 leader_election.cc:336] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.898818  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:09.899559  8995 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:16:09.891121 15837 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:09.874672 15908 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:09.903653 15908 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.895824 15906 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:09.907437 15908 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.901710  9074 raft_consensus.cc:1275] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:09.907757  8996 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 13.
I20260709 12:16:09.909397 15906 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.906387 15824 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.926810  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.935966 15891 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:09.936086  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.936491 15891 raft_consensus.cc:493] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.936975 15891 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:09.937058  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:09.941818  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:09.942466  9067 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.939379 15824 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:09.950567  9067 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
I20260709 12:16:09.951917  8822 catalog_manager.cc:5697] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 21 to 22, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 22 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.954567 15908 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.937973  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.938778 15906 consensus_queue.cc:1048] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:16:09.957852  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
W20260709 12:16:09.959530  8966 leader_election.cc:336] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.960172  8996 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 14: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:16:09.965327  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:16:09.966985  9590 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:09.967645  9590 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:09.969890 15824 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:09.973233 15872 consensus_queue.cc:1048] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:09.976437  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:09.977250  9620 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:16:09.976485 15899 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:09.978149 15892 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.978718 15892 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:09.977751 15908 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.988305  8996 raft_consensus.cc:1275] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:16:09.990219 15892 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:09.993602 15899 raft_consensus.cc:493] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:09.994194 15899 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:10.008438 15864 consensus_queue.cc:1048] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:16:10.014424  9040 leader_election.cc:336] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:10.017087  7716 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8946)
I20260709 12:16:10.020359  9070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:10.022415  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:10.014504 15899 raft_consensus.cc:515] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:10.024859  9620 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:16:10.030055  9070 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
W20260709 12:16:10.036042  8966 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:10.038328  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:10.040477  9067 raft_consensus.cc:2393] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fec7bba20864beea35ba1b33132e47d in current term 14: Already voted for candidate 491a1127924f43d4a369f7d09c3a68db in this term.
I20260709 12:16:10.038084  8966 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 4993160378a142a1bc21648120cbaebc, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:10.002589 15891 raft_consensus.cc:515] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:10.060613 15908 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:10.066535 15891 leader_election.cc:290] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:10.068553 15899 leader_election.cc:290] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:10.071549  9067 raft_consensus.cc:1275] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:10.060968 15892 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:10.072359 15892 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd11e77b4be14e658672599b30d51e76)
I20260709 12:16:10.072755 15892 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:10.085386  8964 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:10.090420  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:10.098230  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.102818 15906 raft_consensus.cc:3060] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:10.103652  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca28c4486a64eceb7e839d2891ef357" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:10.103434 15907 consensus_queue.cc:1048] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:10.104285  8996 raft_consensus.cc:3060] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:10.105729  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee1ce8134fc4f7e9ce1860cf467105b" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d"
I20260709 12:16:10.112124  9067 raft_consensus.cc:1275] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:16:10.133002  9040 leader_election.cc:336] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:10.133759  9040 leader_election.cc:336] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:10.134284  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.144194 15906 raft_consensus.cc:2749] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:10.145656  9620 raft_consensus.cc:1275] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:10.147328 15809 consensus_queue.cc:1048] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:10.153054  8996 raft_consensus.cc:2468] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
I20260709 12:16:10.155827  9037 leader_election.cc:304] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:10.157307 15902 consensus_queue.cc:1048] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:10.157542 15891 raft_consensus.cc:2804] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:16:10.157358  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.197899  8995 raft_consensus.cc:2468] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 14.
I20260709 12:16:10.159386 15891 raft_consensus.cc:697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
W20260709 12:16:10.205466  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:10.206214  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.208287  9037 leader_election.cc:304] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:10.224298 15891 consensus_queue.cc:237] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:10.217746 15899 raft_consensus.cc:2804] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:10.231896 15899 raft_consensus.cc:697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:10.232892 15899 consensus_queue.cc:237] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:10.254683  9070 raft_consensus.cc:1275] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Refusing update from remote peer 4993160378a142a1bc21648120cbaebc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:10.257290 15894 consensus_queue.cc:1048] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:10.296113  8996 raft_consensus.cc:1275] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:16:10.343632  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.353771  9615 raft_consensus.cc:1275] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:16:10.300482 15892 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:10.312508 15878 consensus_queue.cc:1048] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:16:10.361987 15891 consensus_queue.cc:1048] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:16:10.401006  8822 catalog_manager.cc:5697] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 19 to 20, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 20 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:10.413933 15892 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:10.451678  9616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be656547ea464996d40fcd3eb6a653" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:10.452500  9616 raft_consensus.cc:3060] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:10.479629  9616 raft_consensus.cc:2468] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
I20260709 12:16:10.499987  9037 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:10.502104 15892 raft_consensus.cc:2804] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:10.502724 15892 raft_consensus.cc:697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:10.503705 15892 consensus_queue.cc:237] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:10.475654 15920 log.cc:927] Time spent T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:16:10.551826  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 122536us
I20260709 12:16:10.626611  8814 catalog_manager.cc:5697] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 13 to 14, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 14 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:10.631021  9040 leader_election.cc:336] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:10.642031  8995 raft_consensus.cc:1275] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:10.648092 15899 consensus_queue.cc:1048] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:10.702661  8822 catalog_manager.cc:5697] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 17 to 18, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:10.713317  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:10.761605  8995 raft_consensus.cc:1275] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:16:10.763200 15899 consensus_queue.cc:1048] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:16:10.787468  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:10.904950  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:10.972157  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:11.012887  9615 raft_consensus.cc:1275] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:11.014485 15899 consensus_queue.cc:1048] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:16:11.017665  7716 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:11.066241  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.132223  9590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111) [suppressed 404 similar messages]
W20260709 12:16:11.152156  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.214221  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.231289  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.245584  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.254971  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.321781  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.360991  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.404757  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.424193  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.427009  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.470481  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.481927  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.511745  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.512631  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.586153  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.596207  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.604858  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 54344.7us
W20260709 12:16:11.631950  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.682612  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 69980.7us
W20260709 12:16:11.722031  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.723577  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:11.755694 15935 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.756946 15935 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:11.758222  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.758927  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:11.859360 15935 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:11.863797  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:11.864413  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 77018.4us
W20260709 12:16:11.865278  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 89214us
I20260709 12:16:11.932163  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:11.933533  9074 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:16:11.948454 15939 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:11.940114  8966 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:11.959368  8963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 98302.7us
W20260709 12:16:12.018486  7716 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8946)
I20260709 12:16:11.974275 15939 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:12.033221  9590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 73329.4us
W20260709 12:16:12.034205  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 76460.3us
W20260709 12:16:12.036118  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:12.041924  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:12.045312  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:12.052106  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:12.052289  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:12.053025  9615 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 14.
I20260709 12:16:12.145174  8963 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
W20260709 12:16:12.149539  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): ChangeConfig:REMOVE_PEER RPC failed for tablet 64324fda988042f2a6200271577d02a9: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:12.148283 15937 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:12.156005 15937 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:12.156448 15937 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.161336 15939 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:12.165068  9590 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:12.179153  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:12.183820  8996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:16:12.191215  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 53154.5us
I20260709 12:16:12.194670  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:12.198221  9067 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 14.
W20260709 12:16:12.190797  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:12.235358  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:12.285638 15937 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:12.313194  8996 raft_consensus.cc:2393] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4993160378a142a1bc21648120cbaebc in current term 15: Already voted for candidate 2fec7bba20864beea35ba1b33132e47d in this term.
I20260709 12:16:12.316881  9587 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:12.318557 15946 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.327085 15937 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Requested vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:12.328020  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
W20260709 12:16:12.336314  8966 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:12.350040  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64324fda988042f2a6200271577d02a9" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
I20260709 12:16:12.350662  9067 raft_consensus.cc:3060] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.361052  9067 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:16:12.372273 15946 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:12.381405  9615 raft_consensus.cc:2468] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec7bba20864beea35ba1b33132e47d in term 15.
I20260709 12:16:12.386373  8964 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: fd11e77b4be14e658672599b30d51e76
I20260709 12:16:12.387813 15937 raft_consensus.cc:2804] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:12.389240 15937 raft_consensus.cc:697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Becoming Leader. State: Replica: 2fec7bba20864beea35ba1b33132e47d, State: Running, Role: LEADER
I20260709 12:16:12.390383 15937 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:12.400067  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:12.478890  8822 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d reported cstate change: term changed from 13 to 15, leader changed from fd11e77b4be14e658672599b30d51e76 (127.7.137.1) to 2fec7bba20864beea35ba1b33132e47d (127.7.137.2). New cstate: current_term: 15 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:12.558530  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.569962  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.573547  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.600468  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.600499  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.601214  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.618299  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.727888  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.740204  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.774746  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:12.794240  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.875138  9620 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:12.881127 15938 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:16:13.034075  7716 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8946)
I20260709 12:16:13.041352  9074 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:13.069466 15937 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:13.354552  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 52650.4us
W20260709 12:16:13.394496  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.421854  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.446758  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.487746  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.489336  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 58251.6us
W20260709 12:16:13.497653  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.516486  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.651573  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.748040  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.761618  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 49208.2us
W20260709 12:16:13.820043  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.863216  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.879293  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.899104  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:13.904596  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.919795  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.899384  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47618.5us
W20260709 12:16:13.926985  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.941879  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.942514  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:13.958033  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.009408  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.034566  7716 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:14.042690  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.079227  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.089033  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.092367  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.113652  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.136303  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.251011  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800221480 after lost signal to thread 7719
W20260709 12:16:14.252291  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800194a60 after lost signal to thread 8857
W20260709 12:16:14.253734  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08001354a0 after lost signal to thread 9024
W20260709 12:16:14.255440  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800163940 after lost signal to thread 9098
W20260709 12:16:14.256649  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08003ccfc0 after lost signal to thread 9649
W20260709 12:16:14.470149  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.505342  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.554486  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.570655  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.613265  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.647462  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.736336  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.784821  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.865146  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:14.882618  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:14.960952  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.016674  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:15.035142  7716 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:15.035761  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.036378  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.075862  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.121304  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.172885  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.193394  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.300624  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.304291  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:15.381073  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.623750  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:15.893747  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:15.922369  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:16.024753  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.035703  7716 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:16.051748  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.108774  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.134668  9590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 12:16:16.138983  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.152856  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.219507  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.226814  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.275759  8995 consensus_queue.cc:237] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:16.292765  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.302103  9620 raft_consensus.cc:1275] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Refusing update from remote peer 2fec7bba20864beea35ba1b33132e47d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:16:16.305830 15980 consensus_queue.cc:1048] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:16:16.326367  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.341744  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:16.350025 15970 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 11 to 13, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:16.351915  9615 raft_consensus.cc:2955] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
I20260709 12:16:16.365347  8807 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64324fda988042f2a6200271577d02a9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260709 12:16:16.376612  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.378734  8822 catalog_manager.cc:5697] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc reported cstate change: config changed from index 11 to 13, VOTER 491a1127924f43d4a369f7d09c3a68db (127.7.137.3) evicted. New cstate: current_term: 15 leader_uuid: "2fec7bba20864beea35ba1b33132e47d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } } }
W20260709 12:16:16.403100  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.416534  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.430723  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:16.540637  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6e90ec1fa86446378a1fdff46884228e: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:16.553282  9064 tablet_service.cc:1558] Processing DeleteTablet for tablet 64324fda988042f2a6200271577d02a9 with delete_type TABLET_DATA_TOMBSTONED (TS 491a1127924f43d4a369f7d09c3a68db not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41290
W20260709 12:16:16.555099  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.558554  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.573289  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.576990 15989 tablet_replica.cc:333] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:16.578478 15989 raft_consensus.cc:2243] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.579773 15989 raft_consensus.cc:2272] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.592351 15989 ts_tablet_manager.cc:1916] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:16:16.615000  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.618736 15989 ts_tablet_manager.cc:1929] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:16:16.623484 15989 log.cc:1199] T 64324fda988042f2a6200271577d02a9 P 491a1127924f43d4a369f7d09c3a68db: Deleting WAL directory at /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/wals/64324fda988042f2a6200271577d02a9
W20260709 12:16:16.626718  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:16.634032  8808 catalog_manager.cc:5028] TS 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): tablet 64324fda988042f2a6200271577d02a9 (table test-workload [id=b89290bd61324e6c9215460ecb991b4b]) successfully deleted
W20260709 12:16:16.649674  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.692783  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:16.705461  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.016197  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.029600  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.031951  8964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 44708.4us
W20260709 12:16:17.036185  7716 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:17.046595  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.053692  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.054354  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.080077  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.106675  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.120728  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.148872  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.523102  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.500326  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.558503  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.601018  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.602185  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:17.615820  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.700606  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.701895  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.707629  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.733985  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 67049.1us
W20260709 12:16:17.761965  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:17.876085  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.024712  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:18.036646  7716 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:18.031556  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:18.176890  9587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 47640.3us
W20260709 12:16:18.307353  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.379779  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:18.448680  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.496796  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.535712  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.637111  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.637593  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.677280  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.680388  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:18.785698  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.819964  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.830852  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.843533  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:18.857645  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.904062  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:18.962433  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.037165  7716 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8946)
W20260709 12:16:19.065850  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.126942  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:19.166545  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.241935  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.311935  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 50302.4us
W20260709 12:16:19.334832  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.401571  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.403091  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.410833  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.420207  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.519060  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.548193  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.551321  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.554989  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.617195  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.680248  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.717959  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff260 after lost signal to thread 7719
W20260709 12:16:19.719141  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7880 after lost signal to thread 8857
W20260709 12:16:19.720707  9095 debug-util.cc:398] Leaking SignalData structure 0x7b0800301a00 after lost signal to thread 9024
W20260709 12:16:19.721836  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6b80 after lost signal to thread 9098
W20260709 12:16:19.723026  9095 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1880 after lost signal to thread 9649
W20260709 12:16:19.803957  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.876269  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:19.916184  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:19.929899  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.016307  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:20.049549  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.092877  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.134835  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:20.224242  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:20.280081  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.280771  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.297173  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.338855  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.431996  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.562377  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:20.799948  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:20.826450  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:21.633960  9590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111) [suppressed 428 similar messages]
W20260709 12:16:21.710037  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:21.710870  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:21.711661  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:21.723433  9040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.007s	sys 0.029s
W20260709 12:16:21.724145  9040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.008s	sys 0.030s
W20260709 12:16:21.813278  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 189297us
I20260709 12:16:21.823671 16001 raft_consensus.cc:493] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:21.825384 16001 raft_consensus.cc:515] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:21.846686 16001 leader_election.cc:290] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:21.850068 16023 raft_consensus.cc:493] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4993160378a142a1bc21648120cbaebc)
I20260709 12:16:21.860006 16023 raft_consensus.cc:515] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:21.867345 15993 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:21.872762 15993 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:21.870286 16023 leader_election.cc:290] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:21.877657 15993 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:21.883818 16013 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:21.884980 16013 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:21.888922 16013 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:21.904796  9590 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:21.907289  8994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "422d007cdc2c44f4b486ca22b87c8dd8" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:21.910907 16013 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:21.913281 16013 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:21.917831 16023 raft_consensus.cc:493] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:21.921208  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:21.918651 16023 raft_consensus.cc:515] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:21.920521  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:16:21.927657  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 110135us
I20260709 12:16:21.934841 16023 leader_election.cc:290] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:21.935328 16025 raft_consensus.cc:493] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:21.936270 16025 raft_consensus.cc:515] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:21.947734 16023 raft_consensus.cc:493] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:21.948616 16023 raft_consensus.cc:515] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:21.951264 16013 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:21.951040 16023 leader_election.cc:290] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:21.938997 16025 leader_election.cc:290] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:21.980494  9590 leader_election.cc:336] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:21.983453  8966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 76476.9us
I20260709 12:16:21.985133  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030add77af8944519fa93baf328b3e4a" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:21.987852  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:21.988826 16013 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:21.990830 16022 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:21.991818 16022 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:22.007539 16022 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:21.991030  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:22.011157  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:22.012543  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.010892  9587 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:22.009197  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.014014 16013 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:22.009455  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 57010.2us
I20260709 12:16:22.031047 16022 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:22.032034 16022 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:22.034756 16022 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:22.040474  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.041538 16022 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:16:22.042531  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.042315 16022 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:22.043017  8966 leader_election.cc:336] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:22.043486  8966 leader_election.cc:336] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:22.043866  8966 leader_election.cc:336] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:22.044603 16022 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:22.044761  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.045289  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:22.050403  9040 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:22.051107  9040 leader_election.cc:336] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:22.057451 16027 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:22.059846 16027 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:22.062251 16027 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:22.070562  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.099252  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1231588583a41de9b59e17189e8545b" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:22.113591 16018 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:22.114382 16018 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:22.116716 16018 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:22.123133  9040 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:22.127286  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1840 after lost signal to thread 7719
W20260709 12:16:22.128861  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4c00 after lost signal to thread 8857
W20260709 12:16:22.130647  9021 debug-util.cc:398] Leaking SignalData structure 0x7b080030b240 after lost signal to thread 9024
W20260709 12:16:22.133029  9021 debug-util.cc:398] Leaking SignalData structure 0x7b08002af760 after lost signal to thread 9098
W20260709 12:16:22.137478  9021 debug-util.cc:398] Leaking SignalData structure 0x7b0800121940 after lost signal to thread 9649
W20260709 12:16:22.142484  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.148432  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703a24767eb84ead9befa5c1beff0063" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:22.149201  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617ce264333c4b249320780af77038ce" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:22.150549  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2c8c51a5344057978683f2249e4fab" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:22.153605  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9ee0b0b4df4d3abfdf4c57b26939a5" candidate_uuid: "2fec7bba20864beea35ba1b33132e47d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:22.154273  8997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:22.154556  8995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566f7a1027e341e88b14a77db605c154" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:22.156145  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea78b632dcc844fabe1d6e7b6012f9ff" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:22.158571  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:22.164913  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:22.166368  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:16:22.172497  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.178501  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
I20260709 12:16:22.199406  9620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:22.202869  8964 leader_election.cc:304] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:22.204654 16023 raft_consensus.cc:2749] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:22.207367  8998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cab06a8b964cdc84cf62efa5868208" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2fec7bba20864beea35ba1b33132e47d" is_pre_election: true
W20260709 12:16:22.216379  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.220613  8964 leader_election.cc:304] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.221652 16006 raft_consensus.cc:2749] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:22.249643  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:22.257606  8964 leader_election.cc:304] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.258489 16006 raft_consensus.cc:2749] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:22.258934  8964 leader_election.cc:304] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.259697 16006 raft_consensus.cc:2749] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:22.260452  8964 leader_election.cc:304] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fec7bba20864beea35ba1b33132e47d; no voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:22.261231 16023 raft_consensus.cc:2749] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:22.267432  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:22.268885  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.269349 16022 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:22.269781 16016 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:22.271189  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.271984 16016 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:22.273166  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:22.273892 16016 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:22.275180  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:22.275941 16016 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:22.280606  9037 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:22.281389 16016 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:22.335969  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:22.339677  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.539407  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.712306  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.712909  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.729046  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.759889  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.930402  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.933557  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.934263  8966 consensus_peers.cc:597] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.950062  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:22.971894  8966 consensus_peers.cc:597] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.010624  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.039124  8966 consensus_peers.cc:597] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.058718  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.082620  8966 consensus_peers.cc:597] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.195669  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.243604  8966 consensus_peers.cc:597] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.279250  8966 consensus_peers.cc:597] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.281118  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:23.288136  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.455041  8966 consensus_peers.cc:597] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.465579  8966 consensus_peers.cc:597] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:23.552798  8966 consensus_peers.cc:597] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.725215  8966 consensus_peers.cc:597] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:16:23.758011  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:16:23.818795  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:23.927843  8966 consensus_peers.cc:597] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:23.935491  8966 consensus_peers.cc:597] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:23.941224  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:23.942515  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:23.945585  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:24.134182  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.171402  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:24.257016  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:16:24.275820  9587 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.299667  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:24.316457  9587 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.318367  9037 consensus_peers.cc:597] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.338984  9037 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.353426  9587 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.356122  9037 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.387418  9037 consensus_peers.cc:597] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.398000  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.415531  9037 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.420241  8966 consensus_peers.cc:597] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.428548  8966 consensus_peers.cc:597] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.445494  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:24.452033  9037 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.452804  9587 consensus_peers.cc:597] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.474690  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.478096  9037 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.488372  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:24.518554  9587 consensus_peers.cc:597] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.536305  9037 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.541599  8966 consensus_peers.cc:597] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.542876  9587 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.549911  9037 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.550490  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:24.555393  9037 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.553539  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:16:24.559381  9587 consensus_peers.cc:597] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.560772  7716 tablet_replica.cc:333] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.563593  7716 raft_consensus.cc:2243] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.564318  7716 raft_consensus.cc:2272] T 3f07e4a3742b455d9d586fda2b111e62 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.564393  9037 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.567900  7716 tablet_replica.cc:333] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.579352  7716 raft_consensus.cc:2243] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:16:24.599511  9587 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.583549  9037 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.609237  9037 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.613615  9587 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.631790  7716 raft_consensus.cc:2272] T f774722c966e4c2b94851308244cbffd P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.634963  7716 tablet_replica.cc:333] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.635891  7716 raft_consensus.cc:2243] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.637398  7716 raft_consensus.cc:2272] T f4167a86c30a432d84c12cddcaef4f30 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.659861  7716 tablet_replica.cc:333] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.660805  7716 raft_consensus.cc:2243] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.661507  7716 raft_consensus.cc:2272] T 617ce264333c4b249320780af77038ce P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.664499  7716 tablet_replica.cc:333] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.665318  7716 raft_consensus.cc:2243] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:24.674494  9587 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:24.679227  9037 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.666188  7716 raft_consensus.cc:2272] T 2f9e57d64a28430bb24c6a130105d58e P 2fec7bba20864beea35ba1b33132e47d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.690313  7716 tablet_replica.cc:333] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.691222  7716 raft_consensus.cc:2243] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.692917  7716 raft_consensus.cc:2272] T 996aff69fd874168bec179a4292ac2e2 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.695299  8966 consensus_peers.cc:597] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:24.715878  7716 tablet_replica.cc:333] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.716830  7716 raft_consensus.cc:2243] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.718083  7716 raft_consensus.cc:2272] T 30cab06a8b964cdc84cf62efa5868208 P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.721266  7716 tablet_replica.cc:333] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.722074  7716 raft_consensus.cc:2243] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:16:24.736657  9037 consensus_peers.cc:597] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.743932  7716 raft_consensus.cc:2272] T 8e25b484158d4e599cd55c7f9a740e11 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.757525  7716 tablet_replica.cc:333] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.758647  7716 raft_consensus.cc:2243] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.767432  7716 raft_consensus.cc:2272] T 2d1d6970fddb4442a12d0adcf1a1980b P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.770581  7716 tablet_replica.cc:333] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.771478  7716 raft_consensus.cc:2243] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.780052  7716 raft_consensus.cc:2272] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.789969  7716 tablet_replica.cc:333] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.800073  7716 raft_consensus.cc:2243] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.800925  7716 raft_consensus.cc:2272] T 22ba05ad5deb4210a163e266631b3e67 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.804014  7716 tablet_replica.cc:333] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.808660  7716 raft_consensus.cc:2243] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.810079  7716 raft_consensus.cc:2272] T 13d273c2182c4f4d86d85935b864463c P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.822371  7716 tablet_replica.cc:333] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.829134  7716 raft_consensus.cc:2243] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:16:24.815145  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:24.841789  7716 raft_consensus.cc:2272] T 9093f0f82b7942b39a479d2142fc6b1f P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.845144  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:24.845214  7716 tablet_replica.cc:333] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.849407  7716 raft_consensus.cc:2243] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.850243  7716 raft_consensus.cc:2272] T 7cc6b85fd0864fe18832be4b2550889d P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.853188  7716 tablet_replica.cc:333] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.864082  7716 raft_consensus.cc:2243] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.864985  7716 raft_consensus.cc:2272] T ae12ea4362164b50bece754b6f6bd834 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.868312  7716 tablet_replica.cc:333] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.884104  7716 raft_consensus.cc:2243] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.885592  7716 raft_consensus.cc:2272] T e5bea2f56e504744b5355171d4aae5f3 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:24.896888  7716 tablet_replica.cc:333] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.898123  7716 raft_consensus.cc:2243] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:24.899067  7716 raft_consensus.cc:2272] T db8cdabd573f46e28a22e367d9de5201 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.873668  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:16:24.908483  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:24.928516  7716 tablet_replica.cc:333] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.930379  7716 raft_consensus.cc:2243] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.931958  7716 raft_consensus.cc:2272] T f24528c4e0f24715985149f6366da832 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:24.934665  9588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:34547, user_credentials={real_user=slave}} blocked reactor thread for 99474.3us
I20260709 12:16:24.980551  7716 tablet_replica.cc:333] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:24.981706  7716 raft_consensus.cc:2243] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:24.983047  7716 raft_consensus.cc:2272] T 9e996a3dae284298bc7fecf1e8fdc675 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.005249  7716 tablet_replica.cc:333] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.010162  7716 raft_consensus.cc:2243] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.011456  7716 raft_consensus.cc:2272] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.027721  7716 tablet_replica.cc:333] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.030256  7716 raft_consensus.cc:2243] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.035881  7716 raft_consensus.cc:2272] T 703a24767eb84ead9befa5c1beff0063 P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.048588  7716 tablet_replica.cc:333] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
W20260709 12:16:25.049220  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 84952.8us
W20260709 12:16:25.049196  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6e90ec1fa86446378a1fdff46884228e: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:25.050876  7716 raft_consensus.cc:2243] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.052237  7716 raft_consensus.cc:2272] T 422d007cdc2c44f4b486ca22b87c8dd8 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.055073  7716 tablet_replica.cc:333] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.056016  7716 raft_consensus.cc:2243] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.057226  7716 raft_consensus.cc:2272] T 5dde2f9282d04104a95b6e08dc322ad4 P 2fec7bba20864beea35ba1b33132e47d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.060117  7716 tablet_replica.cc:333] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.060949  7716 raft_consensus.cc:2243] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.062003  7716 raft_consensus.cc:2272] T 4febe4c7f30f402a93c27138f2b4c778 P 2fec7bba20864beea35ba1b33132e47d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.064880  7716 tablet_replica.cc:333] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.065716  7716 raft_consensus.cc:2243] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.066432  7716 raft_consensus.cc:2272] T b6874650616d4242a2b161a9a22a07ad P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.069253  7716 tablet_replica.cc:333] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.074167  7716 raft_consensus.cc:2243] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.075213  7716 raft_consensus.cc:2272] T 0daf2fc07a0041229724f51fb6f5fc01 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.077899  7716 tablet_replica.cc:333] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.078689  7716 raft_consensus.cc:2243] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.079434  7716 raft_consensus.cc:2272] T a4285e23e73840659806e00d6213792a P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.093178  7716 tablet_replica.cc:333] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.094228  7716 raft_consensus.cc:2243] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:25.094396  9040 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.095073  7716 raft_consensus.cc:2272] T d1231588583a41de9b59e17189e8545b P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.098258  7716 tablet_replica.cc:333] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.099133  7716 raft_consensus.cc:2243] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.100946  7716 raft_consensus.cc:2272] T 2ee1ce8134fc4f7e9ce1860cf467105b P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.110148  7716 tablet_replica.cc:333] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.111095  7716 raft_consensus.cc:2243] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.113066  7716 raft_consensus.cc:2272] T 64324fda988042f2a6200271577d02a9 P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.117985  7716 tablet_replica.cc:333] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
W20260709 12:16:25.120488  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.123963  7716 raft_consensus.cc:2243] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.125161  7716 raft_consensus.cc:2272] T 1681ffac65ee495d8dd8530b021d3307 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.128188  7716 tablet_replica.cc:333] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.138280  7716 raft_consensus.cc:2243] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.139624  7716 raft_consensus.cc:2272] T c47609ef9e5d4514945afe81e24e790d P 2fec7bba20864beea35ba1b33132e47d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.142728  7716 tablet_replica.cc:333] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.143648  7716 raft_consensus.cc:2243] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.148368  7716 raft_consensus.cc:2272] T 747c26453321457087376c5a57b2b7bb P 2fec7bba20864beea35ba1b33132e47d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.151283  7716 tablet_replica.cc:333] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.152652  7716 raft_consensus.cc:2243] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.160290  7716 raft_consensus.cc:2272] T 309f8de493054d15b198c2f7ddeb70b4 P 2fec7bba20864beea35ba1b33132e47d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.168197  7716 tablet_replica.cc:333] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.169090  7716 raft_consensus.cc:2243] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.169802  7716 raft_consensus.cc:2272] T cca28c4486a64eceb7e839d2891ef357 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.182655  7716 tablet_replica.cc:333] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.183512  7716 raft_consensus.cc:2243] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.184381  7716 raft_consensus.cc:2272] T 2c2c8c51a5344057978683f2249e4fab P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.202101  7716 tablet_replica.cc:333] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.208976  7716 raft_consensus.cc:2243] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.210148  7716 raft_consensus.cc:2272] T 284fe781057a4484a4910b55152f99af P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.213843  7716 tablet_replica.cc:333] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.219357  7716 raft_consensus.cc:2243] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.220284  7716 raft_consensus.cc:2272] T 4be7ce502f794156a9be9d258ca1e04f P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:25.222337  9040 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.251345  7716 tablet_replica.cc:333] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.252252  7716 raft_consensus.cc:2243] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.253649  7716 raft_consensus.cc:2272] T 6e90ec1fa86446378a1fdff46884228e P 2fec7bba20864beea35ba1b33132e47d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:25.260643  8966 consensus_peers.cc:597] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.264529  7716 tablet_replica.cc:333] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.265458  7716 raft_consensus.cc:2243] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.266373  7716 raft_consensus.cc:2272] T f56979e1608d4fcc873d5537e8345d33 P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.269210  7716 tablet_replica.cc:333] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.275959  7716 raft_consensus.cc:2243] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.277253  7716 raft_consensus.cc:2272] T 6c56340353dd41d9a99bb2e22fe8c536 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.280129  7716 tablet_replica.cc:333] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.280908  7716 raft_consensus.cc:2243] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.281582  7716 raft_consensus.cc:2272] T 1d515be0508e478dbeaa4e7bf253d48d P 2fec7bba20864beea35ba1b33132e47d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.284750  7716 tablet_replica.cc:333] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.285566  7716 raft_consensus.cc:2243] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.286374  7716 raft_consensus.cc:2272] T 7bfeb6de89004568abc3f47eb68ee5bf P 2fec7bba20864beea35ba1b33132e47d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.289331  7716 tablet_replica.cc:333] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.290117  7716 raft_consensus.cc:2243] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.291389  7716 raft_consensus.cc:2272] T ea78b632dcc844fabe1d6e7b6012f9ff P 2fec7bba20864beea35ba1b33132e47d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.294442  7716 tablet_replica.cc:333] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.295229  7716 raft_consensus.cc:2243] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.296656  7716 raft_consensus.cc:2272] T 566f7a1027e341e88b14a77db605c154 P 2fec7bba20864beea35ba1b33132e47d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.299492  7716 tablet_replica.cc:333] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.300239  7716 raft_consensus.cc:2243] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.301502  7716 raft_consensus.cc:2272] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.304255  7716 tablet_replica.cc:333] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d: stopping tablet replica
I20260709 12:16:25.304944  7716 raft_consensus.cc:2243] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:25.305522  7716 raft_consensus.cc:2272] T 8552a23b53d0499abefc4f4a5af10c93 P 2fec7bba20864beea35ba1b33132e47d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:25.408181  9040 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:25.461800  9040 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:25.476361  9040 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:25.494438  9040 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:25.600226  9040 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:25.641271  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.661382 16033 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:25.671134 16033 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:25.678705 16033 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:25.764640  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:25.765604 16040 raft_consensus.cc:493] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:25.768319 16029 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:25.768216 16040 raft_consensus.cc:515] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:25.769021 16029 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:25.776240  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:25.778127  9590 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:25.777313 16040 leader_election.cc:290] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:25.783819 16029 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:25.805845 16007 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
W20260709 12:16:25.806630  9037 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:25.806499 16007 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:25.807193  9037 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:25.809046 16007 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:25.825974  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:25.836089  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:16:25.838038  9587 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:25.842579 16042 raft_consensus.cc:493] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:25.849705 16042 raft_consensus.cc:515] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:25.852531 16042 leader_election.cc:290] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:25.853222  9587 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:25.858502 16047 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:25.854748  9040 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:25.861456  9040 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:25.862737  9587 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:25.870740  9040 consensus_peers.cc:597] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:25.871007  9587 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:25.872400 16051 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:25.873977  9040 consensus_peers.cc:597] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:25.870774 16029 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:25.877797 16033 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:25.878376 16033 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:25.880694 16033 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:25.884862  9040 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:25.886417  9040 leader_election.cc:336] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:25.887755  9040 leader_election.cc:304] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:25.892550 16029 raft_consensus.cc:2749] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:25.894136  9587 leader_election.cc:336] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:25.900053  9590 leader_election.cc:336] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:25.897819  9037 leader_election.cc:336] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:25.900604  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:25.900799  9037 leader_election.cc:304] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:25.901530 16047 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:25.901648 16029 raft_consensus.cc:2749] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:26.007696 16042 raft_consensus.cc:493] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.009455 16042 raft_consensus.cc:515] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.016633 16042 leader_election.cc:290] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:26.055922  9037 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.058177 16042 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.058832 16042 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.063871 16042 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
W20260709 12:16:26.071278  9040 leader_election.cc:336] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.080572  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:26.082155  9619 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 17.
I20260709 12:16:26.082888  9040 leader_election.cc:304] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.084028 16051 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.084769 16051 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.087203 16051 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:26.094951  9587 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:26.099684  9590 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.100242  9590 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.105338 16051 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:26.102072  9040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:41023, user_credentials={real_user=slave}} blocked reactor thread for 45455.8us
I20260709 12:16:26.102614 16042 raft_consensus.cc:2749] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:26.109097 16045 raft_consensus.cc:493] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.109666 16045 raft_consensus.cc:515] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.111977 16045 leader_election.cc:290] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.112763 16045 raft_consensus.cc:493] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.113368 16045 raft_consensus.cc:515] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.115630 16045 leader_election.cc:290] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.116760  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:26.120337 16042 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:26.120813 16042 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.121255 16042 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:26.152587 16051 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.153348 16051 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.166100 16047 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.166782 16047 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.169281 16047 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.172992 16047 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.173663 16047 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.185990  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996aff69fd874168bec179a4292ac2e2" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:26.186722  9072 raft_consensus.cc:2468] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 18.
I20260709 12:16:26.188311 16047 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:26.191282  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
W20260709 12:16:26.192552  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35539, user_credentials={real_user=slave}} blocked reactor thread for 44836.7us
W20260709 12:16:26.193107  9037 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.196401 16051 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:26.196877  9040 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.211171  9587 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:26.212020  9040 leader_election.cc:336] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.212177  9037 leader_election.cc:336] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.217991  9037 leader_election.cc:304] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.213712  9587 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:16:26.219125  9037 leader_election.cc:336] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.219581  9037 leader_election.cc:304] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.220257 16029 raft_consensus.cc:2749] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:26.220870 16029 raft_consensus.cc:2749] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:26.222061 16051 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:26.229844  9040 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:26.240793  9040 consensus_peers.cc:597] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.230813  9590 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.242758  9590 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.243188  9587 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.244901  9587 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.250825 16051 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:26.255951  9587 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.257088  9587 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.238690 16042 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.263368 16051 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:26.264281 16047 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.264905 16047 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.268419  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:26.270774 16047 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:26.277549  9037 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.278688  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e25b484158d4e599cd55c7f9a740e11" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:26.278893 16042 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.279347  9619 raft_consensus.cc:3060] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:26.280365 16029 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.280869 16029 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.280392 16045 raft_consensus.cc:493] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.282166 16045 raft_consensus.cc:515] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.282884 16029 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.284083 16045 leader_election.cc:290] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.286801  9619 raft_consensus.cc:2468] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 18.
W20260709 12:16:26.288388  9037 leader_election.cc:336] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:26.288941  9037 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.300328  9037 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.301527 16042 raft_consensus.cc:2804] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:26.302114 16042 raft_consensus.cc:697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:26.312623 16045 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.313199 16045 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.315510 16045 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.322211 16048 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.322907 16048 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.325294 16048 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:26.328670  9037 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.335875  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:26.336165  9615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:26.336571  9619 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
I20260709 12:16:26.336797  9615 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 7.
I20260709 12:16:26.303117 16042 consensus_queue.cc:237] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:26.350227  9040 leader_election.cc:336] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.352466  9040 leader_election.cc:304] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:26.354780  9587 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.357316 16040 raft_consensus.cc:2749] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:26.360108  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:26.365525  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.370886  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.371431 16047 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:26.372040 16045 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:26.372480 16045 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.372843 16045 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:26.375416 16029 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:26.375792 16029 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.376145 16029 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:26.380079  9587 leader_election.cc:336] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:26.384128  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.387037  9590 leader_election.cc:336] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.388608  9590 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.389003 16045 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.393049 16047 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:26.395430 16045 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.389899 16029 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:26.403157  9037 leader_election.cc:336] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.404004  8819 catalog_manager.cc:5697] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 17 to 18, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 18 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.408942 16029 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.411616  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8a12b09f964de2b0eb86fb75bdbfd0" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:26.412197  9619 raft_consensus.cc:3060] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:26.418159  9037 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.420742  9619 raft_consensus.cc:2468] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 21.
I20260709 12:16:26.430820  9037 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.431807 16029 raft_consensus.cc:2804] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:26.432355 16029 raft_consensus.cc:697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 21 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:26.433604 16029 consensus_queue.cc:237] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.446969  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747c26453321457087376c5a57b2b7bb" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:26.447592  9619 raft_consensus.cc:3060] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:26.448241 16047 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.448808 16047 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.454757  9619 raft_consensus.cc:2468] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 8.
I20260709 12:16:26.451141 16047 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:26.463147  9587 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.464457 16040 raft_consensus.cc:493] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.465032 16040 raft_consensus.cc:515] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.467796 16040 leader_election.cc:290] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.469430 16040 raft_consensus.cc:493] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.471820 16040 raft_consensus.cc:515] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.475566 16040 leader_election.cc:290] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.469993 16045 raft_consensus.cc:493] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.478642 16045 raft_consensus.cc:515] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.481501 16045 leader_election.cc:290] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:26.489190 16040 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.489909 16040 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.492494 16040 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.505986  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
W20260709 12:16:26.505419  9590 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.463460  9037 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.507180  9590 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:26.507958  9037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:33071, user_credentials={real_user=slave}} blocked reactor thread for 44583.9us
I20260709 12:16:26.508054 16047 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:26.511974  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:26.513320 16040 raft_consensus.cc:2804] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:26.514357 16040 raft_consensus.cc:697] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:26.516600  8819 catalog_manager.cc:5697] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 20 to 21, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 21 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.518105  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
I20260709 12:16:26.518875  9619 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 19.
I20260709 12:16:26.521440 16040 consensus_queue.cc:237] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:26.541518  9040 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.544698  9040 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.545531  9040 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:26.543707  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 
I20260709 12:16:26.547062 16056 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:26.547657 16056 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.548180 16056 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:26.561921  9037 leader_election.cc:336] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.562486  9037 leader_election.cc:304] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.571758 16045 raft_consensus.cc:2749] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:26.572086  9037 leader_election.cc:336] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.572777  9037 leader_election.cc:304] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.573740 16045 raft_consensus.cc:2749] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:26.574039  9037 leader_election.cc:336] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.574671  9037 leader_election.cc:304] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:26.582695  9037 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.582796 16040 raft_consensus.cc:2749] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:26.578485 16056 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.589480  8819 catalog_manager.cc:5697] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 7 to 8, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 8 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.590029 16056 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.601485  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681ffac65ee495d8dd8530b021d3307" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc"
I20260709 12:16:26.602128  9619 raft_consensus.cc:3060] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:26.608774  9619 raft_consensus.cc:2468] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491a1127924f43d4a369f7d09c3a68db in term 20.
W20260709 12:16:26.609112  9037 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.610128  9037 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.615541 16056 raft_consensus.cc:2804] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:26.616182 16056 raft_consensus.cc:697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Becoming Leader. State: Replica: 491a1127924f43d4a369f7d09c3a68db, State: Running, Role: LEADER
I20260709 12:16:26.617106 16056 consensus_queue.cc:237] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.631330 16056 raft_consensus.cc:493] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.632143 16056 raft_consensus.cc:515] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } }
I20260709 12:16:26.636839  8819 catalog_manager.cc:5697] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db reported cstate change: term changed from 19 to 20, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 491a1127924f43d4a369f7d09c3a68db (127.7.137.3). New cstate: current_term: 20 leader_uuid: "491a1127924f43d4a369f7d09c3a68db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:26.639484  9037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111) [suppressed 576 similar messages]
I20260709 12:16:26.645974 16056 leader_election.cc:290] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:26.653946  9040 leader_election.cc:336] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:26.657195  9037 leader_election.cc:336] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.659183  9037 leader_election.cc:304] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:26.660123 16056 raft_consensus.cc:2749] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:26.658222 16047 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.660920 16047 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:26.670536  9587 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.671204 16056 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.671969 16056 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.673478  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db" is_pre_election: true
I20260709 12:16:26.674263  9072 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 20.
I20260709 12:16:26.674939 16056 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 4993160378a142a1bc21648120cbaebc (127.7.137.4:33071)
I20260709 12:16:26.675802  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.676805 16048 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:26.677266 16048 raft_consensus.cc:493] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:26.677714 16048 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:26.686957  9619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "491a1127924f43d4a369f7d09c3a68db" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4993160378a142a1bc21648120cbaebc" is_pre_election: true
W20260709 12:16:26.690258  9037 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.696519 16047 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:26.703830 16048 raft_consensus.cc:515] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:26.705703  9037 consensus_peers.cc:597] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.706404  9037 consensus_peers.cc:597] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:26.706560  9619 raft_consensus.cc:2393] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491a1127924f43d4a369f7d09c3a68db in current term 21: Already voted for candidate 4993160378a142a1bc21648120cbaebc in this term.
I20260709 12:16:26.710072  9037 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db; no voters: 2fec7bba20864beea35ba1b33132e47d, 4993160378a142a1bc21648120cbaebc
I20260709 12:16:26.711766 16045 raft_consensus.cc:3060] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:26.712384  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d86a8f62c34e43b9b89b2a4a19cf2d" candidate_uuid: "4993160378a142a1bc21648120cbaebc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "491a1127924f43d4a369f7d09c3a68db"
W20260709 12:16:26.716428  9587 leader_election.cc:336] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:26.710330 16048 leader_election.cc:290] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Requested vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:26.724332 16045 raft_consensus.cc:2749] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:26.737838  9037 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.745935  9587 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:26.750268  9072 raft_consensus.cc:2468] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4993160378a142a1bc21648120cbaebc in term 21.
W20260709 12:16:26.751160  9037 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:26.757400  9588 leader_election.cc:304] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491a1127924f43d4a369f7d09c3a68db, 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d
I20260709 12:16:26.759156 16047 raft_consensus.cc:2804] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:26.759769 16047 raft_consensus.cc:697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Becoming Leader. State: Replica: 4993160378a142a1bc21648120cbaebc, State: Running, Role: LEADER
I20260709 12:16:26.760902 16047 consensus_queue.cc:237] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:26.773205  9619 raft_consensus.cc:1275] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:16:26.775647 16056 consensus_queue.cc:1048] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:16:26.779072  9037 consensus_peers.cc:597] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.786450  9037 consensus_peers.cc:597] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.799387  9040 consensus_peers.cc:597] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.803763  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.813410  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff840 after lost signal to thread 7719
W20260709 12:16:26.814503  9646 debug-util.cc:398] Leaking SignalData structure 0x7b0800345060 after lost signal to thread 8857
W20260709 12:16:26.815949  9646 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0860 after lost signal to thread 9098
W20260709 12:16:26.817158  9646 debug-util.cc:398] Leaking SignalData structure 0x7b080037d8e0 after lost signal to thread 9649
I20260709 12:16:26.826014  8819 catalog_manager.cc:5697] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc reported cstate change: term changed from 20 to 21, leader changed from 2fec7bba20864beea35ba1b33132e47d (127.7.137.2) to 4993160378a142a1bc21648120cbaebc (127.7.137.4). New cstate: current_term: 21 leader_uuid: "4993160378a142a1bc21648120cbaebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:26.833393  9037 consensus_peers.cc:597] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.860335  9037 consensus_peers.cc:597] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:26.863741  9037 consensus_peers.cc:597] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:26.881433  9587 consensus_peers.cc:597] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.886444  9040 consensus_peers.cc:597] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:16:26.896577  9587 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.911067  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.918650  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:26.927170  9040 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:26.930496  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
I20260709 12:16:26.939728  9615 raft_consensus.cc:1275] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:26.944088 16029 consensus_queue.cc:1048] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:16:26.968073  9587 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:26.991372  9587 consensus_peers.cc:597] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.012319  9588 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.018543  9037 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.021662  9588 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.055091  9587 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.070538  9037 consensus_peers.cc:597] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.085248  9587 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.095005  9587 consensus_peers.cc:597] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.098992  9037 consensus_peers.cc:597] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.109400  9037 consensus_peers.cc:597] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.109851  9037 consensus_peers.cc:597] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:27.118207  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:16:27.121301  9037 consensus_peers.cc:597] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:27.124073  7716 tablet_replica.cc:333] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.125377  7716 raft_consensus.cc:2243] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.126276  7716 raft_consensus.cc:2272] T c98b3fa87be744c6a1d2a811af614ebc P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.127166  9590 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:27.130194  7716 tablet_replica.cc:333] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.131323  7716 raft_consensus.cc:2243] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.132179  7716 raft_consensus.cc:2272] T f4167a86c30a432d84c12cddcaef4f30 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.132649  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:27.135496  7716 tablet_replica.cc:333] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.136747  7716 raft_consensus.cc:2243] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.138085  7716 raft_consensus.cc:2272] T 3f07e4a3742b455d9d586fda2b111e62 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.152578  7716 tablet_replica.cc:333] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.153640  7716 raft_consensus.cc:2243] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.154592  7716 raft_consensus.cc:2272] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 491a1127924f43d4a369f7d09c3a68db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.157945  7716 tablet_replica.cc:333] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.160109  9615 raft_consensus.cc:1275] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:16:27.160199  7716 raft_consensus.cc:2243] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.161725 16056 consensus_queue.cc:1048] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:27.162400  7716 raft_consensus.cc:2272] T 617ce264333c4b249320780af77038ce P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.166662  7716 tablet_replica.cc:333] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.173775  9619 raft_consensus.cc:1275] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Refusing update from remote peer 491a1127924f43d4a369f7d09c3a68db: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:16:27.175926 16056 consensus_queue.cc:1048] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:16:27.179052  9588 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.185075  7716 raft_consensus.cc:2243] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.187446  7716 raft_consensus.cc:2272] T 996aff69fd874168bec179a4292ac2e2 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.204461  9587 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.219398  9037 consensus_peers.cc:597] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.222319  9037 consensus_peers.cc:597] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:27.235214  9590 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:27.238471  7716 tablet_replica.cc:333] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.239516  7716 raft_consensus.cc:2243] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.243547  7716 raft_consensus.cc:2272] T 4eae6c679d7f4d4a9422d66f842d1d7d P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.247222  7716 tablet_replica.cc:333] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.248174  7716 raft_consensus.cc:2243] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.248944  7716 raft_consensus.cc:2272] T 566f7a1027e341e88b14a77db605c154 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.251782  7716 tablet_replica.cc:333] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.252828  7716 raft_consensus.cc:2243] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.254264  7716 raft_consensus.cc:2272] T 30cab06a8b964cdc84cf62efa5868208 P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.257282  7716 tablet_replica.cc:333] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.261710  9587 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:27.271299  7716 raft_consensus.cc:2243] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.272135  7716 raft_consensus.cc:2272] T 9093f0f82b7942b39a479d2142fc6b1f P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.273092  9588 consensus_peers.cc:597] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.273803  9588 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.275405  7716 tablet_replica.cc:333] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.276788  7716 raft_consensus.cc:2243] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.277940  7716 raft_consensus.cc:2272] T 7cc6b85fd0864fe18832be4b2550889d P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.280668  7716 tablet_replica.cc:333] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.281526  7716 raft_consensus.cc:2243] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.282279  7716 raft_consensus.cc:2272] T 22ba05ad5deb4210a163e266631b3e67 P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.284884  7716 tablet_replica.cc:333] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.285694  7716 raft_consensus.cc:2243] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.286449  7716 raft_consensus.cc:2272] T 13d273c2182c4f4d86d85935b864463c P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.289040  7716 tablet_replica.cc:333] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.289813  7716 raft_consensus.cc:2243] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.290467  7716 raft_consensus.cc:2272] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.295042  9040 consensus_peers.cc:597] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:27.296729  9588 consensus_peers.cc:597] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.297508  7716 tablet_replica.cc:333] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.298413  7716 raft_consensus.cc:2243] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.303826  7716 raft_consensus.cc:2272] T 8e25b484158d4e599cd55c7f9a740e11 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.308794  9588 consensus_peers.cc:597] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.311724  7716 tablet_replica.cc:333] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.312642  7716 raft_consensus.cc:2243] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.313285  7716 raft_consensus.cc:2272] T f24528c4e0f24715985149f6366da832 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:27.322364  9588 consensus_peers.cc:597] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.325392  9587 consensus_peers.cc:597] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:27.330582  9588 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.331200  7716 tablet_replica.cc:333] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.333766  9040 consensus_peers.cc:597] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:27.342338  7716 raft_consensus.cc:2243] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.348465  7716 raft_consensus.cc:2272] T 2f9e57d64a28430bb24c6a130105d58e P 491a1127924f43d4a369f7d09c3a68db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.356483  7716 tablet_replica.cc:333] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.357688  7716 raft_consensus.cc:2243] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.358964  7716 raft_consensus.cc:2272] T ae12ea4362164b50bece754b6f6bd834 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.361822  7716 tablet_replica.cc:333] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.362630  7716 raft_consensus.cc:2243] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.363562  7716 raft_consensus.cc:2272] T e5bea2f56e504744b5355171d4aae5f3 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.366199  7716 tablet_replica.cc:333] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.367022  7716 raft_consensus.cc:2243] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.368335  7716 raft_consensus.cc:2272] T 703a24767eb84ead9befa5c1beff0063 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.372179  7716 tablet_replica.cc:333] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.373065  7716 raft_consensus.cc:2243] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.374341  7716 raft_consensus.cc:2272] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.377172  7716 tablet_replica.cc:333] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.378026  7716 raft_consensus.cc:2243] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.378821  7716 raft_consensus.cc:2272] T 5dde2f9282d04104a95b6e08dc322ad4 P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.381487  7716 tablet_replica.cc:333] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.388391  9588 consensus_peers.cc:597] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.389430  7716 raft_consensus.cc:2243] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.390202  7716 raft_consensus.cc:2272] T 447f05dcf4904c71bfa27d72667dc990 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.394179  7716 tablet_replica.cc:333] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.395028  7716 raft_consensus.cc:2243] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.396334  7716 raft_consensus.cc:2272] T 4febe4c7f30f402a93c27138f2b4c778 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.399268  7716 tablet_replica.cc:333] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.400079  7716 raft_consensus.cc:2243] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.400768  7716 raft_consensus.cc:2272] T b6874650616d4242a2b161a9a22a07ad P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.404820  7716 tablet_replica.cc:333] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.405694  7716 raft_consensus.cc:2243] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.406790  7716 raft_consensus.cc:2272] T 0daf2fc07a0041229724f51fb6f5fc01 P 491a1127924f43d4a369f7d09c3a68db [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.409965  7716 tablet_replica.cc:333] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.415364  9588 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.416558  7716 raft_consensus.cc:2243] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.417796  7716 raft_consensus.cc:2272] T 1681ffac65ee495d8dd8530b021d3307 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.421206  7716 tablet_replica.cc:333] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.421314  9040 consensus_peers.cc:597] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:27.422149  7716 raft_consensus.cc:2243] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.423535  7716 raft_consensus.cc:2272] T 2ee1ce8134fc4f7e9ce1860cf467105b P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.426821  7716 tablet_replica.cc:333] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.427765  7716 raft_consensus.cc:2243] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.428676  7716 raft_consensus.cc:2272] T d1231588583a41de9b59e17189e8545b P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.431564  7716 tablet_replica.cc:333] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.432541  7716 raft_consensus.cc:2243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.433184  7716 raft_consensus.cc:2272] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.436239  7716 tablet_replica.cc:333] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.454828  7716 raft_consensus.cc:2243] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.456164  7716 raft_consensus.cc:2272] T 3f04df98e77b4f7a85750662c7bcaf22 P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.467036  7716 tablet_replica.cc:333] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.472739  9588 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.487603  7716 raft_consensus.cc:2243] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.488624  7716 raft_consensus.cc:2272] T e24627c251054d5eb5c50b970605e2b5 P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.492314  7716 tablet_replica.cc:333] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.492385  9037 consensus_peers.cc:597] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:27.493227  7716 raft_consensus.cc:2243] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.494499  7716 raft_consensus.cc:2272] T 747c26453321457087376c5a57b2b7bb P 491a1127924f43d4a369f7d09c3a68db [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.502784  7716 tablet_replica.cc:333] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.503732  7716 raft_consensus.cc:2243] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.506220  7716 raft_consensus.cc:2272] T 123584ad57374d41b689f4592fe92d4d P 491a1127924f43d4a369f7d09c3a68db [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.508809  7716 tablet_replica.cc:333] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.509550  7716 raft_consensus.cc:2243] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.510748  7716 raft_consensus.cc:2272] T 023d28c087e64377a9e2790180949da6 P 491a1127924f43d4a369f7d09c3a68db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.513363  7716 tablet_replica.cc:333] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.514060  7716 raft_consensus.cc:2243] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.519584  7716 raft_consensus.cc:2272] T cca28c4486a64eceb7e839d2891ef357 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.522450  7716 tablet_replica.cc:333] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.523208  7716 raft_consensus.cc:2243] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.524391  7716 raft_consensus.cc:2272] T 2c2c8c51a5344057978683f2249e4fab P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.527207  7716 tablet_replica.cc:333] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.528098  7716 raft_consensus.cc:2243] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.529526  7716 raft_consensus.cc:2272] T 284fe781057a4484a4910b55152f99af P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.532217  7716 tablet_replica.cc:333] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
W20260709 12:16:27.533223  9040 consensus_peers.cc:597] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:27.539076  7716 raft_consensus.cc:2243] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.539877  7716 raft_consensus.cc:2272] T 7bfeb6de89004568abc3f47eb68ee5bf P 491a1127924f43d4a369f7d09c3a68db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.542814  7716 tablet_replica.cc:333] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.544399  7716 raft_consensus.cc:2243] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.545146  7716 raft_consensus.cc:2272] T ea78b632dcc844fabe1d6e7b6012f9ff P 491a1127924f43d4a369f7d09c3a68db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.547896  7716 tablet_replica.cc:333] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.548659  7716 raft_consensus.cc:2243] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.549750  7716 raft_consensus.cc:2272] T 8552a23b53d0499abefc4f4a5af10c93 P 491a1127924f43d4a369f7d09c3a68db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.552376  7716 tablet_replica.cc:333] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.553109  7716 raft_consensus.cc:2243] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.554186  7716 raft_consensus.cc:2272] T 030add77af8944519fa93baf328b3e4a P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.556923  7716 tablet_replica.cc:333] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.557711  7716 raft_consensus.cc:2243] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.558748  7716 raft_consensus.cc:2272] T 6bbd74f835814289a7dddc3be9b40dbf P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.561659  7716 tablet_replica.cc:333] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.562453  7716 raft_consensus.cc:2243] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.563764  7716 raft_consensus.cc:2272] T b9be656547ea464996d40fcd3eb6a653 P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.567725  7716 tablet_replica.cc:333] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.568792  7716 raft_consensus.cc:2243] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.569947  7716 raft_consensus.cc:2272] T 6e90ec1fa86446378a1fdff46884228e P 491a1127924f43d4a369f7d09c3a68db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.572731  7716 tablet_replica.cc:333] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.573414  7716 raft_consensus.cc:2243] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.574126  7716 raft_consensus.cc:2272] T 6c56340353dd41d9a99bb2e22fe8c536 P 491a1127924f43d4a369f7d09c3a68db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.582893  7716 tablet_replica.cc:333] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.583632  7716 raft_consensus.cc:2243] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:27.584745  7716 raft_consensus.cc:2272] T 1d515be0508e478dbeaa4e7bf253d48d P 491a1127924f43d4a369f7d09c3a68db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.587348  7716 tablet_replica.cc:333] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db: stopping tablet replica
I20260709 12:16:27.588063  7716 raft_consensus.cc:2243] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:27.588676  7716 raft_consensus.cc:2272] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 491a1127924f43d4a369f7d09c3a68db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:27.818519 16070 raft_consensus.cc:493] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:27.819085 16070 raft_consensus.cc:515] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:27.827862  9587 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:27.832608  9590 leader_election.cc:336] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:27.833102  9590 leader_election.cc:304] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:27.833940 16065 raft_consensus.cc:2749] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:27.833994 16070 leader_election.cc:290] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:27.915562 16070 raft_consensus.cc:493] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:27.916105 16070 raft_consensus.cc:515] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:27.918216 16070 leader_election.cc:290] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:27.928188  9587 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:27.929031  9590 leader_election.cc:336] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:27.929440  9590 leader_election.cc:304] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:27.930680 16070 raft_consensus.cc:2749] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:27.992772 16065 raft_consensus.cc:493] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:27.993325 16065 raft_consensus.cc:515] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:27.995566 16065 leader_election.cc:290] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:28.005251  9587 leader_election.cc:336] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.006096  9590 leader_election.cc:336] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.006489  9590 leader_election.cc:304] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.007228 16065 raft_consensus.cc:2749] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:28.113459  9590 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:28.171553  9590 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:28.209352 16065 raft_consensus.cc:493] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:28.209903 16065 raft_consensus.cc:515] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.212124 16065 leader_election.cc:290] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:28.221482  9587 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.222304  9590 leader_election.cc:336] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.222702  9590 leader_election.cc:304] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.224423 16047 raft_consensus.cc:2749] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:28.335110 16065 raft_consensus.cc:493] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:28.335759 16065 raft_consensus.cc:515] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:28.350353  9590 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.352862 16065 leader_election.cc:290] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.358811  9587 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.362766  9587 leader_election.cc:304] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.363883 16065 raft_consensus.cc:2749] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:28.364450  9588 leader_election.cc:336] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
W20260709 12:16:28.438743  9590 consensus_peers.cc:597] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:28.494750 16065 raft_consensus.cc:493] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.495350 16065 raft_consensus.cc:515] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.497372 16065 leader_election.cc:290] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.504331  9587 leader_election.cc:336] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.510576  9588 leader_election.cc:336] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.511147  9588 leader_election.cc:304] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.512845 16065 raft_consensus.cc:2749] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:28.524458 16065 raft_consensus.cc:493] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.525022 16065 raft_consensus.cc:515] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.527256 16065 leader_election.cc:290] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.535884  9590 leader_election.cc:336] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:28.536875  9588 leader_election.cc:336] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.537307  9588 leader_election.cc:304] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.538079 16065 raft_consensus.cc:2749] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:28.570789 16065 raft_consensus.cc:493] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.571398 16065 raft_consensus.cc:515] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } attrs { replace: true } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:28.580060  9588 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.580699 16065 leader_election.cc:290] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.581763  9590 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.582201  9590 leader_election.cc:304] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.582918 16065 raft_consensus.cc:2749] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:16:28.583074  9587 leader_election.cc:336] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.644500 16065 raft_consensus.cc:493] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:28.645068 16065 raft_consensus.cc:515] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.647183 16065 leader_election.cc:290] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
W20260709 12:16:28.657644  9590 leader_election.cc:336] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.658409 16065 raft_consensus.cc:493] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.658967 16065 raft_consensus.cc:515] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.661242 16065 leader_election.cc:290] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.661870  9587 leader_election.cc:336] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.662369  9587 leader_election.cc:304] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.668926 16047 raft_consensus.cc:493] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2fec7bba20864beea35ba1b33132e47d)
I20260709 12:16:28.669533 16047 raft_consensus.cc:515] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.671875 16047 leader_election.cc:290] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539)
I20260709 12:16:28.678000 16065 raft_consensus.cc:2749] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:16:28.679924  9590 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:28.680783  9587 leader_election.cc:336] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.693496  9587 leader_election.cc:336] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.693990  9587 leader_election.cc:304] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:28.694034  9588 leader_election.cc:336] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.694813  9588 leader_election.cc:304] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.695603 16065 raft_consensus.cc:2749] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:28.697016 16065 raft_consensus.cc:2749] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:28.700843 16065 raft_consensus.cc:493] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.701364 16065 raft_consensus.cc:515] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.703538 16065 leader_election.cc:290] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.710048  9590 leader_election.cc:336] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.710924 16065 raft_consensus.cc:493] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.711537 16065 raft_consensus.cc:515] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.720480 16065 leader_election.cc:290] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:28.721935 16070 raft_consensus.cc:493] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.722493 16070 raft_consensus.cc:515] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.733932 16070 leader_election.cc:290] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:28.734546 16070 raft_consensus.cc:493] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.735111 16070 raft_consensus.cc:515] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.737350 16070 leader_election.cc:290] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.744887  9590 leader_election.cc:336] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:28.751386  9590 consensus_peers.cc:597] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:28.754433  9588 leader_election.cc:336] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.755005  9588 leader_election.cc:304] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:28.759914  9588 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.760794 16065 raft_consensus.cc:2749] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:28.761559 16065 raft_consensus.cc:493] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.762048 16065 raft_consensus.cc:515] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.763528 16047 raft_consensus.cc:493] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.764047 16047 raft_consensus.cc:515] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.766250 16047 leader_election.cc:290] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:28.766666 16065 leader_election.cc:290] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.772825  9587 leader_election.cc:336] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.773300  9587 leader_election.cc:304] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.774567 16072 raft_consensus.cc:2749] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:16:28.781127  9588 leader_election.cc:336] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.781683  9588 leader_election.cc:304] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
W20260709 12:16:28.787515  9587 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.788251  9587 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
W20260709 12:16:28.788710  9587 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.789448 16072 raft_consensus.cc:2749] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:28.790520  9588 leader_election.cc:336] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.790974  9588 leader_election.cc:304] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.791756 16072 raft_consensus.cc:2749] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:28.799427  9588 leader_election.cc:336] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.799907  9588 leader_election.cc:304] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.800678 16072 raft_consensus.cc:2749] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:28.801729  9588 leader_election.cc:336] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.802147  9588 leader_election.cc:304] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
I20260709 12:16:28.802856 16072 raft_consensus.cc:2749] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:28.870306 16072 raft_consensus.cc:493] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.870888 16072 raft_consensus.cc:515] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
W20260709 12:16:28.882603  9590 leader_election.cc:336] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:28.883437  9588 leader_election.cc:336] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.883877  9588 leader_election.cc:304] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.884943 16072 leader_election.cc:290] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
I20260709 12:16:28.885622 16065 raft_consensus.cc:2749] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:28.886428 16047 raft_consensus.cc:493] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.886967 16047 raft_consensus.cc:515] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.889241 16047 leader_election.cc:290] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.895082  9590 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:28.899961  9588 leader_election.cc:336] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.902856  9588 leader_election.cc:304] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.905195 16047 raft_consensus.cc:2749] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:28.948885 16047 raft_consensus.cc:493] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.949441 16047 raft_consensus.cc:515] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } attrs { replace: true } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.951674 16072 raft_consensus.cc:493] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.952199 16072 raft_consensus.cc:515] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2fec7bba20864beea35ba1b33132e47d" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35539 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.954249 16072 leader_election.cc:290] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.962471  9587 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.964125 16072 raft_consensus.cc:493] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 491a1127924f43d4a369f7d09c3a68db)
I20260709 12:16:28.966233 16072 raft_consensus.cc:515] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd11e77b4be14e658672599b30d51e76" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 41023 } } peers { permanent_uuid: "491a1127924f43d4a369f7d09c3a68db" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 34547 } } peers { permanent_uuid: "4993160378a142a1bc21648120cbaebc" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 33071 } attrs { promote: false } }
I20260709 12:16:28.977259 16072 leader_election.cc:290] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.965703  9588 leader_election.cc:336] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:28.980875  9588 leader_election.cc:304] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, 491a1127924f43d4a369f7d09c3a68db
W20260709 12:16:28.975157  9590 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:28.983536 16065 raft_consensus.cc:2749] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:28.968055 16047 leader_election.cc:290] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023), 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539), 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547)
W20260709 12:16:28.988399  9587 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111)
I20260709 12:16:28.991791  9587 leader_election.cc:304] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 2fec7bba20864beea35ba1b33132e47d, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:28.994292 16072 raft_consensus.cc:2749] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:28.992633  9590 leader_election.cc:336] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
W20260709 12:16:29.006896  9588 leader_election.cc:336] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
W20260709 12:16:29.008474  9588 leader_election.cc:336] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111)
I20260709 12:16:29.008999  9588 leader_election.cc:304] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4993160378a142a1bc21648120cbaebc; no voters: 491a1127924f43d4a369f7d09c3a68db, fd11e77b4be14e658672599b30d51e76
I20260709 12:16:29.009861 16072 raft_consensus.cc:2749] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:29.062767  9590 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:29.068997  9587 consensus_peers.cc:597] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:29.214531  9588 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:29.244441  9587 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:29.274075  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
W20260709 12:16:29.281985  9587 consensus_peers.cc:597] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:29.414990  7716 tablet_server.cc:179] TabletServer@127.7.137.4:0 shutting down...
W20260709 12:16:29.481599  9587 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:29.499500  9590 consensus_peers.cc:597] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:29.527760  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:29.528731  7716 tablet_replica.cc:333] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.529635  7716 raft_consensus.cc:2243] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.530325  7716 raft_consensus.cc:2272] T 284fe781057a4484a4910b55152f99af P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.533533  7716 tablet_replica.cc:333] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.534492  7716 raft_consensus.cc:2243] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.535359  7716 raft_consensus.cc:2272] T 996aff69fd874168bec179a4292ac2e2 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.540424  9590 consensus_peers.cc:597] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:29.545115  9588 consensus_peers.cc:597] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:29.547492  9587 consensus_peers.cc:597] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:29.548535  7716 tablet_replica.cc:333] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.549556  7716 raft_consensus.cc:2243] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.550375  7716 raft_consensus.cc:2272] T 64324fda988042f2a6200271577d02a9 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.553685  7716 tablet_replica.cc:333] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.560105  7716 raft_consensus.cc:2243] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:29.560375  9587 consensus_peers.cc:597] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:29.561053  9587 consensus_peers.cc:597] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:29.561347  7716 raft_consensus.cc:2272] T 747c26453321457087376c5a57b2b7bb P 4993160378a142a1bc21648120cbaebc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.570294  7716 tablet_replica.cc:333] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
W20260709 12:16:29.571045  9590 consensus_peers.cc:597] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:29.571184  7716 raft_consensus.cc:2243] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.573487  7716 raft_consensus.cc:2272] T 6b9ee0b0b4df4d3abfdf4c57b26939a5 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.579720  7716 tablet_replica.cc:333] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.580576  7716 raft_consensus.cc:2243] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.581779  7716 raft_consensus.cc:2272] T c8a9c1b9c42c4bd88c49949bf6c32d9f P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.583513  9588 consensus_peers.cc:597] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:29.584712  9590 consensus_peers.cc:597] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc -> Peer fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): Couldn't send request to peer fd11e77b4be14e658672599b30d51e76. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:29.584880  7716 tablet_replica.cc:333] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.585860  7716 raft_consensus.cc:2243] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.587693  7716 raft_consensus.cc:2272] T 123584ad57374d41b689f4592fe92d4d P 4993160378a142a1bc21648120cbaebc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.590407  7716 tablet_replica.cc:333] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.599746  7716 raft_consensus.cc:2243] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.600313  7716 raft_consensus.cc:2272] T 422d007cdc2c44f4b486ca22b87c8dd8 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.602506  7716 tablet_replica.cc:333] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.603276  7716 raft_consensus.cc:2243] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.604446  7716 raft_consensus.cc:2272] T 447f05dcf4904c71bfa27d72667dc990 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.607306  7716 tablet_replica.cc:333] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.608176  7716 raft_consensus.cc:2243] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:29.620570  9587 consensus_peers.cc:597] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc -> Peer 2fec7bba20864beea35ba1b33132e47d (127.7.137.2:35539): Couldn't send request to peer 2fec7bba20864beea35ba1b33132e47d. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35539: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:29.621520  7716 raft_consensus.cc:2272] T 8e25b484158d4e599cd55c7f9a740e11 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.624425  7716 tablet_replica.cc:333] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.625276  7716 raft_consensus.cc:2243] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.625970  7716 raft_consensus.cc:2272] T 9e996a3dae284298bc7fecf1e8fdc675 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.628875  7716 tablet_replica.cc:333] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.629679  7716 raft_consensus.cc:2243] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.630455  7716 raft_consensus.cc:2272] T 6e90ec1fa86446378a1fdff46884228e P 4993160378a142a1bc21648120cbaebc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.633437  7716 tablet_replica.cc:333] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.634284  7716 raft_consensus.cc:2243] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.635370  7716 raft_consensus.cc:2272] T 4be7ce502f794156a9be9d258ca1e04f P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.638166  7716 tablet_replica.cc:333] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.639250  7716 raft_consensus.cc:2243] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.640338  7716 raft_consensus.cc:2272] T f56979e1608d4fcc873d5537e8345d33 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.642978  7716 tablet_replica.cc:333] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.643806  7716 raft_consensus.cc:2243] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.644454  7716 raft_consensus.cc:2272] T b9be656547ea464996d40fcd3eb6a653 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.647157  7716 tablet_replica.cc:333] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.647977  7716 raft_consensus.cc:2243] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.648810  7716 raft_consensus.cc:2272] T 2f9e57d64a28430bb24c6a130105d58e P 4993160378a142a1bc21648120cbaebc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.651579  7716 tablet_replica.cc:333] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.652429  7716 raft_consensus.cc:2243] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.653146  7716 raft_consensus.cc:2272] T 030add77af8944519fa93baf328b3e4a P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.655886  7716 tablet_replica.cc:333] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.656685  7716 raft_consensus.cc:2243] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.665877  7716 raft_consensus.cc:2272] T d1231588583a41de9b59e17189e8545b P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.674993  7716 tablet_replica.cc:333] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.675930  7716 raft_consensus.cc:2243] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.676610  7716 raft_consensus.cc:2272] T ae12ea4362164b50bece754b6f6bd834 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.679689  7716 tablet_replica.cc:333] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.680519  7716 raft_consensus.cc:2243] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.681208  7716 raft_consensus.cc:2272] T 8552a23b53d0499abefc4f4a5af10c93 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.683799  7716 tablet_replica.cc:333] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.684577  7716 raft_consensus.cc:2243] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.685683  7716 raft_consensus.cc:2272] T e24627c251054d5eb5c50b970605e2b5 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.688408  7716 tablet_replica.cc:333] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.689253  7716 raft_consensus.cc:2243] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.689911  7716 raft_consensus.cc:2272] T 3f04df98e77b4f7a85750662c7bcaf22 P 4993160378a142a1bc21648120cbaebc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.692618  7716 tablet_replica.cc:333] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.693418  7716 raft_consensus.cc:2243] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.694063  7716 raft_consensus.cc:2272] T 2d1d6970fddb4442a12d0adcf1a1980b P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.696863  7716 tablet_replica.cc:333] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.697679  7716 raft_consensus.cc:2243] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.698772  7716 raft_consensus.cc:2272] T c98b3fa87be744c6a1d2a811af614ebc P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.701332  7716 tablet_replica.cc:333] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.702126  7716 raft_consensus.cc:2243] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.707320  7716 raft_consensus.cc:2272] T a4285e23e73840659806e00d6213792a P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.710255  7716 tablet_replica.cc:333] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.711113  7716 raft_consensus.cc:2243] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.712265  7716 raft_consensus.cc:2272] T 4eae6c679d7f4d4a9422d66f842d1d7d P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.715080  7716 tablet_replica.cc:333] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.715927  7716 raft_consensus.cc:2243] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.716652  7716 raft_consensus.cc:2272] T c47609ef9e5d4514945afe81e24e790d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.719441  7716 tablet_replica.cc:333] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.720296  7716 raft_consensus.cc:2243] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.721426  7716 raft_consensus.cc:2272] T 309f8de493054d15b198c2f7ddeb70b4 P 4993160378a142a1bc21648120cbaebc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.724231  7716 tablet_replica.cc:333] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.725039  7716 raft_consensus.cc:2243] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.726152  7716 raft_consensus.cc:2272] T e7ad3d29ddad476c8f02ee13b8dbe1b5 P 4993160378a142a1bc21648120cbaebc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.728904  7716 tablet_replica.cc:333] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.729650  7716 raft_consensus.cc:2243] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.730325  7716 raft_consensus.cc:2272] T 6bbd74f835814289a7dddc3be9b40dbf P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.732848  7716 tablet_replica.cc:333] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.733593  7716 raft_consensus.cc:2243] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.734689  7716 raft_consensus.cc:2272] T 22ba05ad5deb4210a163e266631b3e67 P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.737294  7716 tablet_replica.cc:333] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.738097  7716 raft_consensus.cc:2243] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.739279  7716 raft_consensus.cc:2272] T b6874650616d4242a2b161a9a22a07ad P 4993160378a142a1bc21648120cbaebc [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.745929  9588 consensus_peers.cc:597] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc -> Peer 491a1127924f43d4a369f7d09c3a68db (127.7.137.3:34547): Couldn't send request to peer 491a1127924f43d4a369f7d09c3a68db. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:34547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:29.748567  7716 tablet_replica.cc:333] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.749454  7716 raft_consensus.cc:2243] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.750162  7716 raft_consensus.cc:2272] T f774722c966e4c2b94851308244cbffd P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.752904  7716 tablet_replica.cc:333] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.753665  7716 raft_consensus.cc:2243] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.754273  7716 raft_consensus.cc:2272] T 1681ffac65ee495d8dd8530b021d3307 P 4993160378a142a1bc21648120cbaebc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.758579  7716 tablet_replica.cc:333] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.759438  7716 raft_consensus.cc:2243] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.760568  7716 raft_consensus.cc:2272] T 7bfeb6de89004568abc3f47eb68ee5bf P 4993160378a142a1bc21648120cbaebc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.763301  7716 tablet_replica.cc:333] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.764029  7716 raft_consensus.cc:2243] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.764643  7716 raft_consensus.cc:2272] T 023d28c087e64377a9e2790180949da6 P 4993160378a142a1bc21648120cbaebc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.769088  7716 tablet_replica.cc:333] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.769881  7716 raft_consensus.cc:2243] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.771090  7716 pending_rounds.cc:70] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Trying to abort 1 pending ops.
I20260709 12:16:29.771397  7716 pending_rounds.cc:77] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc: Aborting op as it isn't in flight: id { term: 21 index: 17 } timestamp: 7305623088199032832 op_type: NO_OP noop_request { }
I20260709 12:16:29.771843  7716 raft_consensus.cc:2889] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:29.772243  7716 raft_consensus.cc:2272] T c1d86a8f62c34e43b9b89b2a4a19cf2d P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.775030  7716 tablet_replica.cc:333] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.775826  7716 raft_consensus.cc:2243] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.776474  7716 raft_consensus.cc:2272] T 1d8a12b09f964de2b0eb86fb75bdbfd0 P 4993160378a142a1bc21648120cbaebc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.779461  7716 tablet_replica.cc:333] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc: stopping tablet replica
I20260709 12:16:29.780216  7716 raft_consensus.cc:2243] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.781316  7716 raft_consensus.cc:2272] T db8cdabd573f46e28a22e367d9de5201 P 4993160378a142a1bc21648120cbaebc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:30.549171  7716 tablet_server.cc:196] TabletServer@127.7.137.4:0 shutdown complete.
I20260709 12:16:30.651077  7716 master.cc:562] Master@127.7.137.62:33577 shutting down...
W20260709 12:16:30.694921  8871 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:16:30.695385  8871 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:30.695607  8871 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:32.700711  8854 debug-util.cc:398] Leaking SignalData structure 0x7b080000b660 after lost signal to thread 7719
W20260709 12:16:32.701486  8854 debug-util.cc:398] Leaking SignalData structure 0x7b0800311ea0 after lost signal to thread 8857
W20260709 12:16:41.453619  8810 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111) [suppressed 313 similar messages]
W20260709 12:16:41.457244  8810 catalog_manager.cc:4755] TS fd11e77b4be14e658672599b30d51e76 (127.7.137.1:41023): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6e90ec1fa86446378a1fdff46884228e: Network error: Client connection negotiation failed: client connection to 127.7.137.1:41023: connect: Connection refused (error 111)
I20260709 12:16:41.604300  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:41.607034  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:41.607635  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P a8a9637095964e1e964bf3e778be9bbd: stopping tablet replica
I20260709 12:16:41.834257  7716 master.cc:584] Master@127.7.137.62:33577 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (237109 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:16:41.962941  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:40141
I20260709 12:16:41.964516  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:41.972283 16078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.972311 16081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.972471 16079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:41.973713  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:41.976887  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:41.977072  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:41.977291  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599401977245 us; error 0 us; skew 500 ppm
I20260709 12:16:41.977871  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:41.980772  7716 webserver.cc:533] Webserver started at http://127.7.137.62:34121/ using document root <none> and password file <none>
I20260709 12:16:41.981304  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:41.981510  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:41.981813  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:41.983150  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "1211a968cb1f4a969cf8b631e94e6d1e"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-9kw9"
I20260709 12:16:41.987869  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:41.991412 16086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.992267  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:16:41.992558  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "1211a968cb1f4a969cf8b631e94e6d1e"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-9kw9"
I20260709 12:16:41.992884  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.003871  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.005158  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.046113  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:40141
I20260709 12:16:42.046217 16137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:40141 every 8 connection(s)
I20260709 12:16:42.050899 16138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.067582 16138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e: Bootstrap starting.
I20260709 12:16:42.074426 16138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.081373 16138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e: No bootstrap required, opened a new log
I20260709 12:16:42.085868 16138 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER }
I20260709 12:16:42.086750 16138 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.087136 16138 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1211a968cb1f4a969cf8b631e94e6d1e, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.088198 16138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER }
I20260709 12:16:42.088974 16138 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:42.089396 16138 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:42.089920 16138 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.098963 16138 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER }
I20260709 12:16:42.099805 16138 leader_election.cc:304] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1211a968cb1f4a969cf8b631e94e6d1e; no voters: 
I20260709 12:16:42.101536 16138 leader_election.cc:290] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:42.101956 16141 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.103688 16141 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 1 LEADER]: Becoming Leader. State: Replica: 1211a968cb1f4a969cf8b631e94e6d1e, State: Running, Role: LEADER
I20260709 12:16:42.104620 16141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER }
I20260709 12:16:42.105150 16138 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:42.120908 16142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER } }
I20260709 12:16:42.121724 16142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:42.123871 16155 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:42.123644 16143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1211a968cb1f4a969cf8b631e94e6d1e. Latest consensus state: current_term: 1 leader_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1211a968cb1f4a969cf8b631e94e6d1e" member_type: VOTER } }
I20260709 12:16:42.124481  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:42.124878 16143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:42.129550 16155 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:42.138578 16155 catalog_manager.cc:1383] Generated new cluster ID: dc0976d62c55483d9625135fecac5c0a
I20260709 12:16:42.138897 16155 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:42.156438 16155 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:42.157883 16155 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:42.170490 16155 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e: Generated new TSK 0
I20260709 12:16:42.171166 16155 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:42.190864  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.197778 16159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.198599 16160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.200273 16162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.201649  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:42.204185  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.204407  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.204588  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599402204568 us; error 0 us; skew 500 ppm
I20260709 12:16:42.205185  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.207656  7716 webserver.cc:533] Webserver started at http://127.7.137.1:44415/ using document root <none> and password file <none>
I20260709 12:16:42.208165  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.208362  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.208699  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.209913  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "371b664722e94372a346a6d621adaa9e"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.214498  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:42.218073 16167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.218868  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:42.219177  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "371b664722e94372a346a6d621adaa9e"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.219515  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.238866  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.240197  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.241716  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.244180  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.244395  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.244681  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.244855  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.286641  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:46255
I20260709 12:16:42.286737 16229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:46255 every 8 connection(s)
I20260709 12:16:42.292152  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.300123 16234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.301293 16235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.304216 16237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.306847  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:42.307941 16230 heartbeater.cc:344] Connected to a master server at 127.7.137.62:40141
I20260709 12:16:42.308364 16230 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.309311 16230 heartbeater.cc:507] Master 127.7.137.62:40141 requested a full tablet report, sending...
I20260709 12:16:42.309684  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.309921  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.310103  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599402310085 us; error 0 us; skew 500 ppm
I20260709 12:16:42.310883  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.311710 16103 ts_manager.cc:194] Registered new tserver with Master: 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:42.313714  7716 webserver.cc:533] Webserver started at http://127.7.137.2:43153/ using document root <none> and password file <none>
I20260709 12:16:42.314392  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.314640  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.314564 16103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49196
I20260709 12:16:42.315132  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.316818  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "d4b26d78497741df932d87016bbc9a15"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.321480  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:42.325089 16242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.325896  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:42.326200  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "d4b26d78497741df932d87016bbc9a15"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.326486  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.351135  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.352447  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.353940  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.356216  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.356453  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.356709  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.356881  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.397329  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:35065
I20260709 12:16:42.397450 16304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:35065 every 8 connection(s)
I20260709 12:16:42.402340  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.409859 16308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.411391 16309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.412760 16311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.413995  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:42.415280  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:42.415429 16305 heartbeater.cc:344] Connected to a master server at 127.7.137.62:40141
W20260709 12:16:42.415581  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.415977  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599402415949 us; error 0 us; skew 500 ppm
I20260709 12:16:42.415995 16305 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.416697  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.416978 16305 heartbeater.cc:507] Master 127.7.137.62:40141 requested a full tablet report, sending...
I20260709 12:16:42.419149 16103 ts_manager.cc:194] Registered new tserver with Master: d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:42.419456  7716 webserver.cc:533] Webserver started at http://127.7.137.3:38989/ using document root <none> and password file <none>
I20260709 12:16:42.419943  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.420099  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.420311  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.420842 16103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49206
I20260709 12:16:42.421793  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "a7f2df769fee4fb7894cdbb752cab97e"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.426349  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:16:42.429809 16316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.430549  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:42.430862  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "a7f2df769fee4fb7894cdbb752cab97e"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.431166  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.441488  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.442732  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.444278  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.446529  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.446707  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.447002  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.447165  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.489300  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:38875
I20260709 12:16:42.489392 16378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:38875 every 8 connection(s)
I20260709 12:16:42.494379  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:42.501268 16382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.503554 16383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:42.504441 16385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:42.504626  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:42.506042  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:42.506268  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:42.506492  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599402506474 us; error 0 us; skew 500 ppm
I20260709 12:16:42.506587 16379 heartbeater.cc:344] Connected to a master server at 127.7.137.62:40141
I20260709 12:16:42.507083 16379 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.507223  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:42.508011 16379 heartbeater.cc:507] Master 127.7.137.62:40141 requested a full tablet report, sending...
I20260709 12:16:42.510237 16103 ts_manager.cc:194] Registered new tserver with Master: a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:42.511634 16103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49218
I20260709 12:16:42.512871  7716 webserver.cc:533] Webserver started at http://127.7.137.4:37467/ using document root <none> and password file <none>
I20260709 12:16:42.513412  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:42.513641  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:42.513923  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:42.515173  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-3-root/instance:
uuid: "bde8efa60f914da8a818213518c2b4ca"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.519996  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:16:42.523599 16390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.524468  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:16:42.524821  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
uuid: "bde8efa60f914da8a818213518c2b4ca"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:42.525135  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:42.542325  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:42.543707  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:42.545202  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:42.547432  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:42.547683  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.547930  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:42.548110  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:42.589314  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.4:43779
I20260709 12:16:42.589419 16452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.4:43779 every 8 connection(s)
I20260709 12:16:42.603966 16453 heartbeater.cc:344] Connected to a master server at 127.7.137.62:40141
I20260709 12:16:42.604321 16453 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:42.605149 16453 heartbeater.cc:507] Master 127.7.137.62:40141 requested a full tablet report, sending...
I20260709 12:16:42.606971 16103 ts_manager.cc:194] Registered new tserver with Master: bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:42.607264  7716 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014638717s
I20260709 12:16:42.608417 16103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49226
I20260709 12:16:42.636308 16103 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49240:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:16:42.887511 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 26698bcad1684a86a906817a779878ba (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:42.889091 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26698bcad1684a86a906817a779878ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.900987 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 243ed9c1ffe244289120a4bac0d23ca6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:42.902509 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ed9c1ffe244289120a4bac0d23ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.911762 16268 tablet_service.cc:1511] Processing CreateTablet for tablet b329094fe65047b2b4440a5d7066ab0a (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:42.913296 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329094fe65047b2b4440a5d7066ab0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.908213 16417 tablet_service.cc:1511] Processing CreateTablet for tablet b329094fe65047b2b4440a5d7066ab0a (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:42.914341 16418 tablet_service.cc:1511] Processing CreateTablet for tablet 26698bcad1684a86a906817a779878ba (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:42.919723 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329094fe65047b2b4440a5d7066ab0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.921152 16415 tablet_service.cc:1511] Processing CreateTablet for tablet ced4db8ec1524a7b8e3ff437ea389c1f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:42.923084 16418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26698bcad1684a86a906817a779878ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.923545 16267 tablet_service.cc:1511] Processing CreateTablet for tablet eb645de5083941e0a7dd5d4e4cf1a798 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:42.923799 16414 tablet_service.cc:1511] Processing CreateTablet for tablet 520520ce482b48638578a08a887f961f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:42.925035 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb645de5083941e0a7dd5d4e4cf1a798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.928110 16413 tablet_service.cc:1511] Processing CreateTablet for tablet a5109a72f97348a6b66b2a2541c30448 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:42.929636 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5109a72f97348a6b66b2a2541c30448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.914484 16416 tablet_service.cc:1511] Processing CreateTablet for tablet 457ef541e8004732abf224552592d3dd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:42.928150 16412 tablet_service.cc:1511] Processing CreateTablet for tablet efd3baaf1b0f43f59cfe39fba8bb4dde (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:42.932158 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457ef541e8004732abf224552592d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.932960 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3baaf1b0f43f59cfe39fba8bb4dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.935755 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520520ce482b48638578a08a887f961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.937031 16266 tablet_service.cc:1511] Processing CreateTablet for tablet ced4db8ec1524a7b8e3ff437ea389c1f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:42.938431 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced4db8ec1524a7b8e3ff437ea389c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.939689 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced4db8ec1524a7b8e3ff437ea389c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.940526 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 9541a370ec014267a500f45686395fb8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:42.941955 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541a370ec014267a500f45686395fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.949049 16410 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf91fbb29104b44a4abee852fbe043e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:42.949656 16265 tablet_service.cc:1511] Processing CreateTablet for tablet a5109a72f97348a6b66b2a2541c30448 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:42.950652 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf91fbb29104b44a4abee852fbe043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.951084 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5109a72f97348a6b66b2a2541c30448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.952464 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 35d00760f88247f1a179973d1c7cc34e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:42.953827 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d00760f88247f1a179973d1c7cc34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.969797 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4353bb62b4c0aa4e854be3297184d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:42.970870 16263 tablet_service.cc:1511] Processing CreateTablet for tablet efd3baaf1b0f43f59cfe39fba8bb4dde (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:42.971485 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4353bb62b4c0aa4e854be3297184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.972390 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3baaf1b0f43f59cfe39fba8bb4dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.981755 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf91fbb29104b44a4abee852fbe043e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:42.983307 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf91fbb29104b44a4abee852fbe043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:42.989744 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 0013e821aa88410fa79bc656b03ec146 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:42.991178 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0013e821aa88410fa79bc656b03ec146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.023631 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 926305cc352545b3b98774de0464f46b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:43.034578 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926305cc352545b3b98774de0464f46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.029505 16418 tablet_service.cc:1511] Processing CreateTablet for tablet 0bff55b8f07d462d9bdf2065695fa373 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:43.037889 16418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bff55b8f07d462d9bdf2065695fa373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.032972 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 49e6d3a14dc24349a70fb2f3910a1fa4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:43.027972 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 300c2bb3f55044b295cab5e11e366867 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:43.043659 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300c2bb3f55044b295cab5e11e366867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.047966 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e6d3a14dc24349a70fb2f3910a1fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.052487 16414 tablet_service.cc:1511] Processing CreateTablet for tablet b4b31f6cc7b54ab1b202f40bc200510e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:43.053990 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b31f6cc7b54ab1b202f40bc200510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.059653 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 115b0258196c44cf8e08f3a410ef0b5e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:43.061224 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b0258196c44cf8e08f3a410ef0b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.073581 16473 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:43.074807 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 862350edca82469998bc1533fcd8f418 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:43.076828 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862350edca82469998bc1533fcd8f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.080257 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 83df294335c64a35b675edbe966445f4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:43.081784 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83df294335c64a35b675edbe966445f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.086095 16417 tablet_service.cc:1511] Processing CreateTablet for tablet fffe1c659d7f45fa93bdafacea3f9ce1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:43.090298 16416 tablet_service.cc:1511] Processing CreateTablet for tablet 52e7274549d04acc9c7bb43812b87d79 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:43.072216 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 988b9e49e49b4d469474bbc23cf32e6d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:43.098515 16473 tablet_bootstrap.cc:654] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.101783 16472 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:43.113349 16267 tablet_service.cc:1511] Processing CreateTablet for tablet e9773066f8824befb0ba38e00f26711b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:43.116436 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 988b9e49e49b4d469474bbc23cf32e6d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 12:16:43.118108 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:43.116508 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 49e6d3a14dc24349a70fb2f3910a1fa4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:43.120193 16410 tablet_service.cc:1511] Processing CreateTablet for tablet 2369e1f2303b4bd18b96d22c3b994929 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:43.120252 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9773066f8824befb0ba38e00f26711b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.121583 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffe1c659d7f45fa93bdafacea3f9ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.122290 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b9e49e49b4d469474bbc23cf32e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.124940 16472 tablet_bootstrap.cc:654] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.126246 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 05fd27468a6e4c88ab3ee076f99a4e73 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:43.133828 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369e1f2303b4bd18b96d22c3b994929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.130836 16268 tablet_service.cc:1511] Processing CreateTablet for tablet b4b31f6cc7b54ab1b202f40bc200510e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:43.109810 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 0bff55b8f07d462d9bdf2065695fa373 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:43.147382 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b9e49e49b4d469474bbc23cf32e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.133211 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 35d00760f88247f1a179973d1c7cc34e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:43.156035 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fd27468a6e4c88ab3ee076f99a4e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.158143 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 06d90126bf2c4c43b7021634cef076aa (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:43.158649 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b31f6cc7b54ab1b202f40bc200510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.160506 16266 tablet_service.cc:1511] Processing CreateTablet for tablet ed67f1fe7bfc40cbaa81904b04e85bbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:43.160615 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 862350edca82469998bc1533fcd8f418 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:43.161496 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 4d18ca29fb0b4817b4d87bc6840c4b04 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:43.161896 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed67f1fe7bfc40cbaa81904b04e85bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.162636 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d00760f88247f1a179973d1c7cc34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.167857 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862350edca82469998bc1533fcd8f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.172400 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bff55b8f07d462d9bdf2065695fa373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.172537 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d90126bf2c4c43b7021634cef076aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.178489 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e7274549d04acc9c7bb43812b87d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.184656 16265 tablet_service.cc:1511] Processing CreateTablet for tablet fffe1c659d7f45fa93bdafacea3f9ce1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:43.189152 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 6f9ae53f366a4893a34b5bef50a38f1b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:43.189076 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 4b08e7c028cd4260a57cc16d538a6431 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:43.190836 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b08e7c028cd4260a57cc16d538a6431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.191694 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d18ca29fb0b4817b4d87bc6840c4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.193778 16414 tablet_service.cc:1511] Processing CreateTablet for tablet e128886ac9ad43e8b89a82573e4512fb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:43.195327 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e128886ac9ad43e8b89a82573e4512fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.199645 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 83df294335c64a35b675edbe966445f4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:43.200963 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f9ae53f366a4893a34b5bef50a38f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.185115 16473 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:43.203259 16268 tablet_service.cc:1511] Processing CreateTablet for tablet d2f740872ebf4b868aae02d23315877f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:43.203641 16473 ts_tablet_manager.cc:1403] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.011s
I20260709 12:16:43.201004 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83df294335c64a35b675edbe966445f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.209537 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 243ed9c1ffe244289120a4bac0d23ca6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:43.213049 16194 tablet_service.cc:1511] Processing CreateTablet for tablet b329094fe65047b2b4440a5d7066ab0a (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:43.211118 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ed9c1ffe244289120a4bac0d23ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.216336 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329094fe65047b2b4440a5d7066ab0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.224609 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffe1c659d7f45fa93bdafacea3f9ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.228868 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f740872ebf4b868aae02d23315877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.234922 16473 raft_consensus.cc:359] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:43.235864 16473 raft_consensus.cc:385] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.235785 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 26698bcad1684a86a906817a779878ba (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:43.236308 16473 raft_consensus.cc:740] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.237358 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26698bcad1684a86a906817a779878ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.237154 16473 consensus_queue.cc:260] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:43.244599 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea523de666d4596bdfd1b53225aff83 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:43.246182 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea523de666d4596bdfd1b53225aff83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.258139 16472 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:43.258785 16472 ts_tablet_manager.cc:1403] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.007s
I20260709 12:16:43.263940 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e6d3a14dc24349a70fb2f3910a1fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.264159 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 457ef541e8004732abf224552592d3dd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:43.265693 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457ef541e8004732abf224552592d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.265681 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 2369e1f2303b4bd18b96d22c3b994929 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:43.271957 16472 raft_consensus.cc:359] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:43.295543 16472 raft_consensus.cc:385] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.295894 16472 raft_consensus.cc:740] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.296339 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369e1f2303b4bd18b96d22c3b994929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.296711 16472 consensus_queue.cc:260] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:43.299098 16336 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf91fbb29104b44a4abee852fbe043e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:43.300480 16336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf91fbb29104b44a4abee852fbe043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.273108 16192 tablet_service.cc:1511] Processing CreateTablet for tablet eb645de5083941e0a7dd5d4e4cf1a798 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:43.274732 16418 tablet_service.cc:1511] Processing CreateTablet for tablet 1671729a63334f38b4e87d414002c770 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:43.308473 16335 tablet_service.cc:1511] Processing CreateTablet for tablet 0013e821aa88410fa79bc656b03ec146 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:43.309624 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 06d90126bf2c4c43b7021634cef076aa (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:43.275674 16191 tablet_service.cc:1511] Processing CreateTablet for tablet ced4db8ec1524a7b8e3ff437ea389c1f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:43.280050 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 243ed9c1ffe244289120a4bac0d23ca6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:43.282559 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 457ef541e8004732abf224552592d3dd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:43.311069 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d90126bf2c4c43b7021634cef076aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.287328 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 520520ce482b48638578a08a887f961f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:43.284935 16341 tablet_service.cc:1511] Processing CreateTablet for tablet eb645de5083941e0a7dd5d4e4cf1a798 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:43.289763 16339 tablet_service.cc:1511] Processing CreateTablet for tablet a5109a72f97348a6b66b2a2541c30448 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:43.292164 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4353bb62b4c0aa4e854be3297184d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:43.294400 16337 tablet_service.cc:1511] Processing CreateTablet for tablet 9541a370ec014267a500f45686395fb8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:43.278275 16190 tablet_service.cc:1511] Processing CreateTablet for tablet 520520ce482b48638578a08a887f961f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:43.308521 16418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1671729a63334f38b4e87d414002c770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.317904 16230 heartbeater.cc:499] Master 127.7.137.62:40141 was elected leader, sending a full tablet report...
I20260709 12:16:43.311213 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb645de5083941e0a7dd5d4e4cf1a798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.322952 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520520ce482b48638578a08a887f961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.311034 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 6242d48e3df44f7aa37579a1cf56386f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:43.310045 16335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0013e821aa88410fa79bc656b03ec146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.329620 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4353bb62b4c0aa4e854be3297184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.331615 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ed9c1ffe244289120a4bac0d23ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.334467 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520520ce482b48638578a08a887f961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.327920 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 863095d43c5442399227ac8c352a6213 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:43.328863 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced4db8ec1524a7b8e3ff437ea389c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.335393 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5109a72f97348a6b66b2a2541c30448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.358978 16472 ts_tablet_manager.cc:1434] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.011s
I20260709 12:16:43.369709 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 6f9ae53f366a4893a34b5bef50a38f1b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:43.388108 16479 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.388384 16305 heartbeater.cc:499] Master 127.7.137.62:40141 was elected leader, sending a full tablet report...
I20260709 12:16:43.388751 16479 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:43.389699 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457ef541e8004732abf224552592d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.394084 16479 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:43.396970 16473 ts_tablet_manager.cc:1434] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.188s	user 0.011s	sys 0.021s
I20260709 12:16:43.398195 16453 heartbeater.cc:499] Master 127.7.137.62:40141 was elected leader, sending a full tablet report...
I20260709 12:16:43.395421 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea523de666d4596bdfd1b53225aff83 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:43.398906 16473 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
W20260709 12:16:43.402132 16306 tablet.cc:2406] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:43.405248 16414 tablet_service.cc:1511] Processing CreateTablet for tablet 0e140631c2f341008091adb103aedea0 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:43.405614 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 4b249075c4bd41b7b53b295ee5b2fc89 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:43.406980 16472 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:43.426841 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863095d43c5442399227ac8c352a6213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.427110 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 863095d43c5442399227ac8c352a6213 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:43.428154 16411 tablet_service.cc:1511] Processing CreateTablet for tablet f2e0c1be74c24bfc83cd8c2b649c857d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:43.443809 16261 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5375d913f4705865397203673a5f5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:43.466238 16267 tablet_service.cc:1511] Processing CreateTablet for tablet 48becf037f204145949737e10924ba94 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:43.491861 16266 tablet_service.cc:1511] Processing CreateTablet for tablet e128886ac9ad43e8b89a82573e4512fb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:43.499543 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6242d48e3df44f7aa37579a1cf56386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.510221 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 4b249075c4bd41b7b53b295ee5b2fc89 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:43.514407 16379 heartbeater.cc:499] Master 127.7.137.62:40141 was elected leader, sending a full tablet report...
I20260709 12:16:43.524791 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4353bb62b4c0aa4e854be3297184d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:43.526943 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4353bb62b4c0aa4e854be3297184d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.541386 16191 tablet_service.cc:1511] Processing CreateTablet for tablet efd3baaf1b0f43f59cfe39fba8bb4dde (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:43.543385 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3baaf1b0f43f59cfe39fba8bb4dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.547676 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48becf037f204145949737e10924ba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.549207 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 9541a370ec014267a500f45686395fb8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:43.551048 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541a370ec014267a500f45686395fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.553635 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e0c1be74c24bfc83cd8c2b649c857d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.557542 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 0013e821aa88410fa79bc656b03ec146 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:43.559675 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0013e821aa88410fa79bc656b03ec146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.565220 16416 tablet_service.cc:1511] Processing CreateTablet for tablet 097c0d5bee584f93ac4b342c7b129ecd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:43.570732 16410 tablet_service.cc:1511] Processing CreateTablet for tablet ab64c621e79c4de99600ba8b24da4565 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:43.565361 16418 tablet_service.cc:1511] Processing CreateTablet for tablet 68c7f1839b1f45898709d7b951744cd4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:43.583803 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541a370ec014267a500f45686395fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.583926 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b249075c4bd41b7b53b295ee5b2fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.589716 16476 raft_consensus.cc:493] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.590281 16476 raft_consensus.cc:515] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:43.591562 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea523de666d4596bdfd1b53225aff83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.600320 16186 tablet_service.cc:1511] Processing CreateTablet for tablet e9773066f8824befb0ba38e00f26711b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:43.601795 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9773066f8824befb0ba38e00f26711b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.602455 16336 tablet_service.cc:1511] Processing CreateTablet for tablet 926305cc352545b3b98774de0464f46b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:43.603345 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f9ae53f366a4893a34b5bef50a38f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.604633 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 35d00760f88247f1a179973d1c7cc34e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:43.606002 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d00760f88247f1a179973d1c7cc34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.607946 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 926305cc352545b3b98774de0464f46b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:43.609385 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926305cc352545b3b98774de0464f46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.612049 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5375d913f4705865397203673a5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.618553 16476 leader_election.cc:290] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:43.603157 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 87730c15a7404b79bbd0af9b86a540eb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:43.633661 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb645de5083941e0a7dd5d4e4cf1a798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.567076 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c0d5bee584f93ac4b342c7b129ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.652485 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e128886ac9ad43e8b89a82573e4512fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.672348 16418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c7f1839b1f45898709d7b951744cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.676159 16481 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:43.677026 16417 tablet_service.cc:1511] Processing CreateTablet for tablet d6155e95b762495aab0bd4e75cfbe8f8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:43.685050 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 0bff55b8f07d462d9bdf2065695fa373 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:43.691762 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:43.656994 16336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926305cc352545b3b98774de0464f46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.711216 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6155e95b762495aab0bd4e75cfbe8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.755311 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863095d43c5442399227ac8c352a6213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.761407 16473 tablet_bootstrap.cc:654] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.753013 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87730c15a7404b79bbd0af9b86a540eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.770623 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e140631c2f341008091adb103aedea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.775643 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b249075c4bd41b7b53b295ee5b2fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.779692 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab64c621e79c4de99600ba8b24da4565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.788340 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bff55b8f07d462d9bdf2065695fa373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.802369 16412 tablet_service.cc:1511] Processing CreateTablet for tablet b2d7819347af4afca9881790734e9619 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:43.804800 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d7819347af4afca9881790734e9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.806221 16341 tablet_service.cc:1511] Processing CreateTablet for tablet e9773066f8824befb0ba38e00f26711b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:43.807416 16477 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:43.819442 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.820006 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 49e6d3a14dc24349a70fb2f3910a1fa4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:43.846138 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9773066f8824befb0ba38e00f26711b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.847172 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:43.852794 16392 leader_election.cc:343] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.850168 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 988b9e49e49b4d469474bbc23cf32e6d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:43.873588 16473 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:43.874172 16473 ts_tablet_manager.cc:1403] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.476s	user 0.019s	sys 0.000s
I20260709 12:16:43.874966 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b9e49e49b4d469474bbc23cf32e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.877476 16473 raft_consensus.cc:359] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:43.878264 16473 raft_consensus.cc:385] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:43.878577 16473 raft_consensus.cc:740] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:43.886034 16481 tablet_bootstrap.cc:654] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.886171 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 4d18ca29fb0b4817b4d87bc6840c4b04 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:43.888868 16265 tablet_service.cc:1511] Processing CreateTablet for tablet f2e0c1be74c24bfc83cd8c2b649c857d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:43.893225 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e0c1be74c24bfc83cd8c2b649c857d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.887035 16186 tablet_service.cc:1511] Processing CreateTablet for tablet b4b31f6cc7b54ab1b202f40bc200510e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:43.864250 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:43.852586 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 300c2bb3f55044b295cab5e11e366867 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 12:16:43.896391 16244 leader_election.cc:343] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Not found: Tablet not found: 6ba4353bb62b4c0aa4e854be3297184d
W20260709 12:16:43.901168 16244 leader_election.cc:343] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.901588 16244 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:43.904047 16478 raft_consensus.cc:2749] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.903358 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 097c0d5bee584f93ac4b342c7b129ecd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:43.899825 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 115b0258196c44cf8e08f3a410ef0b5e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:43.906462 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c0d5bee584f93ac4b342c7b129ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.870724 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 300c2bb3f55044b295cab5e11e366867 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:43.915411 16473 consensus_queue.cc:260] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:43.918268 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 70a614d403d5457387fe78a772c1a022 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:43.934588 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 4d18ca29fb0b4817b4d87bc6840c4b04 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:43.938372 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 83df294335c64a35b675edbe966445f4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:43.918329 16473 ts_tablet_manager.cc:1434] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:16:43.922580 16192 tablet_service.cc:1511] Processing CreateTablet for tablet ed67f1fe7bfc40cbaa81904b04e85bbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:43.863883 16472 tablet_bootstrap.cc:654] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.929508 16477 tablet_bootstrap.cc:654] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:43.930398 16410 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea0d617a664190b1f5e4cf3b807bd5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:43.931573 16263 tablet_service.cc:1511] Processing CreateTablet for tablet ab64c621e79c4de99600ba8b24da4565 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:43.940910 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:43.939705 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e6d3a14dc24349a70fb2f3910a1fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.967621 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b0258196c44cf8e08f3a410ef0b5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:43.967891 16392 leader_election.cc:343] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:43.968402 16392 leader_election.cc:304] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:43.969367 16482 raft_consensus.cc:2749] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:43.970191 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab64c621e79c4de99600ba8b24da4565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.975733 16264 tablet_service.cc:1511] Processing CreateTablet for tablet b2d7819347af4afca9881790734e9619 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:43.977090 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d7819347af4afca9881790734e9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.980438 16191 tablet_service.cc:1511] Processing CreateTablet for tablet d2f740872ebf4b868aae02d23315877f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:43.950822 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 115b0258196c44cf8e08f3a410ef0b5e (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:43.953941 16268 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10175cba84c73816eb6b8bfb0ed55 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:43.992802 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10175cba84c73816eb6b8bfb0ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.995973 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300c2bb3f55044b295cab5e11e366867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.996181 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4130f8e68e4e1186f8b3e11d38a05c (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:43.954417 16411 tablet_service.cc:1511] Processing CreateTablet for tablet f14f4ff55edf4aec8fec38b5631debbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:43.999126 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b31f6cc7b54ab1b202f40bc200510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.003906 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d18ca29fb0b4817b4d87bc6840c4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.006173 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 862350edca82469998bc1533fcd8f418 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:43.964625 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a614d403d5457387fe78a772c1a022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.007165 16336 tablet_service.cc:1511] Processing CreateTablet for tablet fffe1c659d7f45fa93bdafacea3f9ce1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:44.001957 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300c2bb3f55044b295cab5e11e366867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.009351 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862350edca82469998bc1533fcd8f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.009807 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4130f8e68e4e1186f8b3e11d38a05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.010476 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b0258196c44cf8e08f3a410ef0b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.004159 16337 tablet_service.cc:1511] Processing CreateTablet for tablet ed67f1fe7bfc40cbaa81904b04e85bbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:44.011909 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea0d617a664190b1f5e4cf3b807bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.012920 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed67f1fe7bfc40cbaa81904b04e85bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.013856 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f740872ebf4b868aae02d23315877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.014923 16336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fffe1c659d7f45fa93bdafacea3f9ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.016062 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed67f1fe7bfc40cbaa81904b04e85bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.016626 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14f4ff55edf4aec8fec38b5631debbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.023896 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d18ca29fb0b4817b4d87bc6840c4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.959169 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 52e7274549d04acc9c7bb43812b87d79 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:44.004722 16335 tablet_service.cc:1511] Processing CreateTablet for tablet 52e7274549d04acc9c7bb43812b87d79 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:44.041330 16335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e7274549d04acc9c7bb43812b87d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.041391 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e7274549d04acc9c7bb43812b87d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:43.955159 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 87730c15a7404b79bbd0af9b86a540eb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:44.053758 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83df294335c64a35b675edbe966445f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.054013 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87730c15a7404b79bbd0af9b86a540eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.060814 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 2369e1f2303b4bd18b96d22c3b994929 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:16:44.062502 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 63382.7us
W20260709 12:16:44.063846 16088 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 52660.5us
I20260709 12:16:44.069344 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 2f71fc08eaff42d5901a4921f0051394 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:44.070731 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f71fc08eaff42d5901a4921f0051394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.075512 16473 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:44.076620 16344 tablet_service.cc:1511] Processing CreateTablet for tablet d2f740872ebf4b868aae02d23315877f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:44.078169 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f740872ebf4b868aae02d23315877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.085717 16477 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:44.086352 16477 ts_tablet_manager.cc:1403] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.340s	user 0.017s	sys 0.000s
I20260709 12:16:44.111663 16472 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:44.111961 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 96914659c82446db831047bbe79634a6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:44.112473 16472 ts_tablet_manager.cc:1403] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.706s	user 0.022s	sys 0.003s
I20260709 12:16:44.113379 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96914659c82446db831047bbe79634a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.113067 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 70a614d403d5457387fe78a772c1a022 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:44.114595 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a614d403d5457387fe78a772c1a022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.116433 16472 raft_consensus.cc:359] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.106577 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2369e1f2303b4bd18b96d22c3b994929. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:44.122412 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:44.078996 16190 tablet_service.cc:1511] Processing CreateTablet for tablet 05fd27468a6e4c88ab3ee076f99a4e73 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:44.127745 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fd27468a6e4c88ab3ee076f99a4e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.128158 16481 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:44.128861 16481 ts_tablet_manager.cc:1403] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.453s	user 0.003s	sys 0.025s
I20260709 12:16:44.130962 16473 tablet_bootstrap.cc:654] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.121490 16472 raft_consensus.cc:385] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.142349 16472 raft_consensus.cc:740] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.143328 16472 consensus_queue.cc:260] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.132083 16267 tablet_service.cc:1511] Processing CreateTablet for tablet f14f4ff55edf4aec8fec38b5631debbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:44.134425 16341 tablet_service.cc:1511] Processing CreateTablet for tablet 05fd27468a6e4c88ab3ee076f99a4e73 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:44.152364 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14f4ff55edf4aec8fec38b5631debbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.151907 16477 raft_consensus.cc:359] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.152508 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fd27468a6e4c88ab3ee076f99a4e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.153034 16477 raft_consensus.cc:385] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.153501 16477 raft_consensus.cc:740] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.154407 16477 consensus_queue.cc:260] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.156957 16481 raft_consensus.cc:359] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.157871 16481 raft_consensus.cc:385] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.158267 16481 raft_consensus.cc:740] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.159308 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 4b249075c4bd41b7b53b295ee5b2fc89 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:44.160696 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b249075c4bd41b7b53b295ee5b2fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.152606 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 311a9b9c003249ef8438269658bcf3e1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:44.163462 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311a9b9c003249ef8438269658bcf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.164572 16472 ts_tablet_manager.cc:1434] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:16:44.170921 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 06d90126bf2c4c43b7021634cef076aa (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:44.172339 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d90126bf2c4c43b7021634cef076aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.178601 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4130f8e68e4e1186f8b3e11d38a05c (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:44.179579 16266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47834 (request call id 26) took 1024 ms. Trace:
I20260709 12:16:44.159435 16481 consensus_queue.cc:260] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.183516 16266 rpcz_store.cc:276] 0709 12:16:43.155413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.334842 (+179429us) service_pool.cc:224] Handling call
0709 12:16:43.493149 (+158307us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:43.493293 (+   144us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.058229 (+564936us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.178988 (+120759us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.179503 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.192062 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4130f8e68e4e1186f8b3e11d38a05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.193817 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 6242d48e3df44f7aa37579a1cf56386f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:44.196056 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6242d48e3df44f7aa37579a1cf56386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.210717 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 6f9ae53f366a4893a34b5bef50a38f1b (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:44.215610 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f9ae53f366a4893a34b5bef50a38f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.217257 16335 tablet_service.cc:1511] Processing CreateTablet for tablet 4b08e7c028cd4260a57cc16d538a6431 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:44.218814 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 6242d48e3df44f7aa37579a1cf56386f (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:44.224853 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 4b08e7c028cd4260a57cc16d538a6431 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:44.226292 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b08e7c028cd4260a57cc16d538a6431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.227469 16335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b08e7c028cd4260a57cc16d538a6431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.232074 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6242d48e3df44f7aa37579a1cf56386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.238847 16478 raft_consensus.cc:493] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.239439 16478 raft_consensus.cc:515] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.241845 16478 leader_election.cc:290] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.243621 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:44.225494 16337 tablet_service.cc:1511] Processing CreateTablet for tablet e128886ac9ad43e8b89a82573e4512fb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:44.244418 16354 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:44.245162 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e128886ac9ad43e8b89a82573e4512fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.260113 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 1671729a63334f38b4e87d414002c770 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:44.270490 16472 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:44.275353 16244 leader_election.cc:304] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:44.276470 16478 raft_consensus.cc:2804] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.276885 16478 raft_consensus.cc:493] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.276552 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea523de666d4596bdfd1b53225aff83 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:44.277235 16478 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.277331 16186 tablet_service.cc:1511] Processing CreateTablet for tablet 1671729a63334f38b4e87d414002c770 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:44.277985 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea523de666d4596bdfd1b53225aff83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.278656 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1671729a63334f38b4e87d414002c770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.279038 16482 raft_consensus.cc:493] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.279539 16482 raft_consensus.cc:515] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.281984 16482 leader_election.cc:290] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:44.284394 16477 ts_tablet_manager.cc:1434] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.198s	user 0.009s	sys 0.008s
I20260709 12:16:44.284683 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:44.284904 16478 raft_consensus.cc:515] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.291966 16189 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5375d913f4705865397203673a5f5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:44.293466 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:44.296525 16392 leader_election.cc:343] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.298135 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1671729a63334f38b4e87d414002c770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.296406 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 863095d43c5442399227ac8c352a6213 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:44.305254 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863095d43c5442399227ac8c352a6213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.308219 16336 tablet_service.cc:1511] Processing CreateTablet for tablet e0f5375d913f4705865397203673a5f5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:44.310359 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:44.310971 16336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5375d913f4705865397203673a5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.310974 16354 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.312801 16478 leader_election.cc:290] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.309854 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 48becf037f204145949737e10924ba94 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:44.286055 16477 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.320207 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 0e140631c2f341008091adb103aedea0 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:44.321466 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.316475 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48becf037f204145949737e10924ba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.316727 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 48becf037f204145949737e10924ba94 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:44.332968 16472 tablet_bootstrap.cc:654] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.333113 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 0e140631c2f341008091adb103aedea0 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:44.336781 16473 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:44.337462 16473 ts_tablet_manager.cc:1403] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.335s	user 0.011s	sys 0.010s
I20260709 12:16:44.315675 16338 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 15) took 1015 ms. Trace:
I20260709 12:16:44.339479 16338 rpcz_store.cc:276] 0709 12:16:43.299836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.933520 (+633684us) service_pool.cc:224] Handling call
0709 12:16:44.001168 (+ 67648us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b58008d5a98. stack: 00007f3982b1c343 00007f3982b1c240 00007f39824ab1d4 00007f398c1e9304 00007f398c1e9299 00007f39829d6db1 00007f3982b16e9c 00007f3982b16a5b 00007f398ba2f8d9 00007f398ab89ee0 00007f398ac6f831 00007f398ac4cac3 00007f398abfb400 00007f3984080af4 00007f3984080a82 00007f39840809b1
0709 12:16:44.021656 (+ 20488us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.021986 (+   330us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.257638 (+235652us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.315003 (+ 57365us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.315592 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558272}
I20260709 12:16:44.324394 16481 ts_tablet_manager.cc:1434] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.195s	user 0.011s	sys 0.002s
I20260709 12:16:44.354137 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e140631c2f341008091adb103aedea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.360097 16341 tablet_service.cc:1511] Processing CreateTablet for tablet f2e0c1be74c24bfc83cd8c2b649c857d (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:44.371212 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e0c1be74c24bfc83cd8c2b649c857d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.363266 16481 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:44.388504 16190 tablet_service.cc:1511] Processing CreateTablet for tablet 097c0d5bee584f93ac4b342c7b129ecd (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:44.356658 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f5375d913f4705865397203673a5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.373414 16354 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:44.390897 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e140631c2f341008091adb103aedea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.392269 16244 leader_election.cc:304] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:44.393254 16478 raft_consensus.cc:2804] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.394883 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48becf037f204145949737e10924ba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.395509 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:44.397076 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:44.398725 16246 leader_election.cc:343] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:44.399714 16246 leader_election.cc:343] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.402961 16343 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 30) took 1046 ms. Trace:
I20260709 12:16:44.403697 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:44.380115 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:44.362712 16473 raft_consensus.cc:359] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.408766 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2900d9ea1c427ab2b3dea2db3a6e61. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:44.408808 16392 leader_election.cc:343] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.409401 16392 leader_election.cc:304] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:44.407385 16473 raft_consensus.cc:385] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.410393 16482 raft_consensus.cc:2749] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.410998 16473 raft_consensus.cc:740] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.410341 16335 tablet_service.cc:1511] Processing CreateTablet for tablet 68c7f1839b1f45898709d7b951744cd4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:44.411898 16473 consensus_queue.cc:260] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.418733 16472 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:44.421837 16472 ts_tablet_manager.cc:1403] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.008s
I20260709 12:16:44.420653 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 68c7f1839b1f45898709d7b951744cd4 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:44.423666 16473 ts_tablet_manager.cc:1434] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.086s	user 0.012s	sys 0.000s
I20260709 12:16:44.403409 16343 rpcz_store.cc:276] 0709 12:16:43.356580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.308932 (+952352us) service_pool.cc:224] Handling call
0709 12:16:44.316024 (+  7092us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.316116 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.341475 (+ 25359us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.402451 (+ 60976us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.402902 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.432631 16473 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:44.433092 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c0d5bee584f93ac4b342c7b129ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.433445 16343 tablet_service.cc:1511] Processing CreateTablet for tablet ab64c621e79c4de99600ba8b24da4565 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:44.438163 16342 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 28) took 1082 ms. Trace:
I20260709 12:16:44.438570 16342 rpcz_store.cc:276] 0709 12:16:43.355955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.259027 (+903072us) service_pool.cc:224] Handling call
0709 12:16:44.297661 (+ 38634us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.297774 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.382711 (+ 84937us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.437639 (+ 54928us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.438101 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.443073 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c7f1839b1f45898709d7b951744cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.457351 16481 tablet_bootstrap.cc:654] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.428427 16478 raft_consensus.cc:697] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:44.448555 16339 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 31) took 1091 ms. Trace:
I20260709 12:16:44.460842 16339 rpcz_store.cc:276] 0709 12:16:43.356868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.316658 (+959790us) service_pool.cc:224] Handling call
0709 12:16:44.321971 (+  5313us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.322057 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.380949 (+ 58892us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.448025 (+ 67076us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.448496 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.461294 16478 consensus_queue.cc:237] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.463806 16339 tablet_service.cc:1511] Processing CreateTablet for tablet d6155e95b762495aab0bd4e75cfbe8f8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:44.449558 16477 tablet_bootstrap.cc:654] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.465011 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 96914659c82446db831047bbe79634a6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:44.465817 16188 tablet_service.cc:1511] Processing CreateTablet for tablet d6155e95b762495aab0bd4e75cfbe8f8 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:44.466413 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96914659c82446db831047bbe79634a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.467207 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6155e95b762495aab0bd4e75cfbe8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.452514 16193 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10175cba84c73816eb6b8bfb0ed55 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:44.458108 16472 raft_consensus.cc:359] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.468272 16472 raft_consensus.cc:385] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.447366 16335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c7f1839b1f45898709d7b951744cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.468699 16472 raft_consensus.cc:740] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.469003 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 87730c15a7404b79bbd0af9b86a540eb (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:44.469811 16472 consensus_queue.cc:260] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.471540 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab64c621e79c4de99600ba8b24da4565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.472092 16340 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 29) took 1115 ms. Trace:
I20260709 12:16:44.472491 16340 rpcz_store.cc:276] 0709 12:16:43.356287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.295490 (+939203us) service_pool.cc:224] Handling call
0709 12:16:44.304788 (+  9298us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.304885 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.424717 (+119832us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.471587 (+ 46870us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.472027 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.473714 16472 ts_tablet_manager.cc:1434] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 12:16:44.455042 16344 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 24) took 1103 ms. Trace:
I20260709 12:16:44.468554 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10175cba84c73816eb6b8bfb0ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.477093 16336 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 27) took 1121 ms. Trace:
I20260709 12:16:44.477523 16336 rpcz_store.cc:276] 0709 12:16:43.355640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.254369 (+898729us) service_pool.cc:224] Handling call
0709 12:16:44.310525 (+ 56156us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.310615 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.422261 (+111646us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.476565 (+ 54304us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.477033 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.475644 16344 rpcz_store.cc:276] 0709 12:16:43.354525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.217810 (+863285us) service_pool.cc:224] Handling call
0709 12:16:44.231350 (+ 13540us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.231509 (+   159us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.343350 (+111841us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.454503 (+111153us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.454982 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.480712 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 96914659c82446db831047bbe79634a6 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:44.475576 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6155e95b762495aab0bd4e75cfbe8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.487641 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96914659c82446db831047bbe79634a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.493317 16336 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea0d617a664190b1f5e4cf3b807bd5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:44.460090 16473 tablet_bootstrap.cc:654] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.482573 16341 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 32) took 1125 ms. Trace:
I20260709 12:16:44.461431 16342 tablet_service.cc:1511] Processing CreateTablet for tablet f1b10175cba84c73816eb6b8bfb0ed55 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:44.494614 16336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea0d617a664190b1f5e4cf3b807bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.497037 16477 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:44.495474 16341 rpcz_store.cc:276] 0709 12:16:43.357179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.325975 (+968796us) service_pool.cc:224] Handling call
0709 12:16:44.370672 (+ 44697us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.370780 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.442490 (+ 71710us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.481975 (+ 39485us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.482503 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.497587 16477 ts_tablet_manager.cc:1403] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.212s	user 0.006s	sys 0.005s
I20260709 12:16:44.498559 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87730c15a7404b79bbd0af9b86a540eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.475224 16340 tablet_service.cc:1511] Processing CreateTablet for tablet b2d7819347af4afca9881790734e9619 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:44.501348 16477 raft_consensus.cc:359] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.502074 16477 raft_consensus.cc:385] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.502362 16477 raft_consensus.cc:740] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.504616 16337 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 26) took 1149 ms. Trace:
I20260709 12:16:44.504330 16341 tablet_service.cc:1511] Processing CreateTablet for tablet f14f4ff55edf4aec8fec38b5631debbe (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:44.505043 16337 rpcz_store.cc:276] 0709 12:16:43.355317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.224396 (+869079us) service_pool.cc:224] Handling call
0709 12:16:44.244683 (+ 20287us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.244791 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.441525 (+196734us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.504077 (+ 62552us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.504555 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.507875 16337 tablet_service.cc:1511] Processing CreateTablet for tablet 311a9b9c003249ef8438269658bcf3e1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:44.509897 16494 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.510403 16494 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.513276 16494 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:44.515928 16101 catalog_manager.cc:5697] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.489053 16472 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:44.524401 16473 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:44.539626 16473 ts_tablet_manager.cc:1403] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.002s
I20260709 12:16:44.540128 16335 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 34) took 1182 ms. Trace:
I20260709 12:16:44.527841 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14f4ff55edf4aec8fec38b5631debbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.503103 16477 consensus_queue.cc:260] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.541098 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b10175cba84c73816eb6b8bfb0ed55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.542405 16477 ts_tablet_manager.cc:1434] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.004s
I20260709 12:16:44.497644 16186 tablet_service.cc:1511] Processing CreateTablet for tablet 70a614d403d5457387fe78a772c1a022 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:44.543537 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311a9b9c003249ef8438269658bcf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.543919 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a614d403d5457387fe78a772c1a022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.546897 16472 tablet_bootstrap.cc:654] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.531075 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 52ea0d617a664190b1f5e4cf3b807bd5 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:44.548128 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ea0d617a664190b1f5e4cf3b807bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.549904 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 2f71fc08eaff42d5901a4921f0051394 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:44.551770 16477 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.553017 16473 raft_consensus.cc:359] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.524996 16481 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:44.567448 16473 raft_consensus.cc:385] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.567741 16481 ts_tablet_manager.cc:1403] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.000s
I20260709 12:16:44.567834 16473 raft_consensus.cc:740] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.568781 16473 consensus_queue.cc:260] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.569175 16338 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 33) took 1211 ms. Trace:
I20260709 12:16:44.540619 16335 rpcz_store.cc:276] 0709 12:16:43.357802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.409311 (+1051509us) service_pool.cc:224] Handling call
0709 12:16:44.412598 (+  3287us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.412709 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.486536 (+ 73827us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.539560 (+ 53024us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.540067 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.569638 16338 rpcz_store.cc:276] 0709 12:16:43.357492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.369663 (+1012171us) service_pool.cc:224] Handling call
0709 12:16:44.408264 (+ 38601us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.408362 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.491086 (+ 82724us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.568638 (+ 77552us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.569110 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.533787 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4130f8e68e4e1186f8b3e11d38a05c (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:44.566334 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:44.573588 16427 raft_consensus.cc:2468] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:44.563691 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d7819347af4afca9881790734e9619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.571082 16481 raft_consensus.cc:359] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.540414 16343 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51178 (request call id 35) took 1059 ms. Trace:
I20260709 12:16:44.577654 16477 tablet_bootstrap.cc:654] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.581961 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f71fc08eaff42d5901a4921f0051394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.582777 16335 tablet_service.cc:1511] Processing CreateTablet for tablet 2f71fc08eaff42d5901a4921f0051394 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:44.576709 16481 raft_consensus.cc:385] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.587627 16335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f71fc08eaff42d5901a4921f0051394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.588466 16473 ts_tablet_manager.cc:1434] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.005s
I20260709 12:16:44.590036 16473 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:44.578751 16343 rpcz_store.cc:276] 0709 12:16:43.481299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.432446 (+951147us) service_pool.cc:224] Handling call
0709 12:16:44.434263 (+  1817us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.434363 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.520903 (+ 86540us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.539806 (+ 18903us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.540352 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.595651 16481 raft_consensus.cc:740] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.605072 16481 consensus_queue.cc:260] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.610860 16496 raft_consensus.cc:493] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.611487 16496 raft_consensus.cc:515] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.613360 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4130f8e68e4e1186f8b3e11d38a05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.616355 16496 leader_election.cc:290] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.633085 16494 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.633852 16494 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.635757 16481 ts_tablet_manager.cc:1434] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 12:16:44.636915 16481 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:44.637456 16494 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.644012 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 311a9b9c003249ef8438269658bcf3e1 (DEFAULT_TABLE table=test-workload [id=34e02eef4c75478b830f8ea5ca8b62d0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:44.651149 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311a9b9c003249ef8438269658bcf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.660657 16477 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:44.661252 16477 ts_tablet_manager.cc:1403] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.027s
I20260709 12:16:44.668489 16477 raft_consensus.cc:359] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.669283 16477 raft_consensus.cc:385] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.669584 16477 raft_consensus.cc:740] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.670321 16477 consensus_queue.cc:260] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.674067 16477 ts_tablet_manager.cc:1434] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:16:44.675136 16477 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.681075 16171 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:44.684919 16494 raft_consensus.cc:2804] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.685321 16494 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.685643 16494 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:44.687423 16171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 109816us
I20260709 12:16:44.689076 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:44.690618 16171 leader_election.cc:343] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.695673 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:44.697302 16169 leader_election.cc:343] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.702350 16473 tablet_bootstrap.cc:654] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.705379 16494 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.708237 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:44.708863 16427 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.712603 16481 tablet_bootstrap.cc:654] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.720073 16427 raft_consensus.cc:2468] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:44.721583 16171 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:44.725952 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:44.728015 16169 leader_election.cc:343] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.722986 16494 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:44.729991 16494 raft_consensus.cc:2804] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.730422 16494 raft_consensus.cc:697] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:44.735685 16477 tablet_bootstrap.cc:654] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.731050 16494 consensus_queue.cc:237] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.740165 16472 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:44.740154 16481 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:44.740891 16472 ts_tablet_manager.cc:1403] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.252s	user 0.011s	sys 0.006s
I20260709 12:16:44.741225 16481 ts_tablet_manager.cc:1403] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.000s
I20260709 12:16:44.744411 16472 raft_consensus.cc:359] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.745266 16472 raft_consensus.cc:385] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.745590 16472 raft_consensus.cc:740] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.745709 16481 raft_consensus.cc:359] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.746464 16472 consensus_queue.cc:260] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.746827 16481 raft_consensus.cc:385] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.751307 16481 raft_consensus.cc:740] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.759966 16481 consensus_queue.cc:260] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.756561 16473 tablet_bootstrap.cc:492] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:44.765591 16473 ts_tablet_manager.cc:1403] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.007s
I20260709 12:16:44.765749 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:44.766498 16354 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:44.767982 16169 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:44.768167 16482 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.769413 16482 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.769639 16473 raft_consensus.cc:359] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.770349 16473 raft_consensus.cc:385] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.770646 16473 raft_consensus.cc:740] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.771598 16481 ts_tablet_manager.cc:1434] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:16:44.771477 16473 consensus_queue.cc:260] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.772775 16481 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:44.776368 16482 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:44.778985 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:44.780288 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:44.785851 16477 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:44.786453 16477 ts_tablet_manager.cc:1403] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.002s
W20260709 12:16:44.785763 16392 leader_election.cc:343] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.782058 16473 ts_tablet_manager.cc:1434] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:16:44.788669 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:44.787456 16392 leader_election.cc:343] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.789737 16392 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:44.789816 16477 raft_consensus.cc:359] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:44.790200 16318 leader_election.cc:343] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.790640 16477 raft_consensus.cc:385] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.788715 16473 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:44.791188 16477 raft_consensus.cc:740] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.792198 16477 consensus_queue.cc:260] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.790668 16482 raft_consensus.cc:2749] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.796435 16481 tablet_bootstrap.cc:654] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.798614 16100 catalog_manager.cc:5697] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.802733 16494 raft_consensus.cc:493] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.803290 16494 raft_consensus.cc:515] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.805415 16494 leader_election.cc:290] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:44.780555 16517 raft_consensus.cc:2804] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.806429 16517 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.806901 16517 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.809316 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:44.812798 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:44.758071 16472 ts_tablet_manager.cc:1434] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
W20260709 12:16:44.811925 16169 leader_election.cc:343] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:44.815115 16169 leader_election.cc:343] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.815735 16169 leader_election.cc:304] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:44.817188 16494 raft_consensus.cc:2749] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:44.832139 16472 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:44.868619 16169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 53544.9us
I20260709 12:16:44.874579 16427 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.875787 16473 tablet_bootstrap.cc:654] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.882441 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:44.883446 16428 raft_consensus.cc:2468] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:44.885007 16478 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:44.885486 16320 leader_election.cc:304] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:44.885921 16472 tablet_bootstrap.cc:654] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.886520 16496 raft_consensus.cc:2804] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.886449 16517 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.887072 16496 raft_consensus.cc:493] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.887537 16496 raft_consensus.cc:3060] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.888707 16517 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.890231 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:44.891670 16171 leader_election.cc:343] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.892498 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:44.892810 16481 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:44.893112 16354 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.893307 16481 ts_tablet_manager.cc:1403] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.121s	user 0.018s	sys 0.070s
I20260709 12:16:44.895326 16477 ts_tablet_manager.cc:1434] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.109s	user 0.024s	sys 0.062s
I20260709 12:16:44.896337 16481 raft_consensus.cc:359] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.897095 16481 raft_consensus.cc:385] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.897389 16481 raft_consensus.cc:740] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.898290 16481 consensus_queue.cc:260] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:44.905403 16354 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:44.909113 16169 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:44.910799 16523 raft_consensus.cc:2804] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.911458 16523 raft_consensus.cc:697] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:44.914731 16477 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.915313 16523 consensus_queue.cc:237] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.922672 16496 raft_consensus.cc:515] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.924623 16477 tablet_bootstrap.cc:654] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.926896 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:44.928908 16318 leader_election.cc:343] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.932381 16473 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:44.933180 16473 ts_tablet_manager.cc:1403] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.145s	user 0.024s	sys 0.008s
I20260709 12:16:44.937062 16478 raft_consensus.cc:493] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.937616 16478 raft_consensus.cc:515] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.939968 16478 leader_election.cc:290] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:44.944039 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:44.945001 16427 raft_consensus.cc:2468] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:44.946257 16246 leader_election.cc:304] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:44.947413 16477 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:44.942330 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:44.941479 16533 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:44.947213 16478 raft_consensus.cc:2804] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:44.948519 16478 raft_consensus.cc:493] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.948922 16478 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:44.948945 16244 leader_election.cc:343] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.951558 16477 ts_tablet_manager.cc:1403] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.006s
I20260709 12:16:44.952263 16100 catalog_manager.cc:5697] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.955471 16477 raft_consensus.cc:359] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.956442 16477 raft_consensus.cc:385] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.956823 16477 raft_consensus.cc:740] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.962085 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:44.962824 16428 raft_consensus.cc:3060] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:44.963486 16473 raft_consensus.cc:359] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.964470 16473 raft_consensus.cc:385] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:44.964841 16473 raft_consensus.cc:740] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:44.965708 16496 leader_election.cc:290] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:44.968374 16481 ts_tablet_manager.cc:1434] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.075s	user 0.017s	sys 0.024s
I20260709 12:16:44.974810 16428 raft_consensus.cc:2468] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:44.974884 16478 raft_consensus.cc:515] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.976590 16477 consensus_queue.cc:260] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.979728 16523 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.980235 16523 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:44.981490 16478 leader_election.cc:290] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:44.982285 16523 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:44.976625 16481 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:44.982607 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:44.983276 16320 leader_election.cc:304] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:44.978343 16472 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:44.984337 16472 ts_tablet_manager.cc:1403] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.050s
I20260709 12:16:44.984205 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:44.983248 16427 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:44.985664 16244 leader_election.cc:343] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.983374 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:44.987571 16528 raft_consensus.cc:2804] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:44.988163 16528 raft_consensus.cc:697] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
W20260709 12:16:44.988785 16169 leader_election.cc:343] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:44.988937 16477 ts_tablet_manager.cc:1434] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 12:16:44.990075 16477 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.991302 16481 tablet_bootstrap.cc:654] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.977116 16473 consensus_queue.cc:260] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.993331 16427 raft_consensus.cc:2468] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:44.989092 16528 consensus_queue.cc:237] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:44.995435 16246 leader_election.cc:304] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:44.994119 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:44.997298 16428 raft_consensus.cc:2468] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:44.998889 16171 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.000056 16523 raft_consensus.cc:2804] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.000434 16523 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.000772 16523 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.001075 16477 tablet_bootstrap.cc:654] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:44.987588 16472 raft_consensus.cc:359] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.006258 16472 raft_consensus.cc:385] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.006543 16472 raft_consensus.cc:740] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.007333 16472 consensus_queue.cc:260] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.008428 16533 raft_consensus.cc:2804] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.008952 16533 raft_consensus.cc:697] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:45.010108 16472 ts_tablet_manager.cc:1434] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:16:45.009904 16533 consensus_queue.cc:237] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.011204 16472 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:45.014281 16477 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.015026 16477 ts_tablet_manager.cc:1403] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:16:45.019486 16477 raft_consensus.cc:359] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.020524 16477 raft_consensus.cc:385] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.020957 16477 raft_consensus.cc:740] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.023765 16472 tablet_bootstrap.cc:654] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.025416 16477 consensus_queue.cc:260] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.029101 16477 ts_tablet_manager.cc:1434] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:45.020277 16523 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.030433 16477 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:44.993985 16473 ts_tablet_manager.cc:1434] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 12:16:45.033766 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:45.035348 16428 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.034749 16523 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:45.038750 16473 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:45.040058 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:45.047593 16477 tablet_bootstrap.cc:654] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.048414 16102 catalog_manager.cc:5697] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:45.047631 16169 leader_election.cc:343] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.054867 16099 catalog_manager.cc:5697] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.061537 16477 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.062409 16477 ts_tablet_manager.cc:1403] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 12:16:45.067109 16477 raft_consensus.cc:359] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.068148 16477 raft_consensus.cc:385] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.068545 16477 raft_consensus.cc:740] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.069875 16477 consensus_queue.cc:260] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.073333 16473 tablet_bootstrap.cc:654] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.075408 16477 ts_tablet_manager.cc:1434] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.002s
I20260709 12:16:45.076563 16472 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:45.076678 16477 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.077328 16472 ts_tablet_manager.cc:1403] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.011s
I20260709 12:16:45.078694 16481 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.079322 16481 ts_tablet_manager.cc:1403] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.103s	user 0.026s	sys 0.046s
I20260709 12:16:45.080941 16472 raft_consensus.cc:359] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.081845 16472 raft_consensus.cc:385] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.082203 16472 raft_consensus.cc:740] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.082963 16481 raft_consensus.cc:359] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.083165 16472 consensus_queue.cc:260] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.083958 16481 raft_consensus.cc:385] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.084373 16481 raft_consensus.cc:740] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.085415 16477 tablet_bootstrap.cc:654] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.085415 16481 consensus_queue.cc:260] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.088507 16481 ts_tablet_manager.cc:1434] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:45.089897 16481 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.096405 16428 raft_consensus.cc:2468] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:45.097826 16171 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.098860 16477 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.099299 16523 raft_consensus.cc:2804] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.099411 16481 tablet_bootstrap.cc:654] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.099495 16477 ts_tablet_manager.cc:1403] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:16:45.099995 16523 raft_consensus.cc:697] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:45.100945 16523 consensus_queue.cc:237] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.103157 16477 raft_consensus.cc:359] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.104295 16477 raft_consensus.cc:385] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.104697 16477 raft_consensus.cc:740] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.105613 16477 consensus_queue.cc:260] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.109124 16477 ts_tablet_manager.cc:1434] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:16:45.109678 16472 ts_tablet_manager.cc:1434] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:16:45.110556 16477 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.113994 16481 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.114576 16481 ts_tablet_manager.cc:1403] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 12:16:45.115087 16533 raft_consensus.cc:493] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.115748 16533 raft_consensus.cc:515] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.118455 16533 leader_election.cc:290] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.118728 16481 raft_consensus.cc:359] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.119196 16517 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.119612 16481 raft_consensus.cc:385] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.120028 16481 raft_consensus.cc:740] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.119791 16517 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.120666 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.120896 16481 consensus_queue.cc:260] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.121335 16205 raft_consensus.cc:2468] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:45.124305 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.125048 16354 raft_consensus.cc:2468] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:45.125382 16481 ts_tablet_manager.cc:1434] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:16:45.124364 16517 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:45.126627 16481 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.126989 16477 tablet_bootstrap.cc:654] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.130781 16244 leader_election.cc:304] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.135085 16481 tablet_bootstrap.cc:654] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.130914 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:45.138181 16169 leader_election.cc:343] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.138967 16533 raft_consensus.cc:2804] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.139536 16533 raft_consensus.cc:493] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.139935 16533 raft_consensus.cc:3060] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:45.131870 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:45.146771 16533 raft_consensus.cc:515] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.125063 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.147552 16473 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:45.149071 16473 ts_tablet_manager.cc:1403] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.014s
W20260709 12:16:45.149559 16171 leader_election.cc:343] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.149768 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:45.150056 16171 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.150368 16205 raft_consensus.cc:3060] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.151293 16517 raft_consensus.cc:2749] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.148304 16472 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:45.153066 16473 raft_consensus.cc:359] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.154081 16473 raft_consensus.cc:385] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.154458 16473 raft_consensus.cc:740] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.158681 16205 raft_consensus.cc:2468] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:45.160035 16472 tablet_bootstrap.cc:654] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.161113 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ed9c1ffe244289120a4bac0d23ca6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.161803 16354 raft_consensus.cc:3060] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.167706 16477 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.168267 16477 ts_tablet_manager.cc:1403] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.015s
I20260709 12:16:45.163618 16473 consensus_queue.cc:260] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.169087 16472 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:45.169639 16472 ts_tablet_manager.cc:1403] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:16:45.168785 16103 catalog_manager.cc:5697] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.170782 16473 ts_tablet_manager.cc:1434] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:16:45.168808 16481 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.171186 16477 raft_consensus.cc:359] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.171983 16477 raft_consensus.cc:385] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.172266 16477 raft_consensus.cc:740] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.173079 16473 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:45.172941 16477 consensus_queue.cc:260] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.174970 16477 ts_tablet_manager.cc:1434] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:16:45.172000 16533 leader_election.cc:290] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.175572 16482 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.171687 16481 ts_tablet_manager.cc:1403] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.016s
I20260709 12:16:45.176079 16482 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.179791 16481 raft_consensus.cc:359] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.180240 16244 leader_election.cc:304] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.180881 16481 raft_consensus.cc:385] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.181380 16481 raft_consensus.cc:740] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.182762 16477 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.185825 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.186667 16473 tablet_bootstrap.cc:654] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.186600 16205 raft_consensus.cc:2468] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:45.187887 16482 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:45.188683 16481 consensus_queue.cc:260] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.190968 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:45.191707 16481 ts_tablet_manager.cc:1434] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:16:45.191401 16472 raft_consensus.cc:359] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.192353 16472 raft_consensus.cc:385] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:45.192526 16392 leader_election.cc:343] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.192736 16472 raft_consensus.cc:740] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.193172 16481 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.194052 16392 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.193759 16472 consensus_queue.cc:260] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.195197 16478 raft_consensus.cc:2804] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.195708 16478 raft_consensus.cc:697] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:45.196527 16478 consensus_queue.cc:237] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.198101 16477 tablet_bootstrap.cc:654] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:45.205327 16169 consensus_peers.cc:597] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.205910 16482 raft_consensus.cc:2804] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.206423 16482 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.206799 16482 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.208365 16472 ts_tablet_manager.cc:1434] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:16:45.209973 16481 tablet_bootstrap.cc:654] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.211278 16499 raft_consensus.cc:493] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.211760 16499 raft_consensus.cc:515] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.213907 16499 leader_election.cc:290] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.215469 16472 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:45.215790 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb645de5083941e0a7dd5d4e4cf1a798" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.216064 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb645de5083941e0a7dd5d4e4cf1a798" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.216570 16205 raft_consensus.cc:2468] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:45.216998 16353 raft_consensus.cc:2468] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:45.218091 16244 leader_election.cc:304] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.218969 16499 raft_consensus.cc:2804] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.219621 16499 raft_consensus.cc:493] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.219992 16499 raft_consensus.cc:3060] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.231856 16482 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.234817 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:45.235553 16205 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.234877 16499 raft_consensus.cc:515] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.227141 16354 raft_consensus.cc:2468] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:45.242837 16499 leader_election.cc:290] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.244308 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb645de5083941e0a7dd5d4e4cf1a798" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:45.245029 16204 raft_consensus.cc:3060] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.252382 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb645de5083941e0a7dd5d4e4cf1a798" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.253098 16353 raft_consensus.cc:3060] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.252754 16102 catalog_manager.cc:5697] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.258813 16477 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.259567 16477 ts_tablet_manager.cc:1403] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.014s
I20260709 12:16:45.261484 16353 raft_consensus.cc:2468] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:45.263018 16244 leader_election.cc:304] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.263896 16478 raft_consensus.cc:2804] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.264484 16478 raft_consensus.cc:697] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:45.264112 16477 raft_consensus.cc:359] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.265416 16477 raft_consensus.cc:385] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.265892 16477 raft_consensus.cc:740] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.265527 16478 consensus_queue.cc:237] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.267071 16477 consensus_queue.cc:260] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.267995 16205 raft_consensus.cc:2468] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:45.269436 16392 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:45.270473 16522 raft_consensus.cc:2804] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.265491 16204 raft_consensus.cc:2468] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:45.276479 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:45.277998 16392 leader_election.cc:343] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.279881 16482 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:45.284349 16473 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:45.284917 16473 ts_tablet_manager.cc:1403] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.112s	user 0.045s	sys 0.057s
I20260709 12:16:45.285058 16481 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.285755 16481 ts_tablet_manager.cc:1403] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.020s
I20260709 12:16:45.284385 16477 ts_tablet_manager.cc:1434] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:16:45.286188 16472 tablet_bootstrap.cc:654] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.286847 16477 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.287864 16473 raft_consensus.cc:359] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.288537 16473 raft_consensus.cc:385] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.288810 16473 raft_consensus.cc:740] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.289721 16473 consensus_queue.cc:260] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.292038 16473 ts_tablet_manager.cc:1434] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:45.292429 16522 raft_consensus.cc:697] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:45.292938 16473 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:45.293359 16522 consensus_queue.cc:237] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.294960 16103 catalog_manager.cc:5697] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.295854 16517 raft_consensus.cc:493] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.296368 16517 raft_consensus.cc:515] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.298640 16517 leader_election.cc:290] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.299017 16477 tablet_bootstrap.cc:654] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.299384 16473 tablet_bootstrap.cc:654] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.300261 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.300328 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.292776 16481 raft_consensus.cc:359] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.301395 16481 raft_consensus.cc:385] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.301734 16481 raft_consensus.cc:740] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
W20260709 12:16:45.302004 16171 leader_election.cc:343] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.306046 16481 consensus_queue.cc:260] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.307058 16353 raft_consensus.cc:2468] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:45.310760 16169 leader_election.cc:304] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.312088 16517 raft_consensus.cc:2804] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.312494 16517 raft_consensus.cc:493] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.312840 16517 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.315564 16477 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.316128 16477 ts_tablet_manager.cc:1403] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:16:45.317253 16523 raft_consensus.cc:493] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.317772 16523 raft_consensus.cc:515] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.317368 16100 catalog_manager.cc:5697] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.319959 16523 leader_election.cc:290] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.319675 16477 raft_consensus.cc:359] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.320452 16477 raft_consensus.cc:385] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.320747 16477 raft_consensus.cc:740] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.321528 16477 consensus_queue.cc:260] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.322891 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:45.323247 16528 raft_consensus.cc:493] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.323925 16477 ts_tablet_manager.cc:1434] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:45.323966 16528 raft_consensus.cc:515] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.324954 16477 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.331431 16477 tablet_bootstrap.cc:654] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:45.331599 16169 leader_election.cc:343] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.333891 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.334619 16528 leader_election.cc:290] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:45.335413 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:45.338791 16320 leader_election.cc:343] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:45.336033 16169 leader_election.cc:343] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.340713 16169 leader_election.cc:304] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.341883 16523 raft_consensus.cc:2749] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.359524 16523 consensus_queue.cc:1048] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.367084 16481 ts_tablet_manager.cc:1434] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:16:45.368369 16481 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.383250 16534 consensus_queue.cc:1048] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.384639 16517 raft_consensus.cc:515] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.387647 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.388289 16354 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.395807 16562 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.396409 16562 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.398440 16562 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.408828 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:45.409057 16427 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.409868 16280 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:45.413007 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.413933 16352 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:45.415993 16562 raft_consensus.cc:493] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.416164 16169 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:45.416580 16562 raft_consensus.cc:515] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.418833 16562 leader_election.cc:290] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.421926 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.416971 16523 raft_consensus.cc:2804] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.422838 16523 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.423250 16523 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:45.423502 16169 leader_election.cc:343] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.424325 16354 raft_consensus.cc:2468] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:45.424495 16522 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.425221 16522 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.425765 16517 leader_election.cc:290] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.426544 16169 leader_election.cc:304] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:45.430948 16523 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.431631 16517 raft_consensus.cc:2804] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.432165 16517 raft_consensus.cc:697] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:45.433436 16523 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.434633 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:45.435487 16280 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:45.438809 16318 consensus_peers.cc:597] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.441222 16499 raft_consensus.cc:493] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.441779 16499 raft_consensus.cc:515] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.444733 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.445396 16204 raft_consensus.cc:2468] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:45.446503 16280 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:45.446619 16244 leader_election.cc:304] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.447778 16533 raft_consensus.cc:2804] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.448176 16533 raft_consensus.cc:493] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.448516 16533 raft_consensus.cc:3060] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.449307 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.450139 16354 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.456717 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.458964 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.460424 16522 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.460644 16523 consensus_queue.cc:1048] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:45.458967 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:45.462636 16499 leader_election.cc:290] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.464119 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:45.466044 16244 leader_election.cc:343] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.466048 16533 raft_consensus.cc:515] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.471098 16481 tablet_bootstrap.cc:654] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.472278 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.484431 16472 tablet_bootstrap.cc:492] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:45.488675 16472 ts_tablet_manager.cc:1403] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.274s	user 0.010s	sys 0.004s
I20260709 12:16:45.492435 16472 raft_consensus.cc:359] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:45.486886 16171 leader_election.cc:343] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.496089 16533 leader_election.cc:290] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.498719 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:45.499701 16472 raft_consensus.cc:385] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.501916 16472 raft_consensus.cc:740] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.503954 16472 consensus_queue.cc:260] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.505698 16169 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:45.506884 16523 raft_consensus.cc:2804] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.507586 16523 raft_consensus.cc:697] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:45.507508 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.508809 16392 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:45.508672 16523 consensus_queue.cc:237] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.510082 16204 raft_consensus.cc:3060] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.511833 16472 ts_tablet_manager.cc:1434] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:16:45.514581 16472 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:45.518321 16244 leader_election.cc:343] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.520835 16473 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:45.521553 16473 ts_tablet_manager.cc:1403] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.229s	user 0.066s	sys 0.082s
I20260709 12:16:45.433018 16517 consensus_queue.cc:237] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.531535 16473 raft_consensus.cc:359] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.532341 16473 raft_consensus.cc:385] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.532685 16473 raft_consensus.cc:740] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.533438 16473 consensus_queue.cc:260] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.504989 16171 leader_election.cc:304] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.541522 16522 raft_consensus.cc:2749] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:45.541952 16562 raft_consensus.cc:2749] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.543988 16473 ts_tablet_manager.cc:1434] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
W20260709 12:16:45.542924 16171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 56088.2us
I20260709 12:16:45.545154 16473 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
W20260709 12:16:45.545542 16171 leader_election.cc:343] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.561601 16477 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.562222 16477 ts_tablet_manager.cc:1403] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.237s	user 0.049s	sys 0.106s
I20260709 12:16:45.544565 16354 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:45.569247 16481 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.569931 16481 ts_tablet_manager.cc:1403] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.202s	user 0.025s	sys 0.043s
I20260709 12:16:45.573825 16481 raft_consensus.cc:359] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.574764 16481 raft_consensus.cc:385] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.575462 16562 consensus_queue.cc:1048] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:45.576622 16477 raft_consensus.cc:359] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.577296 16477 raft_consensus.cc:385] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.577579 16477 raft_consensus.cc:740] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.578222 16477 consensus_queue.cc:260] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.582911 16477 ts_tablet_manager.cc:1434] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:16:45.585757 16477 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.585582 16522 raft_consensus.cc:493] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.587357 16562 consensus_queue.cc:1048] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.538952 16204 raft_consensus.cc:2468] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:45.588596 16522 raft_consensus.cc:515] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.589895 16244 leader_election.cc:304] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:45.591216 16478 raft_consensus.cc:2804] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.591384 16522 leader_election.cc:290] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.591831 16478 raft_consensus.cc:697] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:45.593046 16478 consensus_queue.cc:237] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.575075 16481 raft_consensus.cc:740] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.587646 16472 tablet_bootstrap.cc:654] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.587199 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.594143 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:45.594803 16481 consensus_queue.cc:260] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:45.595194 16318 leader_election.cc:343] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.597273 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:45.599000 16392 leader_election.cc:343] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.607009 16481 ts_tablet_manager.cc:1434] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:16:45.608250 16481 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.608321 16354 raft_consensus.cc:2468] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:45.601989 16533 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.609510 16533 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.603575 16318 leader_election.cc:304] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.616163 16477 tablet_bootstrap.cc:654] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.619690 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.625929 16575 consensus_queue.cc:1048] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.613147 16528 raft_consensus.cc:2749] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.630177 16566 consensus_queue.cc:1048] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:16:45.631560 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.619982 16533 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.634001 16392 leader_election.cc:304] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.642436 16522 raft_consensus.cc:2804] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.642926 16522 raft_consensus.cc:493] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.643328 16522 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.656243 16244 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.655777 16102 catalog_manager.cc:5697] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.656157 16100 catalog_manager.cc:5697] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:45.655807 16169 consensus_peers.cc:597] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.666843 16280 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.667289 16481 tablet_bootstrap.cc:654] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.673695 16204 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.674649 16473 tablet_bootstrap.cc:654] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.680884 16555 raft_consensus.cc:493] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.681445 16555 raft_consensus.cc:515] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.683207 16477 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.683705 16555 leader_election.cc:290] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:45.684803 16499 consensus_queue.cc:1048] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.690331 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.691136 16353 raft_consensus.cc:2468] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:45.691591 16522 raft_consensus.cc:515] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:45.692385 16392 consensus_peers.cc:597] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.692807 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.693167 16392 leader_election.cc:304] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:45.693972 16522 leader_election.cc:290] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:45.694731 16522 raft_consensus.cc:2804] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:45.695924 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:45.683861 16477 ts_tablet_manager.cc:1403] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.003s
I20260709 12:16:45.698809 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.699539 16522 raft_consensus.cc:493] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.703842 16353 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.712940 16579 consensus_queue.cc:1048] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.713506 16472 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:45.716329 16472 ts_tablet_manager.cc:1403] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.017s
I20260709 12:16:45.715225 16477 raft_consensus.cc:359] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.717231 16477 raft_consensus.cc:385] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.717741 16477 raft_consensus.cc:740] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
W20260709 12:16:45.700858 16392 leader_election.cc:343] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.721342 16499 raft_consensus.cc:493] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.724617 16472 raft_consensus.cc:359] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.726069 16472 raft_consensus.cc:385] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.719607 16522 raft_consensus.cc:3060] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.726387 16472 raft_consensus.cc:740] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.727759 16499 raft_consensus.cc:515] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:45.732863 16392 leader_election.cc:343] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.737372 16477 consensus_queue.cc:260] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.742707 16472 consensus_queue.cc:260] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.745720 16481 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.746640 16481 ts_tablet_manager.cc:1403] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.007s
I20260709 12:16:45.753568 16481 raft_consensus.cc:359] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.754352 16481 raft_consensus.cc:385] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.754637 16499 leader_election.cc:290] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.757982 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.754655 16481 raft_consensus.cc:740] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.769097 16481 consensus_queue.cc:260] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.769665 16523 raft_consensus.cc:493] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.771488 16523 raft_consensus.cc:515] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.772096 16481 ts_tablet_manager.cc:1434] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:16:45.772719 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf91fbb29104b44a4abee852fbe043e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.773205 16481 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.775588 16244 leader_election.cc:304] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.778151 16566 raft_consensus.cc:2749] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.780408 16481 tablet_bootstrap.cc:654] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.786249 16477 ts_tablet_manager.cc:1434] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.002s
I20260709 12:16:45.786684 16579 consensus_queue.cc:1048] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:45.789939 16477 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.784917 16523 leader_election.cc:290] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:45.796532 16473 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:45.797222 16473 ts_tablet_manager.cc:1403] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.002s
I20260709 12:16:45.802501 16472 ts_tablet_manager.cc:1434] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 12:16:45.803965 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:45.805936 16171 leader_election.cc:343] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.794322 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:45.814682 16472 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:45.823434 16169 leader_election.cc:343] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.824064 16169 leader_election.cc:304] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.816501 16579 consensus_queue.cc:1048] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:45.826462 16523 raft_consensus.cc:2749] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.830536 16522 raft_consensus.cc:515] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.830191 16100 catalog_manager.cc:5697] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.833767 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:45.834414 16352 raft_consensus.cc:3060] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.834784 16477 tablet_bootstrap.cc:654] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.837153 16353 raft_consensus.cc:2468] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:45.838326 16473 raft_consensus.cc:359] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.839035 16473 raft_consensus.cc:385] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.839320 16473 raft_consensus.cc:740] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.840013 16473 consensus_queue.cc:260] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.841579 16392 leader_election.cc:304] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:45.842957 16555 raft_consensus.cc:2804] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.845695 16279 raft_consensus.cc:3060] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:45.850301 16352 raft_consensus.cc:2468] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:45.854764 16473 ts_tablet_manager.cc:1434] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:16:45.857687 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
W20260709 12:16:45.861579 16392 leader_election.cc:343] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:45.862509 16481 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.863019 16481 ts_tablet_manager.cc:1403] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.013s
I20260709 12:16:45.862901 16392 leader_election.cc:304] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:45.864437 16473 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:45.869081 16472 tablet_bootstrap.cc:654] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.870209 16477 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:45.870710 16477 ts_tablet_manager.cc:1403] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.003s
I20260709 12:16:45.871534 16478 raft_consensus.cc:2749] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.858794 16522 leader_election.cc:290] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:45.873023 16522 raft_consensus.cc:2804] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:45.873461 16522 raft_consensus.cc:697] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:45.873693 16481 raft_consensus.cc:359] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.874408 16481 raft_consensus.cc:385] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.874709 16481 raft_consensus.cc:740] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.874293 16522 consensus_queue.cc:237] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.863901 16555 raft_consensus.cc:697] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:45.875409 16481 consensus_queue.cc:260] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.876129 16555 consensus_queue.cc:237] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.877562 16481 ts_tablet_manager.cc:1434] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:45.878474 16481 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:45.885842 16473 tablet_bootstrap.cc:654] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.888435 16477 raft_consensus.cc:359] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.889369 16477 raft_consensus.cc:385] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.889695 16477 raft_consensus.cc:740] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.890452 16477 consensus_queue.cc:260] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.892789 16481 tablet_bootstrap.cc:654] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.892853 16477 ts_tablet_manager.cc:1434] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:16:45.894603 16477 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:45.925087 16472 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:45.925633 16472 ts_tablet_manager.cc:1403] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.002s
I20260709 12:16:45.930588 16472 raft_consensus.cc:359] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.932261 16523 consensus_queue.cc:1048] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:45.936654 16472 raft_consensus.cc:385] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.937094 16472 raft_consensus.cc:740] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.937897 16472 consensus_queue.cc:260] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.941347 16102 catalog_manager.cc:5697] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.942764 16102 catalog_manager.cc:5697] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.943781 16575 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.944312 16575 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:45.944758 16472 ts_tablet_manager.cc:1434] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:16:45.945765 16472 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:45.947248 16594 consensus_queue.cc:1048] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:45.948457 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:45.960199 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:45.961905 16244 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:45.962792 16579 raft_consensus.cc:2749] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:45.955739 16528 raft_consensus.cc:493] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.968148 16528 raft_consensus.cc:515] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:45.969940 16528 leader_election.cc:290] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:45.984433 16473 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:45.984460 16481 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:45.985391 16473 ts_tablet_manager.cc:1403] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.019s
I20260709 12:16:45.985394 16481 ts_tablet_manager.cc:1403] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.002s
I20260709 12:16:45.956094 16575 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:45.989622 16473 raft_consensus.cc:359] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.990494 16473 raft_consensus.cc:385] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.990880 16473 raft_consensus.cc:740] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.991627 16473 consensus_queue.cc:260] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:45.992961 16477 tablet_bootstrap.cc:654] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:45.994036 16473 ts_tablet_manager.cc:1434] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:16:45.995398 16473 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:45.991025 16481 raft_consensus.cc:359] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:45.995849 16481 raft_consensus.cc:385] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:45.996140 16481 raft_consensus.cc:740] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:45.996806 16481 consensus_queue.cc:260] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.005235 16481 ts_tablet_manager.cc:1434] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:16:46.006068 16481 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.008845 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.009895 16572 consensus_queue.cc:1048] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.006784 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.011071 16203 raft_consensus.cc:2393] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7f2df769fee4fb7894cdbb752cab97e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:46.022116 16473 tablet_bootstrap.cc:654] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.022392 16472 tablet_bootstrap.cc:654] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.029217 16523 consensus_queue.cc:1048] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:46.025014 16481 tablet_bootstrap.cc:654] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.035187 16318 leader_election.cc:304] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.036844 16602 raft_consensus.cc:3060] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.040350 16528 raft_consensus.cc:493] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.041050 16528 raft_consensus.cc:515] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.044075 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.044761 16427 raft_consensus.cc:2468] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:46.048569 16320 leader_election.cc:304] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:46.048970 16427 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.053110 16528 leader_election.cc:290] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.053646 16528 raft_consensus.cc:2804] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.053985 16528 raft_consensus.cc:493] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.054328 16528 raft_consensus.cc:3060] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.070446 16481 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.072885 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.072537 16472 tablet_bootstrap.cc:492] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.073782 16203 raft_consensus.cc:2468] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:46.074165 16472 ts_tablet_manager.cc:1403] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.010s
I20260709 12:16:46.084643 16575 consensus_queue.cc:1048] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.073778 16481 ts_tablet_manager.cc:1403] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.003s
I20260709 12:16:46.090149 16473 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.090868 16473 ts_tablet_manager.cc:1403] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.002s
I20260709 12:16:46.090678 16481 raft_consensus.cc:359] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.091557 16481 raft_consensus.cc:385] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.091886 16481 raft_consensus.cc:740] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.087284 16472 raft_consensus.cc:359] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.084167 16477 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:46.083711 16602 raft_consensus.cc:2749] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.092715 16472 raft_consensus.cc:385] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.092948 16477 ts_tablet_manager.cc:1403] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.199s	user 0.008s	sys 0.008s
I20260709 12:16:46.093487 16481 consensus_queue.cc:260] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.097164 16472 raft_consensus.cc:740] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.074406 16528 raft_consensus.cc:515] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.095901 16473 raft_consensus.cc:359] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.098281 16473 raft_consensus.cc:385] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.098625 16473 raft_consensus.cc:740] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.099530 16481 ts_tablet_manager.cc:1434] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
W20260709 12:16:46.102123 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 53672.4us
I20260709 12:16:46.103170 16523 consensus_queue.cc:1048] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:46.103278 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:46.103453 16477 raft_consensus.cc:359] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.104053 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:46.104173 16205 raft_consensus.cc:3060] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.104736 16427 raft_consensus.cc:3060] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.104267 16477 raft_consensus.cc:385] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.101999 16473 consensus_queue.cc:260] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.106325 16477 raft_consensus.cc:740] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.109074 16473 ts_tablet_manager.cc:1434] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:46.109900 16473 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.109969 16481 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.110953 16472 consensus_queue.cc:260] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.110539 16528 leader_election.cc:290] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.118085 16477 consensus_queue.cc:260] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.121567 16523 raft_consensus.cc:493] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.122047 16523 raft_consensus.cc:515] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.123153 16205 raft_consensus.cc:2468] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:46.124554 16318 leader_election.cc:304] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:46.125530 16528 raft_consensus.cc:2804] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:46.127364 16477 ts_tablet_manager.cc:1434] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:16:46.127633 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.128439 16477 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:46.126804 16523 leader_election.cc:290] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.126171 16528 raft_consensus.cc:697] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:46.131382 16579 consensus_queue.cc:1048] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.131886 16528 consensus_queue.cc:237] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.134948 16472 ts_tablet_manager.cc:1434] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:16:46.136732 16472 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.139343 16477 tablet_bootstrap.cc:654] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.142855 16481 tablet_bootstrap.cc:654] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.137916 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520520ce482b48638578a08a887f961f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.149387 16427 raft_consensus.cc:2468] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:46.156316 16352 raft_consensus.cc:2393] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:46.161190 16472 tablet_bootstrap.cc:654] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.161398 16169 leader_election.cc:304] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:46.162722 16523 raft_consensus.cc:3060] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.166749 16572 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.167339 16572 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.169930 16572 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.174396 16473 tablet_bootstrap.cc:654] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.173581 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.175663 16426 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:46.176947 16171 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:46.177493 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.177968 16572 raft_consensus.cc:2804] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.178395 16572 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.178781 16572 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:46.179306 16169 leader_election.cc:343] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.181453 16103 catalog_manager.cc:5697] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.188462 16572 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.192323 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:46.192986 16426 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.196131 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
W20260709 12:16:46.197889 16169 leader_election.cc:343] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.201807 16426 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:46.203194 16171 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:46.204295 16517 raft_consensus.cc:2804] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:46.204977 16517 raft_consensus.cc:697] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:46.206091 16517 consensus_queue.cc:237] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.210278 16523 raft_consensus.cc:2749] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.213531 16481 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.214087 16481 ts_tablet_manager.cc:1403] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.017s
I20260709 12:16:46.215833 16572 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.216845 16481 raft_consensus.cc:359] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.218075 16473 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.218483 16481 raft_consensus.cc:385] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.218730 16473 ts_tablet_manager.cc:1403] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 12:16:46.218811 16481 raft_consensus.cc:740] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.219964 16472 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.219748 16481 consensus_queue.cc:260] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.220443 16472 ts_tablet_manager.cc:1403] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.010s
I20260709 12:16:46.222412 16481 ts_tablet_manager.cc:1434] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:46.222200 16473 raft_consensus.cc:359] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.222922 16473 raft_consensus.cc:385] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.223191 16473 raft_consensus.cc:740] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.223862 16481 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.224485 16473 consensus_queue.cc:260] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.226603 16473 ts_tablet_manager.cc:1434] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:46.227363 16280 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.228098 16473 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.228761 16477 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:46.229292 16477 ts_tablet_manager.cc:1403] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.000s
I20260709 12:16:46.230893 16481 tablet_bootstrap.cc:654] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:46.233392 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:46.237280 16473 tablet_bootstrap.cc:654] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.240653 16477 raft_consensus.cc:359] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.241412 16477 raft_consensus.cc:385] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.241696 16477 raft_consensus.cc:740] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.247327 16477 consensus_queue.cc:260] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.252599 16472 raft_consensus.cc:359] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.253347 16472 raft_consensus.cc:385] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.253623 16472 raft_consensus.cc:740] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.253974 16477 ts_tablet_manager.cc:1434] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:16:46.255017 16477 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:46.256624 16478 raft_consensus.cc:493] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.257172 16478 raft_consensus.cc:515] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.260411 16478 leader_election.cc:290] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.261991 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.262140 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.263118 16352 raft_consensus.cc:2393] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:46.264547 16609 raft_consensus.cc:493] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.264569 16246 leader_election.cc:304] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:46.265318 16609 raft_consensus.cc:515] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.265888 16478 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.268057 16609 leader_election.cc:290] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.269549 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.269726 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:46.271214 16320 leader_election.cc:343] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:46.272078 16318 leader_election.cc:343] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.272545 16318 leader_election.cc:304] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.273690 16609 raft_consensus.cc:2749] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.275771 16472 consensus_queue.cc:260] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.277940 16472 ts_tablet_manager.cc:1434] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.002s
I20260709 12:16:46.278815 16472 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.280390 16473 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.281076 16609 raft_consensus.cc:493] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.285157 16473 ts_tablet_manager.cc:1403] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.011s
I20260709 12:16:46.284795 16609 raft_consensus.cc:515] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.288139 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.284050 16481 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.289093 16481 ts_tablet_manager.cc:1403] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.028s
I20260709 12:16:46.290228 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.284319 16477 tablet_bootstrap.cc:654] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:46.291452 16318 leader_election.cc:343] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.292361 16481 raft_consensus.cc:359] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.293175 16481 raft_consensus.cc:385] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.292599 16103 catalog_manager.cc:5697] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.293488 16481 raft_consensus.cc:740] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.294322 16481 consensus_queue.cc:260] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.288388 16609 leader_election.cc:290] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.288969 16203 raft_consensus.cc:2468] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:46.283483 16478 raft_consensus.cc:2749] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.296427 16318 leader_election.cc:304] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.297533 16481 ts_tablet_manager.cc:1434] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:46.297724 16609 raft_consensus.cc:2804] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.298089 16609 raft_consensus.cc:493] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.298444 16609 raft_consensus.cc:3060] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.298916 16481 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.300518 16472 tablet_bootstrap.cc:654] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.307510 16481 tablet_bootstrap.cc:654] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.311403 16609 raft_consensus.cc:515] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.313813 16609 leader_election.cc:290] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.315189 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:46.316699 16318 leader_election.cc:343] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.317487 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:46.318053 16203 raft_consensus.cc:3060] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.326591 16203 raft_consensus.cc:2468] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:46.315022 16473 raft_consensus.cc:359] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.327261 16473 raft_consensus.cc:385] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.327679 16473 raft_consensus.cc:740] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.327852 16318 leader_election.cc:304] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.328413 16473 consensus_queue.cc:260] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.328747 16609 raft_consensus.cc:2804] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:46.329355 16609 raft_consensus.cc:697] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:46.330257 16609 consensus_queue.cc:237] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.331137 16473 ts_tablet_manager.cc:1434] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:16:46.333485 16473 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.339515 16473 tablet_bootstrap.cc:654] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.342062 16478 raft_consensus.cc:493] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.342819 16478 raft_consensus.cc:515] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.348454 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.348845 16478 leader_election.cc:290] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.349074 16593 raft_consensus.cc:493] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.349999 16593 raft_consensus.cc:515] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.352285 16473 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.352989 16473 ts_tablet_manager.cc:1403] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.013s
I20260709 12:16:46.353319 16555 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.353911 16555 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.356089 16472 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.357395 16472 ts_tablet_manager.cc:1403] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.002s
I20260709 12:16:46.358026 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.356446 16473 raft_consensus.cc:359] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.359262 16473 raft_consensus.cc:385] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.359565 16473 raft_consensus.cc:740] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.360239 16473 consensus_queue.cc:260] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.360937 16481 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.361548 16481 ts_tablet_manager.cc:1403] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.004s
I20260709 12:16:46.362354 16473 ts_tablet_manager.cc:1434] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:46.364705 16481 raft_consensus.cc:359] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.365597 16481 raft_consensus.cc:385] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.365581 16472 raft_consensus.cc:359] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.366395 16481 raft_consensus.cc:740] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.356698 16477 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:46.366477 16472 raft_consensus.cc:385] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.363389 16473 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.368218 16481 consensus_queue.cc:260] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.370684 16481 ts_tablet_manager.cc:1434] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:46.371627 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.371824 16481 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.372310 16203 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:46.373324 16572 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.373792 16572 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.374897 16473 tablet_bootstrap.cc:654] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.375967 16572 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.376279 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.379817 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.380077 16481 tablet_bootstrap.cc:654] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.380252 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.380846 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.381513 16426 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
W20260709 12:16:46.382102 16246 leader_election.cc:343] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:46.382184 16169 leader_election.cc:343] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.349159 16352 raft_consensus.cc:2468] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:46.367406 16477 ts_tablet_manager.cc:1403] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.010s
I20260709 12:16:46.368136 16472 raft_consensus.cc:740] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.365824 16102 catalog_manager.cc:5697] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.384410 16171 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.384203 16472 consensus_queue.cc:260] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.356380 16555 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.386070 16244 leader_election.cc:304] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:46.386441 16472 ts_tablet_manager.cc:1434] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 12:16:46.386632 16593 leader_election.cc:290] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.387106 16477 raft_consensus.cc:359] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.387573 16472 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.387879 16477 raft_consensus.cc:385] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.388377 16477 raft_consensus.cc:740] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.389159 16477 consensus_queue.cc:260] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.387657 16478 raft_consensus.cc:2804] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.391276 16478 raft_consensus.cc:493] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.391700 16478 raft_consensus.cc:3060] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.394080 16472 tablet_bootstrap.cc:654] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.396277 16517 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.396842 16517 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.396924 16477 ts_tablet_manager.cc:1434] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:16:46.397377 16517 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.402408 16478 raft_consensus.cc:515] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.405534 16472 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.429154 16472 ts_tablet_manager.cc:1403] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.023s
I20260709 12:16:46.430052 16478 leader_election.cc:290] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.421490 16481 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.407442 16609 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.431293 16609 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.433314 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:46.433688 16609 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.414909 16477 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:46.434798 16246 leader_election.cc:343] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.435045 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:46.437028 16318 leader_election.cc:343] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.409273 16392 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:46.413278 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.438285 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.438926 16203 raft_consensus.cc:2468] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
W20260709 12:16:46.439770 16318 leader_election.cc:343] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.440261 16318 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.440593 16477 tablet_bootstrap.cc:654] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.440865 16593 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.441283 16593 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.441639 16593 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.442386 16609 raft_consensus.cc:2749] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.438290 16517 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.443828 16481 ts_tablet_manager.cc:1403] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.003s
I20260709 12:16:46.446287 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:46.447021 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:46.447032 16481 raft_consensus.cc:359] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:46.448496 16169 leader_election.cc:343] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.449043 16481 raft_consensus.cc:385] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.449379 16481 raft_consensus.cc:740] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.450042 16481 consensus_queue.cc:260] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.452128 16481 ts_tablet_manager.cc:1434] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
W20260709 12:16:46.452732 16392 leader_election.cc:343] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.453033 16481 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
W20260709 12:16:46.454787 16392 leader_election.cc:343] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.455708 16555 consensus_queue.cc:1048] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.458902 16392 leader_election.cc:304] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:46.462383 16555 raft_consensus.cc:2804] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.462769 16555 raft_consensus.cc:493] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.463140 16555 raft_consensus.cc:3060] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.462910 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:46.464097 16353 raft_consensus.cc:3060] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.470609 16472 raft_consensus.cc:359] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.471493 16472 raft_consensus.cc:385] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.471808 16472 raft_consensus.cc:740] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.428071 16473 tablet_bootstrap.cc:492] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.473014 16473 ts_tablet_manager.cc:1403] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.110s	user 0.034s	sys 0.017s
I20260709 12:16:46.472548 16472 consensus_queue.cc:260] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.475406 16472 ts_tablet_manager.cc:1434] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:16:46.476372 16517 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.476614 16472 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.490373 16481 tablet_bootstrap.cc:654] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.476874 16353 raft_consensus.cc:2468] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:46.493750 16473 raft_consensus.cc:359] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.497815 16473 raft_consensus.cc:385] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.497711 16244 leader_election.cc:304] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:46.498235 16473 raft_consensus.cc:740] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.498602 16472 tablet_bootstrap.cc:654] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.499161 16575 raft_consensus.cc:2804] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:46.499001 16473 consensus_queue.cc:260] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.499873 16575 raft_consensus.cc:697] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:46.500725 16575 consensus_queue.cc:237] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.501305 16473 ts_tablet_manager.cc:1434] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:16:46.505972 16473 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.506408 16593 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:46.512059 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 53233.7us
I20260709 12:16:46.518318 16473 tablet_bootstrap.cc:654] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.525606 16555 raft_consensus.cc:515] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.527446 16522 raft_consensus.cc:493] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.528172 16522 raft_consensus.cc:515] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.530936 16522 leader_election.cc:290] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:46.534508 16473 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.535070 16473 ts_tablet_manager.cc:1403] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.006s
I20260709 12:16:46.535286 16426 raft_consensus.cc:2393] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:46.539155 16171 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.540382 16517 raft_consensus.cc:2749] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.541158 16472 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.541922 16472 ts_tablet_manager.cc:1403] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.015s
I20260709 12:16:46.542584 16609 consensus_queue.cc:1048] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.541862 16473 raft_consensus.cc:359] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.546761 16473 raft_consensus.cc:385] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.547093 16473 raft_consensus.cc:740] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.547753 16473 consensus_queue.cc:260] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.549876 16473 ts_tablet_manager.cc:1434] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:46.550832 16473 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.551383 16609 consensus_queue.cc:1048] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.546283 16472 raft_consensus.cc:359] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.563019 16472 raft_consensus.cc:385] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.563536 16472 raft_consensus.cc:740] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.565341 16472 consensus_queue.cc:260] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.566527 16473 tablet_bootstrap.cc:654] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.568404 16472 ts_tablet_manager.cc:1434] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:16:46.569720 16472 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.577075 16472 tablet_bootstrap.cc:654] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.578648 16473 tablet_bootstrap.cc:492] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.579314 16473 ts_tablet_manager.cc:1403] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 12:16:46.582176 16473 raft_consensus.cc:359] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.582868 16473 raft_consensus.cc:385] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.583178 16473 raft_consensus.cc:740] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.589619 16472 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:46.590255 16472 ts_tablet_manager.cc:1403] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:16:46.590153 16473 consensus_queue.cc:260] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.593343 16472 raft_consensus.cc:359] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.594141 16472 raft_consensus.cc:385] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.594457 16472 raft_consensus.cc:740] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.595335 16472 consensus_queue.cc:260] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.596366 16473 ts_tablet_manager.cc:1434] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 12:16:46.596793 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 64029.4us
I20260709 12:16:46.597363 16473 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.597769 16522 consensus_queue.cc:1048] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:46.598385 16472 ts_tablet_manager.cc:1434] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:16:46.599723 16472 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:46.602262 16593 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.604720 16522 consensus_queue.cc:1048] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:46.607993 16472 tablet_bootstrap.cc:654] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.613467 16473 tablet_bootstrap.cc:654] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.613636 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.613744 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.648201 16602 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.648859 16602 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.651582 16523 raft_consensus.cc:493] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.652103 16523 raft_consensus.cc:515] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.654042 16523 leader_election.cc:290] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:46.655856 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.660873 16593 raft_consensus.cc:493] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.661410 16593 raft_consensus.cc:515] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:46.659089 16171 leader_election.cc:343] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:46.665011 16169 consensus_peers.cc:597] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:46.665261 16602 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.666038 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.671288 16280 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.676143 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.678104 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
W20260709 12:16:46.685451 16320 leader_election.cc:343] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.687763 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:46.689380 16318 leader_election.cc:343] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.689843 16318 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:46.690825 16609 raft_consensus.cc:2749] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.690953 16555 leader_election.cc:290] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:46.695775 16169 leader_election.cc:343] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.696352 16169 leader_election.cc:304] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.697568 16517 raft_consensus.cc:2749] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:46.698510 16392 leader_election.cc:343] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.703068 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:46.703955 16202 raft_consensus.cc:3060] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.702224 16103 catalog_manager.cc:5697] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.679193 16205 raft_consensus.cc:2393] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:46.712282 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.712639 16523 consensus_queue.cc:1048] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:46.714766 16575 raft_consensus.cc:493] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.715441 16575 raft_consensus.cc:515] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.717255 16522 raft_consensus.cc:493] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.717742 16522 raft_consensus.cc:515] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.719871 16522 leader_election.cc:290] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:46.721252 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:46.723630 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:46.720403 16575 leader_election.cc:290] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.726974 16609 raft_consensus.cc:493] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.759651 16555 consensus_queue.cc:1048] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:46.749984 16593 leader_election.cc:290] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:46.751708 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.769510 16481 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:46.771116 16481 ts_tablet_manager.cc:1403] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.318s	user 0.044s	sys 0.026s
I20260709 12:16:46.752146 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.758929 16609 raft_consensus.cc:515] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:46.778978 16392 leader_election.cc:343] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.777424 16426 raft_consensus.cc:2468] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
W20260709 12:16:46.785245 16244 leader_election.cc:343] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.798897 16477 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:46.799445 16477 ts_tablet_manager.cc:1403] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.385s	user 0.078s	sys 0.102s
W20260709 12:16:46.794144 16392 leader_election.cc:343] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.806052 16533 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.810171 16473 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:46.810736 16473 ts_tablet_manager.cc:1403] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.214s	user 0.040s	sys 0.100s
I20260709 12:16:46.808760 16246 leader_election.cc:304] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:46.815267 16473 raft_consensus.cc:359] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.815981 16473 raft_consensus.cc:385] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.816190 16499 raft_consensus.cc:2804] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.816440 16473 raft_consensus.cc:740] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.816901 16499 raft_consensus.cc:493] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.817414 16499 raft_consensus.cc:3060] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.817305 16473 consensus_queue.cc:260] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.818461 16481 raft_consensus.cc:359] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.818996 16473 ts_tablet_manager.cc:1434] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:16:46.819150 16481 raft_consensus.cc:385] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.819458 16481 raft_consensus.cc:740] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.820026 16473 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:46.810721 16533 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.811323 16392 leader_election.cc:304] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.838267 16594 raft_consensus.cc:2749] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:46.838521 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 45722.5us
I20260709 12:16:46.840490 16478 raft_consensus.cc:493] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.841187 16478 raft_consensus.cc:515] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.845295 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.846201 16351 raft_consensus.cc:2468] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:46.854104 16477 raft_consensus.cc:359] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.851205 16481 consensus_queue.cc:260] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.855173 16477 raft_consensus.cc:385] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:46.855928 16477 raft_consensus.cc:740] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:46.856841 16477 consensus_queue.cc:260] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:46.864688 16594 raft_consensus.cc:493] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.865228 16594 raft_consensus.cc:515] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.866535 16478 leader_election.cc:290] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.863374 16202 raft_consensus.cc:2468] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:46.871672 16244 leader_election.cc:304] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
W20260709 12:16:46.873857 16318 consensus_peers.cc:597] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:46.875106 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.856173 16528 raft_consensus.cc:493] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.875845 16426 raft_consensus.cc:2468] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:46.875941 16528 raft_consensus.cc:515] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:46.873966 16533 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:46.877799 16609 leader_election.cc:290] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
W20260709 12:16:46.878746 16392 leader_election.cc:343] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.879552 16533 raft_consensus.cc:2804] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.882107 16533 raft_consensus.cc:493] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.882592 16533 raft_consensus.cc:3060] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.882711 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b9e49e49b4d469474bbc23cf32e6d" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.883628 16352 raft_consensus.cc:2393] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:46.884016 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.884665 16481 ts_tablet_manager.cc:1434] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 12:16:46.884681 16351 raft_consensus.cc:2468] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:46.885707 16481 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:46.884045 16594 leader_election.cc:290] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:46.881080 16392 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.887072 16477 ts_tablet_manager.cc:1434] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 12:16:46.888128 16477 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:46.898774 16594 raft_consensus.cc:2749] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:46.916965 16528 leader_election.cc:290] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:46.918711 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed67f1fe7bfc40cbaa81904b04e85bbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.935393 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.933495 16392 leader_election.cc:304] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:46.944679 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.951857 16593 raft_consensus.cc:2804] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:46.951802 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 92384.9us
I20260709 12:16:46.961728 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed67f1fe7bfc40cbaa81904b04e85bbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:46.949510 16318 leader_election.cc:343] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.957332 16593 raft_consensus.cc:697] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:46.958956 16426 raft_consensus.cc:2468] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:46.967744 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.968245 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.965287 16478 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:46.969038 16478 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.972030 16320 leader_election.cc:304] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:46.972270 16593 consensus_queue.cc:237] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:46.973543 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:46.964677 16277 raft_consensus.cc:2468] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:46.977174 16528 raft_consensus.cc:2804] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.977746 16528 raft_consensus.cc:493] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.978189 16528 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.978298 16478 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:46.964418 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:46.981292 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:46.985421 16481 tablet_bootstrap.cc:654] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:46.987419 16499 raft_consensus.cc:515] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:46.989463 16499 leader_election.cc:290] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:46.990403 16318 leader_election.cc:343] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:46.990628 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:46.991268 16426 raft_consensus.cc:3060] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.991508 16318 leader_election.cc:304] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:46.992331 16602 raft_consensus.cc:2804] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.992707 16602 raft_consensus.cc:493] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.993054 16602 raft_consensus.cc:3060] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.993597 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:46.994923 16392 leader_election.cc:304] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:46.995797 16594 raft_consensus.cc:3060] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:46.996177 16392 leader_election.cc:304] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:46.997206 16640 raft_consensus.cc:2804] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:46.997596 16640 raft_consensus.cc:493] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.997918 16640 raft_consensus.cc:3060] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.000078 16533 raft_consensus.cc:515] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.001257 16278 raft_consensus.cc:2393] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:47.003947 16594 raft_consensus.cc:2749] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.005569 16602 raft_consensus.cc:515] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.007356 16609 consensus_queue.cc:1048] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.008878 16472 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:47.009370 16472 ts_tablet_manager.cc:1403] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.410s	user 0.019s	sys 0.041s
W20260709 12:16:47.010174 16392 leader_election.cc:343] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.012383 16472 raft_consensus.cc:359] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.012920 16472 raft_consensus.cc:385] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.013087 16472 raft_consensus.cc:740] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.014612 16472 consensus_queue.cc:260] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.016819 16472 ts_tablet_manager.cc:1434] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:47.018141 16472 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:47.019381 16477 tablet_bootstrap.cc:654] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.023591 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed67f1fe7bfc40cbaa81904b04e85bbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:47.024019 16473 tablet_bootstrap.cc:654] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:47.037334 16318 leader_election.cc:343] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.043185 16602 leader_election.cc:290] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:47.037191 16640 raft_consensus.cc:515] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:47.046597 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 71681.4us
I20260709 12:16:47.062973 16533 leader_election.cc:290] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.058104 16528 raft_consensus.cc:515] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.064287 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:47.065105 16472 tablet_bootstrap.cc:654] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.058864 16426 raft_consensus.cc:2468] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:47.071400 16427 raft_consensus.cc:2393] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:47.075959 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed67f1fe7bfc40cbaa81904b04e85bbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:47.079449 16277 raft_consensus.cc:3060] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.089098 16351 raft_consensus.cc:2393] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:47.088361 16099 catalog_manager.cc:5697] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.098662 16477 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:47.099308 16477 ts_tablet_manager.cc:1403] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.211s	user 0.021s	sys 0.008s
I20260709 12:16:47.103183 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:47.106549 16246 leader_election.cc:304] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:47.110483 16575 raft_consensus.cc:2804] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.111092 16575 raft_consensus.cc:697] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:47.112040 16575 consensus_queue.cc:237] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.113276 16477 raft_consensus.cc:359] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.113610 16277 raft_consensus.cc:2468] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:47.114022 16477 raft_consensus.cc:385] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.115099 16477 raft_consensus.cc:740] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.118686 16318 leader_election.cc:304] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:47.120132 16609 raft_consensus.cc:2804] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.120849 16609 raft_consensus.cc:697] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:47.118721 16477 consensus_queue.cc:260] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.121845 16609 consensus_queue.cc:237] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.127542 16528 leader_election.cc:290] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.128386 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:47.129310 16427 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.121850 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:47.134624 16277 raft_consensus.cc:2393] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:47.141158 16533 raft_consensus.cc:493] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:47.141036 16656 log.cc:927] Time spent T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:16:47.141764 16533 raft_consensus.cc:515] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.148202 16477 ts_tablet_manager.cc:1434] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:16:47.149112 16477 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:47.150002 16481 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.150837 16481 ts_tablet_manager.cc:1403] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.265s	user 0.021s	sys 0.014s
I20260709 12:16:47.152943 16655 consensus_queue.cc:1048] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 12:16:47.153280 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:47.154949 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:47.155769 16426 raft_consensus.cc:2468] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:47.157243 16473 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:47.157896 16473 ts_tablet_manager.cc:1403] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.338s	user 0.026s	sys 0.030s
I20260709 12:16:47.144855 16640 leader_election.cc:290] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.161176 16246 leader_election.cc:304] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:47.148872 16533 leader_election.cc:290] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.162897 16575 raft_consensus.cc:2804] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.163417 16575 raft_consensus.cc:493] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.163802 16575 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.164024 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:47.167299 16477 tablet_bootstrap.cc:654] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.176841 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
W20260709 12:16:47.180029 16244 leader_election.cc:343] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.186792 16354 raft_consensus.cc:3060] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.192716 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bff55b8f07d462d9bdf2065695fa373" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
W20260709 12:16:47.172212 16318 leader_election.cc:343] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.182641 16473 raft_consensus.cc:359] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.216976 16473 raft_consensus.cc:385] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.199539 16392 leader_election.cc:304] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.206862 16100 catalog_manager.cc:5697] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.217358 16473 raft_consensus.cc:740] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.220914 16473 consensus_queue.cc:260] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.223819 16477 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:47.224480 16477 ts_tablet_manager.cc:1403] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.076s	user 0.035s	sys 0.026s
I20260709 12:16:47.223229 16473 ts_tablet_manager.cc:1434] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.003s
I20260709 12:16:47.229732 16473 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
W20260709 12:16:47.218387 16244 leader_election.cc:343] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.219808 16655 consensus_queue.cc:1048] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:47.236284 16472 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:47.236830 16472 ts_tablet_manager.cc:1403] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.024s
I20260709 12:16:47.239384 16477 raft_consensus.cc:359] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.244798 16477 raft_consensus.cc:385] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.245150 16477 raft_consensus.cc:740] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.239801 16392 leader_election.cc:304] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.248083 16477 consensus_queue.cc:260] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.249742 16522 raft_consensus.cc:2749] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.250168 16477 ts_tablet_manager.cc:1434] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:16:47.251173 16477 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:47.252065 16572 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.252583 16572 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.254838 16572 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.257416 16477 tablet_bootstrap.cc:654] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.257807 16481 raft_consensus.cc:359] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.258580 16481 raft_consensus.cc:385] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.258891 16481 raft_consensus.cc:740] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.239786 16472 raft_consensus.cc:359] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.260161 16472 raft_consensus.cc:385] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.247371 16473 tablet_bootstrap.cc:654] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.260598 16472 raft_consensus.cc:740] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.263008 16354 raft_consensus.cc:2468] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:47.263067 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:47.235592 16575 raft_consensus.cc:515] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.268191 16352 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:47.266050 16472 consensus_queue.cc:260] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.269521 16575 leader_election.cc:290] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.263533 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:47.269191 16103 catalog_manager.cc:5697] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.260218 16481 consensus_queue.cc:260] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.270788 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:47.271215 16169 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:47.272176 16426 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:47.272630 16169 leader_election.cc:343] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.273659 16572 raft_consensus.cc:2804] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.274091 16572 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.274449 16572 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.234184 16427 raft_consensus.cc:2468] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:47.281514 16523 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.291441 16523 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.293829 16523 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.289149 16481 ts_tablet_manager.cc:1434] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.001s
I20260709 12:16:47.296435 16555 raft_consensus.cc:2749] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.297047 16320 leader_election.cc:304] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.297605 16481 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.298599 16609 raft_consensus.cc:2804] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.299188 16609 raft_consensus.cc:697] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:47.300137 16609 consensus_queue.cc:237] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.300724 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:47.301648 16354 raft_consensus.cc:2468] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:47.232894 16244 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:47.303833 16655 raft_consensus.cc:2749] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:47.304862 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 86746.3us
I20260709 12:16:47.305727 16244 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.303881 16169 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:47.316888 16523 raft_consensus.cc:2804] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.317451 16523 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.317906 16523 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:47.318011 16244 leader_election.cc:343] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.307466 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:47.324043 16171 leader_election.cc:343] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.311803 16426 raft_consensus.cc:2468] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:47.313690 16655 raft_consensus.cc:2749] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:47.320353 16572 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.328423 16472 ts_tablet_manager.cc:1434] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.001s
I20260709 12:16:47.330953 16472 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:47.340485 16481 tablet_bootstrap.cc:654] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.342070 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:47.344131 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:47.352860 16477 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:47.353394 16477 ts_tablet_manager.cc:1403] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.029s
I20260709 12:16:47.353770 16523 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.354424 16472 tablet_bootstrap.cc:654] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.357080 16572 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.358937 16244 leader_election.cc:304] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.359568 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:47.359679 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:47.360605 16244 leader_election.cc:343] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:47.362416 16171 leader_election.cc:343] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.362700 16246 leader_election.cc:304] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:47.363773 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:47.364362 16352 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.364529 16533 raft_consensus.cc:2804] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.365096 16533 raft_consensus.cc:697] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:47.356422 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:47.366287 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:47.366035 16533 consensus_queue.cc:237] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.359735 16477 raft_consensus.cc:359] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.367074 16477 raft_consensus.cc:385] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:47.361258 16169 leader_election.cc:343] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.366530 16354 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.367698 16477 raft_consensus.cc:740] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.360884 16655 raft_consensus.cc:2804] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.369699 16655 raft_consensus.cc:697] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:47.370651 16655 consensus_queue.cc:237] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.376493 16352 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:47.376237 16477 consensus_queue.cc:260] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.377051 16517 raft_consensus.cc:493] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.377638 16517 raft_consensus.cc:515] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.378108 16354 raft_consensus.cc:2468] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:47.379320 16169 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.380611 16572 raft_consensus.cc:2804] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.381289 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:47.380633 16517 leader_election.cc:290] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:47.381677 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b31f6cc7b54ab1b202f40bc200510e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:47.382169 16426 raft_consensus.cc:2393] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:47.384269 16171 leader_election.cc:304] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.401202 16169 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.404282 16473 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:47.404987 16473 ts_tablet_manager.cc:1403] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.002s
I20260709 12:16:47.393968 16517 raft_consensus.cc:3060] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.408932 16473 raft_consensus.cc:359] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.410079 16473 raft_consensus.cc:385] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.410430 16473 raft_consensus.cc:740] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.386248 16523 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:47.412703 16100 catalog_manager.cc:5697] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.414086 16572 raft_consensus.cc:697] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:47.414798 16473 consensus_queue.cc:260] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.419845 16575 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.421639 16473 ts_tablet_manager.cc:1434] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:16:47.421557 16575 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.422678 16473 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:47.434114 16575 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:47.438486 16477 ts_tablet_manager.cc:1434] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.085s	user 0.025s	sys 0.018s
I20260709 12:16:47.441185 16477 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:47.442914 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:47.444166 16427 raft_consensus.cc:2393] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:47.447106 16517 raft_consensus.cc:2749] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.452948 16477 tablet_bootstrap.cc:654] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.440338 16523 raft_consensus.cc:2804] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:47.432322 16244 leader_election.cc:343] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.459108 16572 consensus_queue.cc:237] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.459215 16103 catalog_manager.cc:5697] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.461292 16523 raft_consensus.cc:697] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:47.463904 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:47.479122 16473 tablet_bootstrap.cc:654] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.480612 16472 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:47.481138 16472 ts_tablet_manager.cc:1403] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.150s	user 0.019s	sys 0.005s
I20260709 12:16:47.478572 16202 raft_consensus.cc:2393] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:47.484735 16481 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.485240 16481 ts_tablet_manager.cc:1403] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.188s	user 0.025s	sys 0.029s
I20260709 12:16:47.487972 16481 raft_consensus.cc:359] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.489041 16481 raft_consensus.cc:385] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.489326 16481 raft_consensus.cc:740] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.490062 16481 consensus_queue.cc:260] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.490484 16472 raft_consensus.cc:359] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.492103 16472 raft_consensus.cc:385] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.492710 16472 raft_consensus.cc:740] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.492916 16481 ts_tablet_manager.cc:1434] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:47.494483 16481 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.487210 16523 consensus_queue.cc:237] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.494334 16472 consensus_queue.cc:260] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.500802 16472 ts_tablet_manager.cc:1434] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:16:47.507964 16472 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:47.510445 16481 tablet_bootstrap.cc:654] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.508098 16103 catalog_manager.cc:5697] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.513805 16477 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:47.514364 16477 ts_tablet_manager.cc:1403] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 12:16:47.521875 16609 consensus_queue.cc:1048] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.524399 16477 raft_consensus.cc:359] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.525148 16477 raft_consensus.cc:385] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.525404 16477 raft_consensus.cc:740] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.526036 16477 consensus_queue.cc:260] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.517767 16244 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.527796 16499 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.535615 16477 ts_tablet_manager.cc:1434] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:16:47.537060 16477 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:47.541337 16472 tablet_bootstrap.cc:654] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.555804 16472 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:47.556303 16472 ts_tablet_manager.cc:1403] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.002s
I20260709 12:16:47.557085 16499 raft_consensus.cc:2749] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.559293 16472 raft_consensus.cc:359] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.560032 16472 raft_consensus.cc:385] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.560297 16472 raft_consensus.cc:740] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.560895 16472 consensus_queue.cc:260] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.563315 16472 ts_tablet_manager.cc:1434] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:47.564102 16202 raft_consensus.cc:3060] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.564262 16472 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:47.572254 16102 catalog_manager.cc:5697] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.577104 16477 tablet_bootstrap.cc:654] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:47.578397 16392 consensus_peers.cc:597] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:47.577701 16499 consensus_queue.cc:1048] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:47.578483 16602 consensus_queue.cc:1048] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:47.580184 16522 consensus_queue.cc:1048] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.584699 16602 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.585202 16602 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.585714 16472 tablet_bootstrap.cc:654] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.585951 16481 tablet_bootstrap.cc:492] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.586455 16481 ts_tablet_manager.cc:1403] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.007s
I20260709 12:16:47.588279 16602 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:47.589215 16481 raft_consensus.cc:359] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.589697 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:47.589923 16481 raft_consensus.cc:385] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.590217 16481 raft_consensus.cc:740] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.590366 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:47.590939 16481 consensus_queue.cc:260] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.592921 16481 ts_tablet_manager.cc:1434] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:47.593753 16481 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.593338 16318 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.595356 16610 raft_consensus.cc:2749] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.601969 16481 tablet_bootstrap.cc:654] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.574147 16102 catalog_manager.cc:5697] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.601969 16473 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:47.608594 16473 ts_tablet_manager.cc:1403] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.015s
I20260709 12:16:47.617405 16481 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.626196 16655 consensus_queue.cc:1048] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.638206 16473 raft_consensus.cc:359] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.642433 16473 raft_consensus.cc:385] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.639129 16481 ts_tablet_manager.cc:1403] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.011s
I20260709 12:16:47.645437 16481 raft_consensus.cc:359] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.646158 16481 raft_consensus.cc:385] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.646817 16481 raft_consensus.cc:740] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.647702 16481 consensus_queue.cc:260] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.646478 16473 raft_consensus.cc:740] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.649063 16473 consensus_queue.cc:260] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.652788 16481 ts_tablet_manager.cc:1434] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:47.653388 16473 ts_tablet_manager.cc:1434] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:16:47.654522 16473 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:47.660451 16473 tablet_bootstrap.cc:654] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.628685 16477 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:47.669024 16477 ts_tablet_manager.cc:1403] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.005s
I20260709 12:16:47.681731 16593 raft_consensus.cc:493] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.688470 16481 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.682461 16593 raft_consensus.cc:515] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.701152 16481 tablet_bootstrap.cc:654] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.701822 16593 leader_election.cc:290] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:47.704459 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:47.711215 16392 leader_election.cc:343] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.718964 16481 tablet_bootstrap.cc:492] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.719683 16481 ts_tablet_manager.cc:1403] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 12:16:47.741446 16481 raft_consensus.cc:359] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.742429 16481 raft_consensus.cc:385] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.742774 16481 raft_consensus.cc:740] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.718559 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:47.746981 16204 raft_consensus.cc:2468] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:47.748538 16481 consensus_queue.cc:260] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.748883 16392 leader_election.cc:304] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.750636 16593 raft_consensus.cc:2804] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.751169 16593 raft_consensus.cc:493] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.751663 16593 raft_consensus.cc:3060] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.754817 16610 consensus_queue.cc:1048] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.766057 16481 ts_tablet_manager.cc:1434] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:16:47.767051 16481 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.775369 16353 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.768734 16593 raft_consensus.cc:515] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.782214 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:47.783967 16204 raft_consensus.cc:3060] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.790704 16499 consensus_queue.cc:1048] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:47.793871 16593 leader_election.cc:290] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:47.798148 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
W20260709 12:16:47.799952 16392 leader_election.cc:343] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.813102 16481 tablet_bootstrap.cc:654] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:47.814229 16523 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.814795 16523 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.816991 16555 raft_consensus.cc:493] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.817626 16555 raft_consensus.cc:515] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.818575 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:47.820148 16169 leader_election.cc:343] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.816982 16523 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.822176 16204 raft_consensus.cc:2468] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:47.823954 16392 leader_election.cc:304] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.825042 16555 leader_election.cc:290] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.827023 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d90126bf2c4c43b7021634cef076aa" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:47.827984 16352 raft_consensus.cc:2468] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:47.825898 16555 raft_consensus.cc:2804] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.829567 16392 leader_election.cc:304] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:47.830441 16555 raft_consensus.cc:697] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:47.831010 16640 raft_consensus.cc:2804] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.831637 16640 raft_consensus.cc:493] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.832057 16640 raft_consensus.cc:3060] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.833684 16610 raft_consensus.cc:493] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.834364 16610 raft_consensus.cc:515] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.838397 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:47.840466 16320 leader_election.cc:343] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.842161 16610 leader_election.cc:290] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:47.844255 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:47.844425 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:47.845042 16277 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
W20260709 12:16:47.845902 16318 leader_election.cc:343] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.846112 16640 raft_consensus.cc:515] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.846504 16318 leader_election.cc:304] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:47.846747 16169 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:47.847925 16523 raft_consensus.cc:2804] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:47.848381 16610 raft_consensus.cc:2749] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.848313 16523 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.848995 16523 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:47.848133 16318 consensus_peers.cc:597] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:47.855314 16555 consensus_queue.cc:237] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.858606 16481 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.861800 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d90126bf2c4c43b7021634cef076aa" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:47.866034 16352 raft_consensus.cc:3060] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.870445 16593 raft_consensus.cc:493] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.862843 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d90126bf2c4c43b7021634cef076aa" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:47.871203 16593 raft_consensus.cc:515] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.871698 16277 raft_consensus.cc:2468] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:47.873997 16593 leader_election.cc:290] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.876744 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:47.878281 16352 raft_consensus.cc:2468] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
W20260709 12:16:47.878576 16392 leader_election.cc:343] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.863221 16640 leader_election.cc:290] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.864794 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d90126bf2c4c43b7021634cef076aa" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:47.879560 16392 leader_election.cc:304] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:47.879932 16278 raft_consensus.cc:3060] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.880110 16481 ts_tablet_manager.cc:1403] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.001s
I20260709 12:16:47.883440 16640 raft_consensus.cc:2804] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:47.884084 16640 raft_consensus.cc:697] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:47.885142 16640 consensus_queue.cc:237] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:47.893875 16481 raft_consensus.cc:359] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.895692 16481 raft_consensus.cc:385] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.896037 16481 raft_consensus.cc:740] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.896878 16481 consensus_queue.cc:260] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.897912 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:47.900014 16392 leader_election.cc:343] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:47.900691 16392 leader_election.cc:304] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:47.901777 16481 ts_tablet_manager.cc:1434] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:47.902637 16593 raft_consensus.cc:2749] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:47.902801 16481 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.912847 16481 tablet_bootstrap.cc:654] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:47.930012 16171 consensus_peers.cc:597] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e -> Peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Couldn't send request to peer bde8efa60f914da8a818213518c2b4ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:47.933393 16477 raft_consensus.cc:359] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.934432 16477 raft_consensus.cc:385] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.934842 16477 raft_consensus.cc:740] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.939693 16477 consensus_queue.cc:260] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:47.946702 16472 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:47.947355 16472 ts_tablet_manager.cc:1403] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.383s	user 0.085s	sys 0.159s
I20260709 12:16:47.963982 16499 consensus_queue.cc:1048] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:47.964775 16481 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:47.965303 16481 ts_tablet_manager.cc:1403] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.012s
I20260709 12:16:47.968153 16481 raft_consensus.cc:359] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.968873 16481 raft_consensus.cc:385] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.969237 16481 raft_consensus.cc:740] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.971285 16472 raft_consensus.cc:359] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.972234 16472 raft_consensus.cc:385] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:47.972554 16472 raft_consensus.cc:740] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:47.973376 16472 consensus_queue.cc:260] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.974270 16477 ts_tablet_manager.cc:1434] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.305s	user 0.005s	sys 0.004s
I20260709 12:16:47.975353 16477 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:47.861805 16523 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:47.979599 16523 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:47.970575 16481 consensus_queue.cc:260] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:47.984555 16472 ts_tablet_manager.cc:1434] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:16:47.985338 16472 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:47.987717 16691 log.cc:927] Time spent T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:16:47.994597 16481 ts_tablet_manager.cc:1434] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:16:47.996762 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:47.996917 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:47.997457 16280 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.997586 16350 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.999336 16477 tablet_bootstrap.cc:654] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.000010 16481 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:47.987939 16655 consensus_queue.cc:1048] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:16:48.007376 16354 raft_consensus.cc:3060] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.007753 16351 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:47.993008 16523 consensus_queue.cc:1048] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:16:48.026626 16610 raft_consensus.cc:493] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.027254 16610 raft_consensus.cc:515] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.031046 16610 leader_election.cc:290] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:48.032285 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.033499 16278 raft_consensus.cc:2468] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:48.043032 16472 tablet_bootstrap.cc:654] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.074936 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.042053 16100 catalog_manager.cc:5697] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.054121 16499 consensus_queue.cc:1048] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.077627 16318 leader_election.cc:304] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:48.046753 16473 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.060453 16280 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.058190 16350 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.082845 16602 raft_consensus.cc:2749] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:48.087308 16100 catalog_manager.cc:5697] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.091696 16528 raft_consensus.cc:493] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bde8efa60f914da8a818213518c2b4ca)
I20260709 12:16:48.092265 16528 raft_consensus.cc:515] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.096921 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.095014 16528 leader_election.cc:290] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.107060 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.108808 16320 leader_election.cc:304] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:48.110129 16610 raft_consensus.cc:2749] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:48.114092 16472 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.114683 16472 ts_tablet_manager.cc:1403] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.006s
I20260709 12:16:48.068250 16481 tablet_bootstrap.cc:654] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:48.070637 16169 consensus_peers.cc:597] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:48.119163 16169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 48659.4us
I20260709 12:16:48.121269 16169 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:48.054447 16575 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.123039 16575 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.124863 16572 raft_consensus.cc:2804] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:48.125427 16572 raft_consensus.cc:697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:48.125912 16575 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.080226 16473 ts_tablet_manager.cc:1403] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.426s	user 0.059s	sys 0.125s
I20260709 12:16:48.126315 16572 consensus_queue.cc:237] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.131088 16481 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:48.131640 16481 ts_tablet_manager.cc:1403] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.002s
I20260709 12:16:48.132701 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.134111 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.134347 16481 raft_consensus.cc:359] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.154512 16481 raft_consensus.cc:385] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.154804 16481 raft_consensus.cc:740] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.155612 16481 consensus_queue.cc:260] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.137845 16473 raft_consensus.cc:359] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.160046 16473 raft_consensus.cc:385] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.139994 16472 raft_consensus.cc:359] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.160331 16473 raft_consensus.cc:740] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.160564 16472 raft_consensus.cc:385] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.160961 16472 raft_consensus.cc:740] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.161051 16473 consensus_queue.cc:260] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.161700 16472 consensus_queue.cc:260] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.162966 16473 ts_tablet_manager.cc:1434] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.000s
W20260709 12:16:48.136880 16246 leader_election.cc:343] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.159763 16481 ts_tablet_manager.cc:1434] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 12:16:48.163905 16244 leader_election.cc:343] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.140388 16672 consensus_queue.cc:1048] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:16:48.166091 16244 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:48.170897 16099 catalog_manager.cc:5697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.172286 16575 raft_consensus.cc:2749] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.174556 16472 ts_tablet_manager.cc:1434] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:16:48.175673 16472 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:48.177830 16672 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.178355 16672 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.179725 16481 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:48.181435 16672 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.184337 16473 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.193107 16477 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:48.187549 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.255419 16278 raft_consensus.cc:3060] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.183950 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.267694 16477 ts_tablet_manager.cc:1403] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.293s	user 0.037s	sys 0.027s
I20260709 12:16:48.267879 16280 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.269583 16169 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:48.269922 16473 tablet_bootstrap.cc:654] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.187005 16706 raft_consensus.cc:493] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.267985 16425 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.193229 16472 tablet_bootstrap.cc:654] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.272989 16706 raft_consensus.cc:515] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.274632 16481 tablet_bootstrap.cc:654] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.274016 16672 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:48.275079 16672 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.275731 16672 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.278100 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.287865 16706 leader_election.cc:290] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.287106 16672 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.289119 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83df294335c64a35b675edbe966445f4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.290143 16202 raft_consensus.cc:2393] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate bde8efa60f914da8a818213518c2b4ca in this term.
I20260709 12:16:48.290395 16602 raft_consensus.cc:493] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.290900 16602 raft_consensus.cc:515] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.291970 16244 leader_election.cc:304] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:48.292873 16602 leader_election.cc:290] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.293483 16706 raft_consensus.cc:3060] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.295394 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.296046 16425 raft_consensus.cc:2468] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:48.270934 16477 raft_consensus.cc:359] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.302009 16477 raft_consensus.cc:385] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.302294 16477 raft_consensus.cc:740] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.302950 16477 consensus_queue.cc:260] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.306070 16477 ts_tablet_manager.cc:1434] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:16:48.307199 16320 leader_election.cc:304] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:48.308802 16472 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.309338 16472 ts_tablet_manager.cc:1403] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.023s
I20260709 12:16:48.311434 16481 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:48.308799 16477 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:48.311908 16481 ts_tablet_manager.cc:1403] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.000s
I20260709 12:16:48.314607 16481 raft_consensus.cc:359] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.315300 16481 raft_consensus.cc:385] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.315582 16481 raft_consensus.cc:740] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.315714 16472 raft_consensus.cc:359] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.316555 16472 raft_consensus.cc:385] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.316854 16472 raft_consensus.cc:740] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.316357 16481 consensus_queue.cc:260] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.317480 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.318179 16528 raft_consensus.cc:2804] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:48.318555 16528 raft_consensus.cc:493] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.318902 16528 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:48.323550 16318 leader_election.cc:343] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.317525 16472 consensus_queue.cc:260] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.327682 16472 ts_tablet_manager.cc:1434] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:16:48.328629 16472 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:48.332624 16672 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.335119 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:48.335842 16425 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.324154 16706 raft_consensus.cc:2749] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.343575 16477 tablet_bootstrap.cc:654] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.344035 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:48.344722 16277 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.346268 16472 tablet_bootstrap.cc:654] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.347103 16555 consensus_queue.cc:1048] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.350412 16706 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.350934 16706 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.354070 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:48.355480 16246 leader_election.cc:343] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.361174 16473 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.361694 16473 ts_tablet_manager.cc:1403] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.029s
I20260709 12:16:48.364897 16473 raft_consensus.cc:359] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.365628 16473 raft_consensus.cc:385] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.365942 16473 raft_consensus.cc:740] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.366854 16473 consensus_queue.cc:260] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.377503 16473 ts_tablet_manager.cc:1434] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:16:48.378880 16473 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.385125 16481 ts_tablet_manager.cc:1434] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 12:16:48.389201 16528 raft_consensus.cc:515] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.401933 16481 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:48.401789 16640 consensus_queue.cc:1048] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:48.405680 16277 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:16:48.406898 16169 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:48.407379 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.408581 16672 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.409109 16672 raft_consensus.cc:697] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:48.403285 16706 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.409951 16672 consensus_queue.cc:237] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.412719 16425 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:16:48.412941 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:48.413326 16244 leader_election.cc:343] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.413657 16481 tablet_bootstrap.cc:654] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.413877 16244 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:48.415917 16706 raft_consensus.cc:2749] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.417510 16499 raft_consensus.cc:493] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7f2df769fee4fb7894cdbb752cab97e)
I20260709 12:16:48.423063 16499 raft_consensus.cc:515] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.424253 16679 raft_consensus.cc:493] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.424767 16679 raft_consensus.cc:515] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.425755 16499 leader_election.cc:290] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:48.417466 16593 consensus_queue.cc:1048] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:48.427382 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.413707 16427 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.434271 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9773066f8824befb0ba38e00f26711b" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:48.436240 16244 leader_election.cc:304] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:48.437836 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
W20260709 12:16:48.439404 16318 leader_election.cc:343] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.436199 16477 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:48.440940 16477 ts_tablet_manager.cc:1403] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.023s
I20260709 12:16:48.442869 16473 tablet_bootstrap.cc:654] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.448688 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:48.450407 16171 leader_election.cc:343] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.433672 16528 leader_election.cc:290] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.452982 16679 leader_election.cc:290] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.452998 16593 consensus_queue.cc:1048] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:16:48.467293 16719 raft_consensus.cc:2749] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:48.469538 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:48.469564 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.472674 16103 catalog_manager.cc:5697] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 2, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.473914 16472 tablet_bootstrap.cc:492] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.477159 16472 ts_tablet_manager.cc:1403] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.015s
W20260709 12:16:48.480968 16169 leader_election.cc:343] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.481702 16169 leader_election.cc:304] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:48.483223 16572 raft_consensus.cc:2749] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.485783 16427 raft_consensus.cc:2468] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:48.489368 16320 leader_election.cc:304] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:48.490968 16528 raft_consensus.cc:2804] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:48.491644 16528 raft_consensus.cc:697] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:48.492730 16528 consensus_queue.cc:237] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.493978 16477 raft_consensus.cc:359] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.494695 16477 raft_consensus.cc:385] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.495158 16477 raft_consensus.cc:740] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.507942 16473 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.508514 16473 ts_tablet_manager.cc:1403] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.007s
I20260709 12:16:48.495822 16477 consensus_queue.cc:260] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.513026 16477 ts_tablet_manager.cc:1434] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:16:48.513401 16473 raft_consensus.cc:359] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.514089 16473 raft_consensus.cc:385] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.514350 16473 raft_consensus.cc:740] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.487190 16472 raft_consensus.cc:359] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.515425 16472 raft_consensus.cc:385] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.515936 16472 raft_consensus.cc:740] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.521898 16472 consensus_queue.cc:260] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.524087 16472 ts_tablet_manager.cc:1434] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:16:48.524598 16477 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:48.525102 16472 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:48.515950 16473 consensus_queue.cc:260] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.528334 16473 ts_tablet_manager.cc:1434] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:16:48.529452 16473 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.533237 16481 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:48.533772 16481 ts_tablet_manager.cc:1403] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.000s
I20260709 12:16:48.536537 16481 raft_consensus.cc:359] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.537228 16481 raft_consensus.cc:385] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.537490 16481 raft_consensus.cc:740] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.537691 16477 tablet_bootstrap.cc:654] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.549232 16473 tablet_bootstrap.cc:654] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.553471 16425 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.560700 16473 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.561251 16473 ts_tablet_manager.cc:1403] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.005s
I20260709 12:16:48.564002 16473 raft_consensus.cc:359] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.564779 16473 raft_consensus.cc:385] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.564580 16572 consensus_queue.cc:1048] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.565055 16473 raft_consensus.cc:740] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.563640 16100 catalog_manager.cc:5697] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.579764 16679 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.580298 16679 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.583106 16679 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.585405 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.585860 16473 consensus_queue.cc:260] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.547542 16481 consensus_queue.cc:260] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.587118 16427 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:48.587217 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.588030 16278 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:48.588349 16171 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:48.589294 16572 raft_consensus.cc:2804] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:48.589743 16572 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.590081 16572 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.594023 16473 ts_tablet_manager.cc:1434] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:16:48.594573 16481 ts_tablet_manager.cc:1434] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 12:16:48.596027 16473 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.596612 16481 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:48.597028 16528 raft_consensus.cc:493] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.597520 16528 raft_consensus.cc:515] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.606190 16523 consensus_queue.cc:1048] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.610530 16528 leader_election.cc:290] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.615625 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:48.622903 16318 leader_election.cc:343] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.623375 16602 raft_consensus.cc:493] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.623936 16602 raft_consensus.cc:515] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.628087 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.631590 16602 leader_election.cc:290] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.611189 16481 tablet_bootstrap.cc:654] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.612308 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.632436 16427 raft_consensus.cc:2468] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:48.633944 16320 leader_election.cc:304] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:48.635290 16602 raft_consensus.cc:2804] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:48.635756 16602 raft_consensus.cc:493] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.636169 16602 raft_consensus.cc:3060] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.596081 16472 tablet_bootstrap.cc:654] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:48.636865 16318 leader_election.cc:343] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.639891 16473 tablet_bootstrap.cc:654] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.646708 16572 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.648907 16572 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.650775 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:48.651618 16277 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.654357 16472 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.654878 16472 ts_tablet_manager.cc:1403] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.002s
I20260709 12:16:48.657612 16472 raft_consensus.cc:359] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.658303 16472 raft_consensus.cc:385] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.658578 16472 raft_consensus.cc:740] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.661787 16472 consensus_queue.cc:260] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.667583 16472 ts_tablet_manager.cc:1434] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:16:48.668557 16472 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:48.670446 16719 raft_consensus.cc:493] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.670974 16719 raft_consensus.cc:515] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.672940 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:48.674203 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.674894 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:48.675556 16426 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.676244 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:48.677999 16719 leader_election.cc:290] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:48.680197 16246 leader_election.cc:304] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:48.683816 16706 raft_consensus.cc:2749] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.689384 16481 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:48.690148 16481 ts_tablet_manager.cc:1403] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.005s
I20260709 12:16:48.691850 16277 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.695024 16169 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:48.698945 16572 raft_consensus.cc:2804] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:48.699448 16572 raft_consensus.cc:697] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:48.700464 16472 tablet_bootstrap.cc:654] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.700249 16572 consensus_queue.cc:237] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:48.711980 16318 leader_election.cc:343] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.712504 16318 leader_election.cc:304] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:48.713253 16610 raft_consensus.cc:2749] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:48.715956 16426 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.717234 16602 raft_consensus.cc:515] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.718657 16477 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:48.721079 16477 ts_tablet_manager.cc:1403] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.205s	user 0.042s	sys 0.077s
I20260709 12:16:48.720024 16481 raft_consensus.cc:359] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.720057 16472 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.722009 16481 raft_consensus.cc:385] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.722237 16472 ts_tablet_manager.cc:1403] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 12:16:48.723887 16477 raft_consensus.cc:359] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.724287 16481 raft_consensus.cc:740] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.724609 16477 raft_consensus.cc:385] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.724916 16477 raft_consensus.cc:740] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.725330 16481 consensus_queue.cc:260] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.726694 16472 raft_consensus.cc:359] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.723387 16602 leader_election.cc:290] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.728382 16481 ts_tablet_manager.cc:1434] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:16:48.727301 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:48.731191 16425 raft_consensus.cc:3060] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.731945 16481 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:48.732125 16477 consensus_queue.cc:260] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.734481 16477 ts_tablet_manager.cc:1434] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:16:48.740269 16278 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.739485 16101 catalog_manager.cc:5697] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.743408 16477 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:48.746877 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:48.727372 16472 raft_consensus.cc:385] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.747726 16472 raft_consensus.cc:740] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
W20260709 12:16:48.748514 16318 leader_election.cc:343] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.748426 16472 consensus_queue.cc:260] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.756870 16472 ts_tablet_manager.cc:1434] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.000s
I20260709 12:16:48.757839 16472 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:48.763681 16472 tablet_bootstrap.cc:654] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.764195 16481 tablet_bootstrap.cc:654] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.767520 16572 raft_consensus.cc:493] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.768132 16572 raft_consensus.cc:515] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.770085 16477 tablet_bootstrap.cc:654] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.771150 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:48.771871 16350 raft_consensus.cc:2468] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:48.777462 16425 raft_consensus.cc:2468] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:48.778609 16169 leader_election.cc:304] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:48.778729 16320 leader_election.cc:304] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:48.779340 16481 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:48.780004 16481 ts_tablet_manager.cc:1403] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 12:16:48.780354 16679 raft_consensus.cc:2804] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:48.780122 16572 leader_election.cc:290] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:48.780848 16679 raft_consensus.cc:493] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.781267 16679 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.789721 16472 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:48.790468 16472 ts_tablet_manager.cc:1403] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:16:48.779925 16602 raft_consensus.cc:2804] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:48.791443 16602 raft_consensus.cc:697] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:48.792657 16602 consensus_queue.cc:237] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.794217 16472 raft_consensus.cc:359] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.796204 16481 raft_consensus.cc:359] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.797178 16481 raft_consensus.cc:385] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.797528 16481 raft_consensus.cc:740] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.798470 16481 consensus_queue.cc:260] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:48.801515 16481 ts_tablet_manager.cc:1434] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:48.802945 16481 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:48.803958 16672 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.805632 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.806694 16477 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:48.808683 16477 ts_tablet_manager.cc:1403] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.019s
I20260709 12:16:48.809830 16473 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.795224 16472 raft_consensus.cc:385] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.807394 16672 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.810317 16473 ts_tablet_manager.cc:1403] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.023s
I20260709 12:16:48.810416 16472 raft_consensus.cc:740] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.812211 16477 raft_consensus.cc:359] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.813055 16477 raft_consensus.cc:385] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.813359 16477 raft_consensus.cc:740] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.813356 16472 consensus_queue.cc:260] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.815557 16472 ts_tablet_manager.cc:1434] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:16:48.815781 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:48.816444 16277 raft_consensus.cc:2468] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:48.816620 16472 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:48.817366 16171 leader_election.cc:343] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.819201 16169 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:48.818766 16102 catalog_manager.cc:5697] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.819466 16473 raft_consensus.cc:359] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.820243 16473 raft_consensus.cc:385] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.820361 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:48.820562 16473 raft_consensus.cc:740] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.822098 16473 consensus_queue.cc:260] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.824399 16473 ts_tablet_manager.cc:1434] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:16:48.822120 16572 raft_consensus.cc:2804] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:48.824934 16572 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.825273 16572 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.825407 16473 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.817633 16672 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
W20260709 12:16:48.829355 16171 leader_election.cc:343] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.829856 16477 consensus_queue.cc:260] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.830024 16679 raft_consensus.cc:515] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.832499 16477 ts_tablet_manager.cc:1434] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:16:48.833287 16277 raft_consensus.cc:1275] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:48.837442 16477 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:48.840018 16672 consensus_queue.cc:1048] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.841810 16473 tablet_bootstrap.cc:654] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.847820 16477 tablet_bootstrap.cc:654] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.871299 16280 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.878332 16473 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:48.878935 16473 ts_tablet_manager.cc:1403] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.007s
I20260709 12:16:48.883630 16473 raft_consensus.cc:359] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.884410 16473 raft_consensus.cc:385] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.884716 16473 raft_consensus.cc:740] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:48.885382 16473 consensus_queue.cc:260] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.887528 16679 leader_election.cc:290] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:48.890766 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:48.891453 16350 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.896272 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:48.896852 16426 raft_consensus.cc:1275] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:48.896936 16425 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.895414 16572 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:48.901157 16672 consensus_queue.cc:1048] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.903716 16602 consensus_queue.cc:1048] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:48.904260 16472 tablet_bootstrap.cc:654] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.904937 16350 raft_consensus.cc:2468] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.909138 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:48.901185 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:48.912031 16278 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:48.916685 16169 leader_election.cc:304] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
W20260709 12:16:48.917941 16171 leader_election.cc:343] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:48.916708 16473 ts_tablet_manager.cc:1434] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:16:48.921872 16481 tablet_bootstrap.cc:654] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:48.922338 16672 raft_consensus.cc:2804] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:48.931762 16672 raft_consensus.cc:697] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:48.932865 16672 consensus_queue.cc:237] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.920670 16473 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:48.924284 16477 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:48.926342 16425 raft_consensus.cc:2468] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:48.906661 16572 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:48.940150 16477 ts_tablet_manager.cc:1403] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.001s
I20260709 12:16:48.940976 16602 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.945847 16602 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:48.948681 16477 raft_consensus.cc:359] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:48.949608 16477 raft_consensus.cc:385] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:48.949781 16602 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:48.949921 16477 raft_consensus.cc:740] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.311164 16477 consensus_queue.cc:260] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.313337 16477 ts_tablet_manager.cc:1434] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.373s	user 0.008s	sys 0.000s
I20260709 12:16:49.313628 16672 raft_consensus.cc:493] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.314383 16672 raft_consensus.cc:515] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.316471 16672 leader_election.cc:290] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:49.319200 16278 raft_consensus.cc:2468] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:49.320729 16101 catalog_manager.cc:5697] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:49.327417 16473 tablet_bootstrap.cc:700] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: Time spent opening tablet: real 0.343s	user 0.003s	sys 0.012s
I20260709 12:16:49.314333 16477 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:49.339277 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:49.360695 16473 tablet_bootstrap.cc:654] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:49.454694 16719 raft_consensus.cc:493] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.475814 16719 raft_consensus.cc:515] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.507211 16719 leader_election.cc:290] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:49.507848 16748 log.cc:927] Time spent T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:16:49.531281 16472 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:49.532042 16472 ts_tablet_manager.cc:1403] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.716s	user 0.023s	sys 0.014s
I20260709 12:16:49.537608 16477 tablet_bootstrap.cc:654] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:49.533245 16749 log.cc:927] Time spent T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:16:49.574995 16754 raft_consensus.cc:493] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.575752 16754 raft_consensus.cc:515] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:49.578341 16754 leader_election.cc:290] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:49.594631 16472 raft_consensus.cc:359] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.595463 16472 raft_consensus.cc:385] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.595758 16472 raft_consensus.cc:740] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.595806 16555 raft_consensus.cc:493] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.596310 16555 raft_consensus.cc:515] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.596498 16472 consensus_queue.cc:260] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.598052 16472 ts_tablet_manager.cc:1434] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.000s
I20260709 12:16:49.598467 16555 leader_election.cc:290] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:49.600699 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:49.588824 16679 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.606829 16472 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:49.610005 16679 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.612896 16679 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:49.623072 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:49.628582 16481 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:49.629341 16481 ts_tablet_manager.cc:1403] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.827s	user 0.021s	sys 0.039s
I20260709 12:16:49.656731 16169 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:49.668836 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:49.669950 16169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 43737.5us
I20260709 12:16:49.673039 16679 raft_consensus.cc:2804] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:49.673740 16679 raft_consensus.cc:697] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:49.675776 16481 raft_consensus.cc:359] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.676591 16481 raft_consensus.cc:385] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.676887 16481 raft_consensus.cc:740] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.677640 16481 consensus_queue.cc:260] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.694721 16481 ts_tablet_manager.cc:1434] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 12:16:49.674805 16679 consensus_queue.cc:237] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:49.695998 16392 leader_election.cc:343] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.713245 16481 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:49.713958 16765 raft_consensus.cc:493] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.741421 16472 tablet_bootstrap.cc:654] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:49.729574 16765 raft_consensus.cc:515] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.755084 16473 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:49.755923 16473 ts_tablet_manager.cc:1403] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.835s	user 0.022s	sys 0.020s
I20260709 12:16:49.750437 16765 leader_election.cc:290] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:49.765566 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:49.769721 16246 leader_election.cc:343] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.777931 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:49.778935 16354 raft_consensus.cc:2468] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
W20260709 12:16:49.780390 16244 leader_election.cc:343] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:49.780752 16318 leader_election.cc:343] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.782908 16473 raft_consensus.cc:359] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.784242 16473 raft_consensus.cc:385] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.784521 16473 raft_consensus.cc:740] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.786144 16477 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:49.786850 16477 ts_tablet_manager.cc:1403] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.473s	user 0.013s	sys 0.035s
I20260709 12:16:49.794616 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:49.795855 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:49.800215 16477 raft_consensus.cc:359] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.801265 16477 raft_consensus.cc:385] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.801385 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:49.801667 16477 raft_consensus.cc:740] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.802822 16477 consensus_queue.cc:260] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.805720 16477 ts_tablet_manager.cc:1434] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:16:49.806973 16477 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:49.788132 16473 consensus_queue.cc:260] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.810900 16773 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.815653 16773 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.816699 16481 tablet_bootstrap.cc:654] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:49.817886 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:49.822031 16349 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:49.818063 16773 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
W20260709 12:16:49.823863 16169 leader_election.cc:343] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.827394 16756 consensus_queue.cc:1048] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:49.831554 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:49.832399 16205 raft_consensus.cc:2468] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:49.834081 16244 leader_election.cc:304] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:49.834934 16760 raft_consensus.cc:2804] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:49.835355 16760 raft_consensus.cc:493] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.835696 16760 raft_consensus.cc:3060] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:49.835935 16756 consensus_queue.cc:1048] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:49.836582 16169 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:49.837466 16772 raft_consensus.cc:2804] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:49.837849 16772 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.838161 16772 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:49.841495 16244 leader_election.cc:304] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:49.842378 16719 raft_consensus.cc:2804] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:49.842762 16318 consensus_peers.cc:597] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.842818 16719 raft_consensus.cc:493] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.843570 16719 raft_consensus.cc:3060] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:49.844282 16318 consensus_peers.cc:597] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.854844 16472 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:49.855657 16472 ts_tablet_manager.cc:1403] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.249s	user 0.008s	sys 0.011s
I20260709 12:16:49.855552 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:49.857221 16756 consensus_queue.cc:1048] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:49.861249 16472 raft_consensus.cc:359] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:49.861922 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:49.862666 16473 ts_tablet_manager.cc:1434] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:16:49.862432 16719 raft_consensus.cc:515] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.870512 16472 raft_consensus.cc:385] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.875746 16472 raft_consensus.cc:740] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.876551 16472 consensus_queue.cc:260] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.878297 16473 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:49.882937 16760 raft_consensus.cc:515] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.883255 16101 catalog_manager.cc:5697] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.885653 16472 ts_tablet_manager.cc:1434] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:16:49.886464 16477 tablet_bootstrap.cc:654] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:49.868204 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 48060.4us
I20260709 12:16:49.887802 16472 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:49.892448 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:49.891855 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:49.895771 16280 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:49.896557 16719 leader_election.cc:290] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:49.900446 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:49.902639 16481 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:49.903801 16481 ts_tablet_manager.cc:1403] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.010s
W20260709 12:16:49.893769 16320 leader_election.cc:343] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.908460 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:49.908466 16246 leader_election.cc:343] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.913079 16320 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:49.914824 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:49.915556 16204 raft_consensus.cc:3060] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:49.915692 16772 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:49.906924 16760 leader_election.cc:290] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:49.918375 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:49.919102 16349 raft_consensus.cc:3060] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:49.921904 16472 tablet_bootstrap.cc:654] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:49.928188 16320 leader_election.cc:343] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:49.929365 16392 leader_election.cc:343] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.930158 16392 leader_election.cc:304] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:49.933408 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
W20260709 12:16:49.933553 16318 leader_election.cc:343] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.934104 16318 leader_election.cc:304] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:49.936151 16766 raft_consensus.cc:2749] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:49.938930 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:49.939666 16481 raft_consensus.cc:359] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:49.940025 16274 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
W20260709 12:16:49.940899 16244 leader_election.cc:343] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.930760 16750 raft_consensus.cc:2749] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:49.948230 16169 leader_election.cc:343] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:49.948839 16169 leader_election.cc:304] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:49.953359 16523 raft_consensus.cc:2749] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:49.940439 16481 raft_consensus.cc:385] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:49.955124 16481 raft_consensus.cc:740] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:49.955924 16762 raft_consensus.cc:2749] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:49.956240 16481 consensus_queue.cc:260] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:49.956938 16205 raft_consensus.cc:2393] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7f2df769fee4fb7894cdbb752cab97e in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:49.958631 16481 ts_tablet_manager.cc:1434] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:16:49.960412 16318 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:49.961589 16770 raft_consensus.cc:2804] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:49.962045 16770 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.962466 16770 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:49.972426 16473 tablet_bootstrap.cc:654] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:49.975194 16768 consensus_queue.cc:1048] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:49.978425 16204 raft_consensus.cc:2468] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:49.984841 16481 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:49.987808 16349 raft_consensus.cc:2468] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:49.988915 16244 leader_election.cc:304] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:49.990214 16244 leader_election.cc:304] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:49.991124 16765 raft_consensus.cc:2804] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:49.991986 16765 raft_consensus.cc:697] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:49.994997 16481 tablet_bootstrap.cc:654] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:49.993260 16765 consensus_queue.cc:237] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:49.991328 16719 raft_consensus.cc:2804] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:49.977255 16772 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.003779 16719 raft_consensus.cc:697] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:50.019753 16760 raft_consensus.cc:493] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.030864 16760 raft_consensus.cc:515] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.034539 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:50.007004 16169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 52274.4us
I20260709 12:16:50.038086 16204 raft_consensus.cc:2468] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.040076 16244 leader_election.cc:304] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:50.041101 16758 raft_consensus.cc:2804] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.041196 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.041514 16758 raft_consensus.cc:493] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.041864 16758 raft_consensus.cc:3060] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.041911 16427 raft_consensus.cc:2468] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.042884 16770 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.051154 16719 consensus_queue.cc:237] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.051748 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:50.052525 16203 raft_consensus.cc:2393] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7f2df769fee4fb7894cdbb752cab97e in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:50.036818 16760 leader_election.cc:290] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:50.060606 16555 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.061170 16555 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.063230 16555 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:50.065294 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.065410 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:50.066124 16274 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.066399 16275 raft_consensus.cc:2393] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:50.069492 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.078514 16392 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.079493 16755 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.088511 16758 raft_consensus.cc:515] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.092346 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:50.093345 16427 raft_consensus.cc:3060] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.101460 16477 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.101832 16427 raft_consensus.cc:2468] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:50.102068 16477 ts_tablet_manager.cc:1403] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.295s	user 0.013s	sys 0.009s
I20260709 12:16:50.103111 16246 leader_election.cc:304] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:50.104967 16477 raft_consensus.cc:359] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.105698 16477 raft_consensus.cc:385] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.105957 16477 raft_consensus.cc:740] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.056241 16770 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:50.106640 16477 consensus_queue.cc:260] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.109388 16477 ts_tablet_manager.cc:1434] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:16:50.111063 16274 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:50.111768 16499 raft_consensus.cc:2804] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.112293 16572 consensus_queue.cc:1048] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.112555 16318 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:50.112450 16499 raft_consensus.cc:697] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:50.114427 16770 raft_consensus.cc:2804] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.114151 16499 consensus_queue.cc:237] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.115561 16477 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:50.118251 16770 raft_consensus.cc:697] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:50.120071 16770 consensus_queue.cc:237] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.120940 16758 leader_election.cc:290] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:50.123334 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:50.125305 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.126305 16275 raft_consensus.cc:2393] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:50.150050 16481 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.150604 16481 ts_tablet_manager.cc:1403] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.019s
I20260709 12:16:50.155009 16477 tablet_bootstrap.cc:654] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.159382 16169 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.158970 16481 raft_consensus.cc:359] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.160053 16481 raft_consensus.cc:385] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.142438 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea523de666d4596bdfd1b53225aff83" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:50.160410 16481 raft_consensus.cc:740] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.164875 16204 raft_consensus.cc:3060] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.162467 16772 raft_consensus.cc:2749] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.165277 16481 consensus_queue.cc:260] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.175717 16481 ts_tablet_manager.cc:1434] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.009s
I20260709 12:16:50.176713 16481 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:50.214253 16755 raft_consensus.cc:2749] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.221832 16758 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.222433 16473 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:50.222407 16758 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.223034 16473 ts_tablet_manager.cc:1403] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.348s	user 0.017s	sys 0.000s
I20260709 12:16:50.224735 16758 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:50.226284 16481 tablet_bootstrap.cc:654] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.235584 16473 raft_consensus.cc:359] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.236083 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.236418 16473 raft_consensus.cc:385] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.236748 16473 raft_consensus.cc:740] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.237460 16473 consensus_queue.cc:260] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.237983 16204 raft_consensus.cc:2468] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:50.239223 16472 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:50.239759 16472 ts_tablet_manager.cc:1403] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.353s	user 0.014s	sys 0.017s
I20260709 12:16:50.240909 16772 raft_consensus.cc:493] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.236200 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.241413 16772 raft_consensus.cc:515] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.246058 16768 raft_consensus.cc:493] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.246730 16772 leader_election.cc:290] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:50.246573 16768 raft_consensus.cc:515] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.248673 16768 leader_election.cc:290] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:50.249142 16472 raft_consensus.cc:359] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.249891 16472 raft_consensus.cc:385] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.250200 16472 raft_consensus.cc:740] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.252559 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.251830 16472 consensus_queue.cc:260] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.257732 16102 catalog_manager.cc:5697] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:50.259101 16102 catalog_manager.cc:5697] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.263520 16772 consensus_queue.cc:1048] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.264230 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.264917 16428 raft_consensus.cc:2468] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:50.266415 16320 leader_election.cc:304] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:50.267320 16770 raft_consensus.cc:2804] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.267822 16770 raft_consensus.cc:493] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.268268 16770 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.269591 16246 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:50.271030 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.273535 16472 ts_tablet_manager.cc:1434] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 12:16:50.273815 16101 catalog_manager.cc:5697] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.275337 16473 ts_tablet_manager.cc:1434] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 12:16:50.280731 16169 leader_election.cc:304] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:50.282774 16772 raft_consensus.cc:2749] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.275142 16472 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:50.286737 16755 raft_consensus.cc:493] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.287918 16770 raft_consensus.cc:515] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.287935 16755 raft_consensus.cc:515] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.292899 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:50.299453 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.300252 16354 raft_consensus.cc:2468] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:50.298990 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:50.302193 16426 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.301147 16770 leader_election.cc:290] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:50.305063 16473 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:50.302135 16392 leader_election.cc:304] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:50.308835 16774 raft_consensus.cc:2804] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.309473 16774 raft_consensus.cc:493] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.309921 16774 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:50.311187 16318 leader_election.cc:343] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.311852 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.313750 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:50.302481 16799 log.cc:927] Time spent T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:16:50.330529 16318 leader_election.cc:343] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.335525 16774 raft_consensus.cc:515] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.337721 16774 leader_election.cc:290] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.321884 16755 leader_election.cc:290] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.342903 16204 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:50.345091 16392 leader_election.cc:343] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.357009 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.348579 16473 tablet_bootstrap.cc:654] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.349094 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:50.351537 16756 consensus_queue.cc:1048] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.359827 16354 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:50.372704 16392 leader_election.cc:343] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.384845 16426 raft_consensus.cc:2468] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:50.388300 16477 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.388816 16477 ts_tablet_manager.cc:1403] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.002s
I20260709 12:16:50.391264 16481 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.391445 16320 leader_election.cc:304] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.391939 16481 ts_tablet_manager.cc:1403] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.215s	user 0.033s	sys 0.019s
I20260709 12:16:50.392431 16477 raft_consensus.cc:359] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.393134 16753 raft_consensus.cc:2804] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.393668 16753 raft_consensus.cc:697] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:50.394470 16753 consensus_queue.cc:237] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.397032 16472 tablet_bootstrap.cc:654] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.393153 16477 raft_consensus.cc:385] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.401793 16477 raft_consensus.cc:740] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.403894 16354 raft_consensus.cc:2468] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:50.405867 16392 leader_election.cc:304] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.408726 16481 raft_consensus.cc:359] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.409695 16481 raft_consensus.cc:385] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.410022 16481 raft_consensus.cc:740] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.410832 16481 consensus_queue.cc:260] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.422115 16481 ts_tablet_manager.cc:1434] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:16:50.418403 16477 consensus_queue.cc:260] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.424400 16760 raft_consensus.cc:2749] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:50.416558 16774 raft_consensus.cc:2804] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.432878 16774 raft_consensus.cc:697] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:50.433964 16774 consensus_queue.cc:237] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.441069 16481 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:50.469138 16477 ts_tablet_manager.cc:1434] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.004s
I20260709 12:16:50.470543 16473 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:50.471118 16473 ts_tablet_manager.cc:1403] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.166s	user 0.025s	sys 0.014s
I20260709 12:16:50.476830 16472 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:50.477442 16472 ts_tablet_manager.cc:1403] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.203s	user 0.011s	sys 0.029s
I20260709 12:16:50.480682 16473 raft_consensus.cc:359] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.481488 16473 raft_consensus.cc:385] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.481812 16473 raft_consensus.cc:740] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.482585 16473 consensus_queue.cc:260] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.484517 16472 raft_consensus.cc:359] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.485340 16472 raft_consensus.cc:385] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.485630 16472 raft_consensus.cc:740] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.488363 16472 consensus_queue.cc:260] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.490688 16472 ts_tablet_manager.cc:1434] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:16:50.490931 16765 consensus_queue.cc:1048] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.491677 16472 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
W20260709 12:16:50.491794 16246 consensus_peers.cc:597] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 -> Peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Couldn't send request to peer bde8efa60f914da8a818213518c2b4ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:50.494273 16473 ts_tablet_manager.cc:1434] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:16:50.495426 16473 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:50.501642 16473 tablet_bootstrap.cc:654] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.507622 16765 consensus_queue.cc:1048] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:50.516644 16481 tablet_bootstrap.cc:654] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.517650 16774 raft_consensus.cc:493] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.516781 16472 tablet_bootstrap.cc:654] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.518278 16774 raft_consensus.cc:515] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.520838 16774 leader_election.cc:290] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.522745 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:50.523360 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:50.524391 16392 leader_election.cc:343] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:50.525527 16392 leader_election.cc:343] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.526052 16392 leader_election.cc:304] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.527446 16774 raft_consensus.cc:2749] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.535149 16472 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:50.540989 16481 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.540933 16103 catalog_manager.cc:5697] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } }
I20260709 12:16:50.552997 16481 ts_tablet_manager.cc:1403] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.005s
I20260709 12:16:50.526957 16100 catalog_manager.cc:5697] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:50.548199 16758 consensus_queue.cc:1048] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.555840 16481 raft_consensus.cc:359] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.556520 16481 raft_consensus.cc:385] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.556799 16481 raft_consensus.cc:740] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.557436 16481 consensus_queue.cc:260] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
W20260709 12:16:50.559216 16244 consensus_peers.cc:597] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:50.548722 16477 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:50.560107 16472 ts_tablet_manager.cc:1403] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.005s
I20260709 12:16:50.552361 16473 tablet_bootstrap.cc:492] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:50.562652 16473 ts_tablet_manager.cc:1403] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.002s
I20260709 12:16:50.565398 16473 raft_consensus.cc:359] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.566051 16473 raft_consensus.cc:385] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.566314 16473 raft_consensus.cc:740] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.559614 16481 ts_tablet_manager.cc:1434] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:50.570364 16477 tablet_bootstrap.cc:654] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.571035 16481 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:50.576121 16472 raft_consensus.cc:359] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.576920 16472 raft_consensus.cc:385] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.577299 16472 raft_consensus.cc:740] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.578030 16472 consensus_queue.cc:260] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.566942 16473 consensus_queue.cc:260] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.583163 16481 tablet_bootstrap.cc:654] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.589069 16473 ts_tablet_manager.cc:1434] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:16:50.590513 16473 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:50.584425 16765 consensus_queue.cc:1048] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.596379 16477 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.596916 16477 ts_tablet_manager.cc:1403] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.005s
I20260709 12:16:50.586791 16770 consensus_queue.cc:1048] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:50.599669 16477 raft_consensus.cc:359] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.600411 16477 raft_consensus.cc:385] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.600715 16477 raft_consensus.cc:740] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.601616 16477 consensus_queue.cc:260] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.604295 16472 ts_tablet_manager.cc:1434] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:16:50.604832 16770 raft_consensus.cc:493] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.610395 16770 raft_consensus.cc:515] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.606170 16477 ts_tablet_manager.cc:1434] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:50.611251 16473 tablet_bootstrap.cc:654] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.612035 16477 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:50.610958 16472 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:50.613651 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.614429 16205 raft_consensus.cc:2468] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:50.615886 16318 leader_election.cc:304] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:50.616865 16753 raft_consensus.cc:2804] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.617271 16753 raft_consensus.cc:493] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.617718 16753 raft_consensus.cc:3060] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.623438 16472 tablet_bootstrap.cc:654] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.623525 16499 raft_consensus.cc:493] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.625156 16499 raft_consensus.cc:515] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.629148 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.629937 16205 raft_consensus.cc:2468] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.630026 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.631330 16244 leader_election.cc:304] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:50.629276 16499 leader_election.cc:290] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.632290 16499 raft_consensus.cc:2804] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.632740 16499 raft_consensus.cc:493] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.633173 16499 raft_consensus.cc:3060] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.638497 16100 catalog_manager.cc:5697] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.641103 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:50.646000 16753 raft_consensus.cc:515] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.647318 16354 raft_consensus.cc:2393] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:50.649945 16768 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.650555 16768 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.653128 16768 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:50.653931 16770 leader_election.cc:290] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:50.655205 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.651024 16477 tablet_bootstrap.cc:654] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:50.656946 16320 leader_election.cc:343] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.659754 16481 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.660228 16481 ts_tablet_manager.cc:1403] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.004s
I20260709 12:16:50.659376 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:50.662936 16318 leader_election.cc:343] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.662875 16481 raft_consensus.cc:359] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.663477 16318 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:50.663769 16481 raft_consensus.cc:385] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.664052 16481 raft_consensus.cc:740] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.664260 16768 raft_consensus.cc:2749] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.664880 16481 consensus_queue.cc:260] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.667438 16572 raft_consensus.cc:493] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.667650 16481 ts_tablet_manager.cc:1434] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:50.668027 16572 raft_consensus.cc:515] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.668861 16481 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:50.670408 16499 raft_consensus.cc:515] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.671792 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.672206 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1671729a63334f38b4e87d414002c770" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.677474 16481 tablet_bootstrap.cc:654] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.682363 16274 raft_consensus.cc:2393] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7f2df769fee4fb7894cdbb752cab97e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:50.682600 16171 leader_election.cc:304] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:50.683669 16772 raft_consensus.cc:2749] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.677989 16572 leader_election.cc:290] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:50.687736 16472 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:50.688563 16755 raft_consensus.cc:493] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.692561 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:50.692771 16477 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.692638 16755 raft_consensus.cc:515] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.693377 16205 raft_consensus.cc:3060] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.693732 16477 ts_tablet_manager.cc:1403] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.011s
I20260709 12:16:50.693629 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:50.695503 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:50.696393 16352 raft_consensus.cc:2393] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:50.698242 16244 leader_election.cc:304] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:50.699520 16758 raft_consensus.cc:2749] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.700062 16755 leader_election.cc:290] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.702164 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:50.703418 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.704118 16354 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:50.704555 16205 raft_consensus.cc:2468] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:50.705827 16318 leader_election.cc:304] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:50.706496 16477 raft_consensus.cc:359] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.707324 16477 raft_consensus.cc:385] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.707391 16768 raft_consensus.cc:2804] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.707823 16477 raft_consensus.cc:740] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.707989 16768 raft_consensus.cc:697] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:50.708951 16768 consensus_queue.cc:237] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.709561 16392 leader_election.cc:304] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:50.710424 16755 raft_consensus.cc:2804] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.710819 16755 raft_consensus.cc:493] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.702865 16280 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:50.711336 16755 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.713976 16477 consensus_queue.cc:260] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.716473 16477 ts_tablet_manager.cc:1434] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:16:50.720765 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48becf037f204145949737e10924ba94" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.741500 16274 raft_consensus.cc:2393] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7f2df769fee4fb7894cdbb752cab97e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:50.741619 16473 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:50.721544 16753 leader_election.cc:290] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:50.728833 16771 consensus_queue.cc:1048] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:50.734138 16481 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.743168 16481 ts_tablet_manager.cc:1403] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.000s
I20260709 12:16:50.741652 16477 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:50.691874 16499 leader_election.cc:290] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.735772 16472 ts_tablet_manager.cc:1403] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.000s
I20260709 12:16:50.746201 16481 raft_consensus.cc:359] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.747306 16481 raft_consensus.cc:385] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.747725 16481 raft_consensus.cc:740] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.748834 16481 consensus_queue.cc:260] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.751262 16477 tablet_bootstrap.cc:654] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.751875 16481 ts_tablet_manager.cc:1434] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:50.756824 16472 raft_consensus.cc:359] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.757906 16472 raft_consensus.cc:385] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.758277 16472 raft_consensus.cc:740] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.760994 16481 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:50.736897 16755 raft_consensus.cc:515] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.742214 16473 ts_tablet_manager.cc:1403] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.009s
I20260709 12:16:50.766104 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:50.766805 16274 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.766992 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:50.767680 16354 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.768124 16755 leader_election.cc:290] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.759059 16100 catalog_manager.cc:5697] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.767391 16472 consensus_queue.cc:260] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.784591 16354 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:50.785863 16472 ts_tablet_manager.cc:1434] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:16:50.786001 16392 leader_election.cc:304] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:50.769393 16473 raft_consensus.cc:359] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.787163 16473 raft_consensus.cc:385] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.787525 16473 raft_consensus.cc:740] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.787520 16472 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:50.790007 16755 raft_consensus.cc:2804] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.790582 16755 raft_consensus.cc:697] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:50.794462 16473 consensus_queue.cc:260] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.799621 16204 raft_consensus.cc:3060] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.800958 16477 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.808822 16477 ts_tablet_manager.cc:1403] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.012s
I20260709 12:16:50.804062 16473 ts_tablet_manager.cc:1434] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:16:50.812743 16473 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:50.799228 16755 consensus_queue.cc:237] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:50.818017 16481 tablet_bootstrap.cc:654] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.801756 16472 tablet_bootstrap.cc:654] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.794193 16274 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:50.819980 16477 raft_consensus.cc:359] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.828357 16477 raft_consensus.cc:385] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.835345 16477 raft_consensus.cc:740] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.836848 16499 raft_consensus.cc:493] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.839564 16499 raft_consensus.cc:515] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.839982 16477 consensus_queue.cc:260] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.841949 16499 leader_election.cc:290] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.843413 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.844197 16203 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.845266 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:50.845430 16244 leader_election.cc:304] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:50.845980 16354 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.846299 16765 raft_consensus.cc:2804] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.846719 16477 ts_tablet_manager.cc:1434] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.006s
I20260709 12:16:50.846755 16765 raft_consensus.cc:493] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.847915 16765 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.849155 16477 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:50.839007 16473 tablet_bootstrap.cc:654] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.853340 16753 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.853849 16753 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.855952 16753 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:50.858520 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:50.858395 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:50.861459 16318 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.858363 16102 catalog_manager.cc:5697] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.847380 16472 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:50.868480 16472 ts_tablet_manager.cc:1403] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.000s
I20260709 12:16:50.880039 16481 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:50.880604 16481 ts_tablet_manager.cc:1403] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.011s
W20260709 12:16:50.874029 16318 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.881558 16318 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:50.883172 16753 raft_consensus.cc:2749] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:50.883504 16481 raft_consensus.cc:359] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.884224 16481 raft_consensus.cc:385] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.884495 16481 raft_consensus.cc:740] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.871933 16765 raft_consensus.cc:515] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:50.885892 16392 consensus_peers.cc:597] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:50.886524 16765 leader_election.cc:290] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:50.887677 16477 tablet_bootstrap.cc:654] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.889842 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:50.890560 16203 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.885484 16481 consensus_queue.cc:260] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.894583 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:50.895166 16354 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.898708 16481 ts_tablet_manager.cc:1434] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:50.899700 16481 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
W20260709 12:16:50.902789 16318 consensus_peers.cc:597] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:50.906194 16481 tablet_bootstrap.cc:654] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.907302 16354 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:50.913497 16244 leader_election.cc:304] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:50.923380 16765 raft_consensus.cc:2804] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:50.923935 16765 raft_consensus.cc:697] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:50.924813 16765 consensus_queue.cc:237] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:50.929162 16473 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:50.929682 16473 ts_tablet_manager.cc:1403] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.007s
I20260709 12:16:50.929620 16472 raft_consensus.cc:359] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.930455 16472 raft_consensus.cc:385] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.930755 16472 raft_consensus.cc:740] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.939673 16203 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:50.941766 16753 consensus_queue.cc:1048] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:50.949031 16473 raft_consensus.cc:359] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.951936 16473 raft_consensus.cc:385] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.957535 16473 raft_consensus.cc:740] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.952149 16472 consensus_queue.cc:260] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.960700 16473 consensus_queue.cc:260] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.964293 16472 ts_tablet_manager.cc:1434] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 12:16:50.965373 16472 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:50.965618 16473 ts_tablet_manager.cc:1434] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 12:16:50.966676 16473 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:50.974536 16760 raft_consensus.cc:493] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.975170 16760 raft_consensus.cc:515] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:50.976832 16472 tablet_bootstrap.cc:654] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:50.977540 16760 leader_election.cc:290] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:50.980016 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87730c15a7404b79bbd0af9b86a540eb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:50.981894 16244 leader_election.cc:343] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:50.983887 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87730c15a7404b79bbd0af9b86a540eb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:50.984586 16424 raft_consensus.cc:2468] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:50.988476 16246 leader_election.cc:304] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:50.991139 16477 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:50.991706 16477 ts_tablet_manager.cc:1403] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.019s
I20260709 12:16:50.991906 16499 raft_consensus.cc:2804] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:50.992336 16499 raft_consensus.cc:493] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.992664 16499 raft_consensus.cc:3060] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:50.994431 16477 raft_consensus.cc:359] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:50.996847 16477 raft_consensus.cc:385] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:50.997112 16477 raft_consensus.cc:740] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:50.996380 16100 catalog_manager.cc:5697] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:50.999359 16756 raft_consensus.cc:493] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.000787 16771 raft_consensus.cc:493] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.001327 16771 raft_consensus.cc:515] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.004402 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:51.004952 16771 leader_election.cc:290] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.005576 16477 consensus_queue.cc:260] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
W20260709 12:16:51.006512 16318 leader_election.cc:343] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.006630 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.007840 16426 raft_consensus.cc:2468] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:51.009207 16320 leader_election.cc:304] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:51.010950 16753 raft_consensus.cc:2804] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.011528 16753 raft_consensus.cc:493] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.012048 16753 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.012176 16477 ts_tablet_manager.cc:1434] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:16:51.013785 16477 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:51.000133 16756 raft_consensus.cc:515] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.015981 16499 raft_consensus.cc:515] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.020722 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87730c15a7404b79bbd0af9b86a540eb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:51.021443 16426 raft_consensus.cc:3060] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.030300 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.030678 16756 leader_election.cc:290] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:51.032572 16426 raft_consensus.cc:2468] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:51.032994 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f5375d913f4705865397203673a5f5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:51.034045 16246 leader_election.cc:304] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:51.035109 16765 raft_consensus.cc:2804] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:51.036434 16765 raft_consensus.cc:697] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:51.039839 16477 tablet_bootstrap.cc:654] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:51.044036 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:51.046581 16169 leader_election.cc:304] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:51.049237 16772 raft_consensus.cc:2749] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:51.055511 16755 consensus_queue.cc:1048] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:51.038933 16765 consensus_queue.cc:237] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.081422 16756 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.116210 16756 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.092765 16481 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:51.101677 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87730c15a7404b79bbd0af9b86a540eb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:51.119818 16481 ts_tablet_manager.cc:1403] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.220s	user 0.015s	sys 0.002s
W20260709 12:16:51.120816 16244 leader_election.cc:343] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.121959 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.122654 16349 raft_consensus.cc:2468] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:51.124377 16169 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:51.126219 16756 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.102830 16499 leader_election.cc:290] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:51.133704 16481 raft_consensus.cc:359] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.134760 16481 raft_consensus.cc:385] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.135103 16481 raft_consensus.cc:740] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.111636 16753 raft_consensus.cc:515] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.115562 16473 tablet_bootstrap.cc:654] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.126942 16756 raft_consensus.cc:2804] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.147471 16756 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.136050 16481 consensus_queue.cc:260] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.153115 16756 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.151546 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.160188 16481 ts_tablet_manager.cc:1434] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:16:51.161628 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:51.162352 16481 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
W20260709 12:16:51.165017 16318 leader_election.cc:343] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.170372 16753 leader_election.cc:290] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.172104 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:51.172761 16425 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.173204 16481 tablet_bootstrap.cc:654] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.179539 16204 raft_consensus.cc:3060] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.185637 16555 raft_consensus.cc:493] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.191377 16477 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:51.191942 16477 ts_tablet_manager.cc:1403] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.178s	user 0.022s	sys 0.025s
I20260709 12:16:51.194015 16472 tablet_bootstrap.cc:492] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:51.195489 16472 ts_tablet_manager.cc:1403] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.230s	user 0.082s	sys 0.067s
W20260709 12:16:51.195062 16171 leader_election.cc:343] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.191277 16555 raft_consensus.cc:515] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.200868 16477 raft_consensus.cc:359] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.201753 16477 raft_consensus.cc:385] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.202056 16477 raft_consensus.cc:740] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.203022 16555 leader_election.cc:290] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:51.202783 16477 consensus_queue.cc:260] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.218801 16477 ts_tablet_manager.cc:1434] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
W20260709 12:16:51.230517 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 48205us
I20260709 12:16:51.234186 16477 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:51.242200 16473 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:51.242911 16473 ts_tablet_manager.cc:1403] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.276s	user 0.012s	sys 0.013s
I20260709 12:16:51.250388 16481 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:51.251724 16481 ts_tablet_manager.cc:1403] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.003s
I20260709 12:16:51.261438 16473 raft_consensus.cc:359] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.262203 16473 raft_consensus.cc:385] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.262477 16473 raft_consensus.cc:740] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.266391 16477 tablet_bootstrap.cc:654] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.269377 16473 consensus_queue.cc:260] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.273838 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6155e95b762495aab0bd4e75cfbe8f8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:51.277381 16473 ts_tablet_manager.cc:1434] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:16:51.278654 16473 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:51.240700 16499 raft_consensus.cc:493] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.282184 16100 catalog_manager.cc:5697] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.270846 16756 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.295265 16756 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.296505 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6155e95b762495aab0bd4e75cfbe8f8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.297267 16352 raft_consensus.cc:2468] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
W20260709 12:16:51.298062 16392 leader_election.cc:343] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.291824 16499 raft_consensus.cc:515] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.299480 16425 raft_consensus.cc:2468] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:51.303391 16472 raft_consensus.cc:359] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.304174 16472 raft_consensus.cc:385] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.304450 16472 raft_consensus.cc:740] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.305959 16472 consensus_queue.cc:260] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.315019 16472 ts_tablet_manager.cc:1434] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.000s
I20260709 12:16:51.309753 16481 raft_consensus.cc:359] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.315716 16481 raft_consensus.cc:385] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.315968 16481 raft_consensus.cc:740] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.331683 16392 leader_election.cc:304] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:51.324635 16768 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.334589 16774 raft_consensus.cc:2804] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.339598 16774 raft_consensus.cc:493] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.339977 16774 raft_consensus.cc:3060] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.343048 16477 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:51.342973 16499 leader_election.cc:290] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:51.344723 16477 ts_tablet_manager.cc:1403] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.006s
I20260709 12:16:51.350737 16472 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:51.352509 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c0d5bee584f93ac4b342c7b129ecd" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.354434 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:51.357913 16246 leader_election.cc:343] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.360774 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c0d5bee584f93ac4b342c7b129ecd" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:51.361497 16481 consensus_queue.cc:260] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.361536 16202 raft_consensus.cc:2468] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:51.346125 16320 leader_election.cc:304] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:51.366930 16244 leader_election.cc:304] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:51.367992 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:51.368752 16349 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.377334 16827 consensus_queue.cc:1048] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:51.378356 16850 consensus_queue.cc:1048] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:51.368508 16760 raft_consensus.cc:2804] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.386828 16481 ts_tablet_manager.cc:1434] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.135s	user 0.009s	sys 0.002s
I20260709 12:16:51.388103 16473 tablet_bootstrap.cc:654] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:51.399118 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 64445.4us
I20260709 12:16:51.391669 16850 raft_consensus.cc:2804] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:51.402501 16753 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.347653 16768 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.403051 16753 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.404945 16768 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:51.406687 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:51.408895 16318 leader_election.cc:343] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.404970 16753 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:51.410954 16477 raft_consensus.cc:359] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.412187 16477 raft_consensus.cc:385] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.384116 16760 raft_consensus.cc:493] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.416405 16760 raft_consensus.cc:3060] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.416967 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:51.417846 16850 raft_consensus.cc:697] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:51.418881 16850 consensus_queue.cc:237] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.420135 16846 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:51.420444 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:51.412478 16477 raft_consensus.cc:740] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.426443 16477 consensus_queue.cc:260] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.439018 16477 ts_tablet_manager.cc:1434] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.001s
I20260709 12:16:51.440662 16481 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:51.444067 16477 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:51.427803 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.424433 16846 raft_consensus.cc:493] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.446683 16499 raft_consensus.cc:493] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:51.496479 16171 leader_election.cc:343] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:51.500772 16318 leader_election.cc:343] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.501214 16318 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
W20260709 12:16:51.502214 16318 leader_election.cc:343] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.503209 16753 raft_consensus.cc:2749] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:51.504436 16855 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.504974 16855 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.486720 16774 raft_consensus.cc:515] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.510434 16853 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:51.522768 16481 tablet_bootstrap.cc:654] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.472718 16846 raft_consensus.cc:515] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.483912 16499 raft_consensus.cc:515] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.535419 16426 raft_consensus.cc:3060] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.536762 16349 raft_consensus.cc:2468] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:51.539897 16169 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:51.541390 16851 raft_consensus.cc:2804] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:51.541901 16851 raft_consensus.cc:697] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:51.529273 16765 consensus_queue.cc:1048] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:16:51.544441 16757 consensus_queue.cc:1048] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:51.537161 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.551105 16347 raft_consensus.cc:2468] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
W20260709 12:16:51.551878 16320 leader_election.cc:343] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.552380 16320 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:51.553421 16499 leader_election.cc:290] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.553434 16850 raft_consensus.cc:2749] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:51.556440 16472 tablet_bootstrap.cc:654] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.556793 16169 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:51.560225 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.563863 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.564690 16424 raft_consensus.cc:2393] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:51.565964 16246 leader_election.cc:304] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:51.567456 16757 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.567310 16102 catalog_manager.cc:5697] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.568964 16846 leader_election.cc:290] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:51.542768 16851 consensus_queue.cc:237] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.583077 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:51.578752 16756 raft_consensus.cc:2804] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.590679 16756 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.591136 16756 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.621740 16477 tablet_bootstrap.cc:654] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.613997 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:51.603847 16855 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
W20260709 12:16:51.625895 16171 leader_election.cc:343] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.630309 16473 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:51.636531 16473 ts_tablet_manager.cc:1403] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.358s	user 0.017s	sys 0.002s
I20260709 12:16:51.627375 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:51.639048 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6155e95b762495aab0bd4e75cfbe8f8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:51.646173 16760 raft_consensus.cc:515] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.661247 16347 raft_consensus.cc:3060] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.677565 16473 raft_consensus.cc:359] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.685808 16473 raft_consensus.cc:385] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.686110 16473 raft_consensus.cc:740] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.660620 16774 leader_election.cc:290] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:51.685238 16867 log.cc:927] Time spent T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:16:51.686740 16473 consensus_queue.cc:260] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:51.727065 16760 leader_election.cc:290] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:51.728628 16472 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:51.729190 16472 ts_tablet_manager.cc:1403] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.379s	user 0.014s	sys 0.003s
I20260709 12:16:51.735054 16473 ts_tablet_manager.cc:1434] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 12:16:51.736958 16473 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:51.744961 16392 leader_election.cc:304] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:51.749199 16472 raft_consensus.cc:359] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.757241 16472 raft_consensus.cc:385] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.757675 16472 raft_consensus.cc:740] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.748049 16757 raft_consensus.cc:2749] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:51.761314 16472 consensus_queue.cc:260] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.752444 16853 raft_consensus.cc:2749] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:51.771087 16472 ts_tablet_manager.cc:1434] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.003s
I20260709 12:16:51.772316 16472 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:51.772869 16481 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:51.773615 16481 ts_tablet_manager.cc:1403] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.333s	user 0.026s	sys 0.030s
I20260709 12:16:51.739019 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6155e95b762495aab0bd4e75cfbe8f8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
W20260709 12:16:51.786765 16244 consensus_peers.cc:597] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:51.786849 16866 log.cc:927] Time spent T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Append to log took a long time: real 0.129s	user 0.004s	sys 0.000s
I20260709 12:16:51.789426 16347 raft_consensus.cc:2468] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:51.791411 16392 leader_election.cc:304] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:51.792356 16472 tablet_bootstrap.cc:654] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.794202 16473 tablet_bootstrap.cc:654] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.793756 16102 catalog_manager.cc:5697] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.794665 16846 raft_consensus.cc:2804] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:51.795171 16846 raft_consensus.cc:697] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:51.796010 16846 consensus_queue.cc:237] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
W20260709 12:16:51.798059 16868 log.cc:927] Time spent T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:16:51.798377 16481 raft_consensus.cc:359] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.799226 16481 raft_consensus.cc:385] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.801843 16481 raft_consensus.cc:740] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.802816 16481 consensus_queue.cc:260] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.805322 16481 ts_tablet_manager.cc:1434] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:16:51.805889 16758 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.806434 16758 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.817785 16758 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:51.808332 16200 raft_consensus.cc:3060] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.821686 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
W20260709 12:16:51.823145 16244 leader_election.cc:343] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:51.824458 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c0d5bee584f93ac4b342c7b129ecd" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:51.825445 16201 raft_consensus.cc:3060] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.840078 16481 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:51.848837 16477 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:51.849656 16477 ts_tablet_manager.cc:1403] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.406s	user 0.029s	sys 0.025s
I20260709 12:16:51.806980 16756 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.888422 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:51.889175 16348 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:51.891145 16244 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:51.894176 16877 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:51.894546 16877 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.894861 16877 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.897746 16753 consensus_queue.cc:1048] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:51.909698 16756 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:51.910082 16481 tablet_bootstrap.cc:654] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.916527 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:51.917269 16347 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.921988 16753 consensus_queue.cc:1048] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:51.932307 16472 tablet_bootstrap.cc:492] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:51.937165 16472 ts_tablet_manager.cc:1403] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.165s	user 0.044s	sys 0.060s
I20260709 12:16:51.948684 16472 raft_consensus.cc:359] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.952171 16472 raft_consensus.cc:385] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.952461 16472 raft_consensus.cc:740] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.953120 16472 consensus_queue.cc:260] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:51.955206 16472 ts_tablet_manager.cc:1434] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:16:51.955842 16477 raft_consensus.cc:359] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.958207 16477 raft_consensus.cc:385] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:51.958463 16477 raft_consensus.cc:740] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:51.960748 16477 consensus_queue.cc:260] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:51.963037 16477 ts_tablet_manager.cc:1434] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 12:16:51.967945 16481 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:51.968793 16481 ts_tablet_manager.cc:1403] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.160s	user 0.002s	sys 0.014s
I20260709 12:16:51.951049 16347 raft_consensus.cc:2468] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:51.974671 16169 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:51.975512 16772 raft_consensus.cc:2804] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:51.976115 16772 raft_consensus.cc:697] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:51.977159 16772 consensus_queue.cc:237] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:51.978845 16100 catalog_manager.cc:5697] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.982818 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:51.984923 16477 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:51.989024 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c0d5bee584f93ac4b342c7b129ecd" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:51.989662 16425 raft_consensus.cc:3060] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:51.990690 16472 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:51.991734 16477 tablet_bootstrap.cc:654] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:51.997989 16472 tablet_bootstrap.cc:654] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.012419 16201 raft_consensus.cc:2468] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:52.014220 16870 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.014943 16870 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.018671 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:52.019507 16870 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:52.022204 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.023221 16350 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:52.025146 16855 consensus_queue.cc:1048] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:51.968104 16200 raft_consensus.cc:2468] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:52.035187 16169 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:16:52.039968 16244 leader_election.cc:304] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:52.044055 16875 raft_consensus.cc:2804] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.044862 16875 raft_consensus.cc:697] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:52.046115 16875 consensus_queue.cc:237] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.043294 16870 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:52.066102 16473 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:52.066715 16473 ts_tablet_manager.cc:1403] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.330s	user 0.022s	sys 0.012s
I20260709 12:16:52.068449 16877 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.069132 16425 raft_consensus.cc:2468] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:52.072046 16276 raft_consensus.cc:2393] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:52.059892 16870 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.072871 16870 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.084623 16481 raft_consensus.cc:359] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.085690 16481 raft_consensus.cc:385] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.086191 16481 raft_consensus.cc:740] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.091790 16877 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:52.089386 16473 raft_consensus.cc:359] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.094483 16473 raft_consensus.cc:385] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.094956 16473 raft_consensus.cc:740] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.092845 16481 consensus_queue.cc:260] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.269115 16771 raft_consensus.cc:493] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.097429 16870 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.281032 16870 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:52.270565 16771 raft_consensus.cc:515] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.283025 16477 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:52.290145 16477 ts_tablet_manager.cc:1403] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.305s	user 0.016s	sys 0.014s
I20260709 12:16:52.294587 16472 tablet_bootstrap.cc:492] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:52.287034 16771 leader_election.cc:290] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:52.257354 16473 consensus_queue.cc:260] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.313449 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:52.314384 16853 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.314780 16347 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.346515 16477 raft_consensus.cc:359] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.347640 16477 raft_consensus.cc:385] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.348047 16477 raft_consensus.cc:740] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.315315 16853 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.348897 16477 consensus_queue.cc:260] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.322018 16472 ts_tablet_manager.cc:1403] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.332s	user 0.030s	sys 0.004s
I20260709 12:16:52.324021 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:52.327396 16765 raft_consensus.cc:493] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.351429 16765 raft_consensus.cc:515] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.353425 16274 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.354363 16765 leader_election.cc:290] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:52.364437 16852 raft_consensus.cc:493] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.365293 16852 raft_consensus.cc:515] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.368137 16852 leader_election.cc:290] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:52.372056 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:52.379808 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.343513 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:52.381655 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:52.382766 16279 raft_consensus.cc:2393] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:52.346422 16873 consensus_queue.cc:1048] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:52.351032 16477 ts_tablet_manager.cc:1434] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.004s
W20260709 12:16:52.342800 16171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 147396us
I20260709 12:16:52.366849 16853 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:52.371037 16473 ts_tablet_manager.cc:1434] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.304s	user 0.007s	sys 0.003s
I20260709 12:16:52.365310 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:52.395061 16204 raft_consensus.cc:2393] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:52.391973 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:52.404685 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.414429 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:52.416723 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:52.419461 16473 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
W20260709 12:16:52.420432 16318 leader_election.cc:343] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.405671 16853 consensus_queue.cc:1048] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:16:52.448256 16318 leader_election.cc:343] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:52.445667 16171 leader_election.cc:343] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:52.460067 16890 log.cc:927] Time spent T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: Append to log took a long time: real 0.149s	user 0.004s	sys 0.000s
I20260709 12:16:52.459928 16477 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:52.467391 16171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 53404.9us
I20260709 12:16:52.472076 16347 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:52.474501 16244 leader_election.cc:304] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:52.485898 16472 raft_consensus.cc:359] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.487104 16472 raft_consensus.cc:385] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.488044 16472 raft_consensus.cc:740] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.494797 16771 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.495563 16425 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.495689 16771 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.498137 16771 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:52.499184 16477 tablet_bootstrap.cc:654] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.500154 16481 ts_tablet_manager.cc:1434] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.531s	user 0.018s	sys 0.018s
W20260709 12:16:52.500686 16481 ts_tablet_manager.cc:1467] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Tablet startup took 531ms
I20260709 12:16:52.504662 16244 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:52.505110 16169 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:52.505697 16877 raft_consensus.cc:2749] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.506403 16849 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.507035 16849 raft_consensus.cc:697] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
W20260709 12:16:52.501046 16481 ts_tablet_manager.cc:1469] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: Trace:
0709 12:16:43.953359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.506843 (+553484us) service_pool.cc:224] Handling call
0709 12:16:44.508834 (+  1991us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:44.508928 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:44.639551 (+130623us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:44.722200 (+ 82649us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:44.732636 (+ 10436us) inbound_call.cc:177] Queueing success response
0709 12:16:51.809016 (+7076380us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:16:51.969133 (+160117us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:16:52.075519 (+106386us) tablet_replica.cc:261] Starting instrumentation
0709 12:16:52.076111 (+   592us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":15657,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":372,"tablet-open.queue_time_us":7084611,"thread_start_us":147626,"threads_started":1}
I20260709 12:16:52.513284 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:52.509119 16320 leader_election.cc:343] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.515502 16320 leader_election.cc:304] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
W20260709 12:16:52.520824 16318 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.523161 16770 raft_consensus.cc:2749] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.523888 16472 consensus_queue.cc:260] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.540555 16757 raft_consensus.cc:2749] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.522686 16849 consensus_queue.cc:237] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.547601 16472 ts_tablet_manager.cc:1434] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.198s	user 0.009s	sys 0.000s
I20260709 12:16:52.549196 16472 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:52.561350 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:52.573129 16100 catalog_manager.cc:5697] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:52.574576 16473 tablet_bootstrap.cc:654] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.584874 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:52.586130 16477 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:52.586690 16477 ts_tablet_manager.cc:1403] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.002s
I20260709 12:16:52.590109 16477 raft_consensus.cc:359] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.590921 16477 raft_consensus.cc:385] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.591205 16477 raft_consensus.cc:740] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.593830 16477 consensus_queue.cc:260] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.600476 16851 consensus_queue.cc:1048] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:16:52.604903 16481 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:52.606868 16472 tablet_bootstrap.cc:654] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.599272 16477 ts_tablet_manager.cc:1434] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
W20260709 12:16:52.611559 16318 leader_election.cc:343] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:52.614573 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 107638us
I20260709 12:16:52.620406 16772 raft_consensus.cc:493] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.618784 16765 consensus_queue.cc:1048] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:52.655145 16318 leader_election.cc:304] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:52.655968 16477 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:52.621758 16481 tablet_bootstrap.cc:654] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:52.656235 16318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 44707.9us
I20260709 12:16:52.658267 16771 raft_consensus.cc:2749] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.658897 16772 raft_consensus.cc:515] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.634720 16102 catalog_manager.cc:5697] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:52.657959 16318 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.660506 16318 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:52.661271 16852 raft_consensus.cc:2749] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.661373 16772 leader_election.cc:290] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:52.640334 16894 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.665416 16477 tablet_bootstrap.cc:654] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.665035 16894 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.642356 16893 consensus_queue.cc:1048] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:52.668910 16894 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:52.677644 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:52.689941 16473 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:52.690757 16473 ts_tablet_manager.cc:1403] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.017s
I20260709 12:16:52.692121 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:52.697532 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:52.699683 16473 raft_consensus.cc:359] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.700081 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.705035 16348 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:52.699949 16477 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:52.702211 16472 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:52.705444 16853 consensus_queue.cc:1048] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:52.707301 16171 leader_election.cc:343] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:52.709003 16171 leader_election.cc:343] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.709160 16472 ts_tablet_manager.cc:1403] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.160s	user 0.005s	sys 0.010s
I20260709 12:16:52.713141 16472 raft_consensus.cc:359] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.706280 16477 ts_tablet_manager.cc:1403] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
W20260709 12:16:52.713801 16171 consensus_peers.cc:597] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e -> Peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Couldn't send request to peer bde8efa60f914da8a818213518c2b4ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.713966 16473 raft_consensus.cc:385] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.723533 16473 raft_consensus.cc:740] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.724501 16473 consensus_queue.cc:260] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.715971 16169 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:52.719774 16875 consensus_queue.cc:1048] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:52.726249 16477 raft_consensus.cc:359] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.727391 16772 raft_consensus.cc:2804] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:52.727046 16477 raft_consensus.cc:385] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.727825 16772 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.728331 16472 raft_consensus.cc:385] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.729668 16472 raft_consensus.cc:740] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.730491 16472 consensus_queue.cc:260] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.732923 16472 ts_tablet_manager.cc:1434] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:16:52.728463 16477 raft_consensus.cc:740] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.728286 16772 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.734019 16477 consensus_queue.cc:260] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.741065 16473 ts_tablet_manager.cc:1434] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.003s
I20260709 12:16:52.742458 16473 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:52.741255 16477 ts_tablet_manager.cc:1434] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:52.746965 16477 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:52.753453 16477 tablet_bootstrap.cc:654] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.745769 16472 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:52.763123 16472 tablet_bootstrap.cc:654] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.764981 16392 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
W20260709 12:16:52.755631 16169 leader_election.cc:343] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.765713 16169 leader_election.cc:304] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:52.756215 16772 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.765901 16846 raft_consensus.cc:2749] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.767783 16894 raft_consensus.cc:2749] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:52.769393 16772 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:52.770525 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:52.773993 16171 leader_election.cc:343] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.775508 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:52.776206 16348 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.787963 16348 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:52.796983 16472 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:52.797557 16472 ts_tablet_manager.cc:1403] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.004s
I20260709 12:16:52.798432 16169 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:52.794543 16481 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:52.799311 16894 raft_consensus.cc:2804] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.799598 16481 ts_tablet_manager.cc:1403] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.005s
I20260709 12:16:52.799824 16894 raft_consensus.cc:697] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:52.800765 16894 consensus_queue.cc:237] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:52.802480 16481 raft_consensus.cc:359] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.803617 16481 raft_consensus.cc:385] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.803879 16481 raft_consensus.cc:740] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.805698 16472 raft_consensus.cc:359] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.806432 16472 raft_consensus.cc:385] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.807546 16472 raft_consensus.cc:740] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.807022 16481 consensus_queue.cc:260] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.807770 16102 catalog_manager.cc:5697] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.809623 16472 consensus_queue.cc:260] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.815827 16772 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.836504 16481 ts_tablet_manager.cc:1434] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:16:52.841398 16473 tablet_bootstrap.cc:654] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.847666 16481 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: Bootstrap starting.
I20260709 12:16:52.849385 16760 raft_consensus.cc:493] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.849967 16760 raft_consensus.cc:515] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.852381 16472 ts_tablet_manager.cc:1434] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.054s	user 0.002s	sys 0.005s
I20260709 12:16:52.857491 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.858280 16347 raft_consensus.cc:2468] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:52.859647 16244 leader_election.cc:304] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:52.860364 16765 raft_consensus.cc:2804] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:52.860731 16765 raft_consensus.cc:493] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.852200 16760 leader_election.cc:290] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:52.861059 16765 raft_consensus.cc:3060] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:52.866014 16149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:52.839716 16772 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.877614 16772 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:52.879225 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:52.879853 16472 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:52.880899 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:52.881594 16347 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:52.883381 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:52.888475 16169 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:52.889077 16244 leader_election.cc:343] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:52.889192 16169 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:52.890029 16893 raft_consensus.cc:2804] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:52.890424 16893 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.890749 16893 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.892653 16481 tablet_bootstrap.cc:654] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.893913 16472 tablet_bootstrap.cc:654] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.897612 16477 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:52.898083 16477 ts_tablet_manager.cc:1403] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.006s
I20260709 12:16:52.923566 16477 raft_consensus.cc:359] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.924584 16477 raft_consensus.cc:385] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.924918 16477 raft_consensus.cc:740] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.939805 16477 consensus_queue.cc:260] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:52.953311 16893 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:52.954232 16472 tablet_bootstrap.cc:492] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:52.954829 16472 ts_tablet_manager.cc:1403] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.013s
I20260709 12:16:52.966425 16758 raft_consensus.cc:493] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.967017 16758 raft_consensus.cc:515] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:52.999079 16758 leader_election.cc:290] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:53.002408 16851 consensus_queue.cc:1048] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:53.010345 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:53.019573 16473 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.011072 16894 consensus_queue.cc:1048] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:53.002786 16472 raft_consensus.cc:359] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.021718 16472 raft_consensus.cc:385] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.022029 16472 raft_consensus.cc:740] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.022679 16472 consensus_queue.cc:260] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.023279 16473 ts_tablet_manager.cc:1403] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.281s	user 0.015s	sys 0.027s
I20260709 12:16:53.031026 16473 raft_consensus.cc:359] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.031810 16473 raft_consensus.cc:385] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.032164 16473 raft_consensus.cc:740] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.031589 16103 catalog_manager.cc:5697] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.033296 16472 ts_tablet_manager.cc:1434] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 12:16:53.034485 16472 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:53.036944 16473 consensus_queue.cc:260] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.041824 16477 ts_tablet_manager.cc:1434] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.000s
I20260709 12:16:53.047514 16477 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:53.015865 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:53.016131 16765 raft_consensus.cc:515] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.053638 16765 leader_election.cc:290] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:53.057191 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:53.057542 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:53.051146 16473 ts_tablet_manager.cc:1434] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:16:53.058118 16354 raft_consensus.cc:3060] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.059319 16473 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
W20260709 12:16:53.060406 16244 leader_election.cc:343] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.063016 16246 leader_election.cc:304] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:53.063971 16274 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.064471 16894 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.065054 16894 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.066283 16473 tablet_bootstrap.cc:654] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.056422 16472 tablet_bootstrap.cc:654] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.071127 16894 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:53.079226 16354 raft_consensus.cc:2468] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:53.080892 16244 leader_election.cc:304] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:53.074288 16893 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:53.090737 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:53.088932 16760 raft_consensus.cc:2804] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.093302 16760 raft_consensus.cc:697] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:53.094246 16760 consensus_queue.cc:237] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.094565 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:53.097434 16352 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.102304 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:53.083141 16758 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.106348 16758 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.109211 16280 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 0.
I20260709 12:16:53.113150 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:53.114089 16204 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:53.118253 16244 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.119429 16875 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.120100 16875 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.120595 16875 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.126994 16846 raft_consensus.cc:493] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.127931 16846 raft_consensus.cc:515] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.131352 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:53.133850 16426 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.136997 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:53.138613 16246 leader_election.cc:343] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:53.141860 16171 leader_election.cc:343] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.145437 16758 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.159523 16481 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: No bootstrap required, opened a new log
I20260709 12:16:53.160071 16481 ts_tablet_manager.cc:1403] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: Time spent bootstrapping tablet: real 0.313s	user 0.049s	sys 0.088s
I20260709 12:16:53.166190 16472 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:53.166893 16472 ts_tablet_manager.cc:1403] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.133s	user 0.044s	sys 0.044s
W20260709 12:16:53.166939 16169 leader_election.cc:343] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.167788 16169 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:53.170869 16772 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.171326 16772 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.171674 16772 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.173352 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:53.173470 16472 raft_consensus.cc:359] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.174105 16277 raft_consensus.cc:2468] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:53.174460 16472 raft_consensus.cc:385] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.174865 16472 raft_consensus.cc:740] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.162894 16481 raft_consensus.cc:359] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.175688 16481 raft_consensus.cc:385] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.175976 16481 raft_consensus.cc:740] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.176714 16481 consensus_queue.cc:260] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.182217 16472 consensus_queue.cc:260] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.191942 16477 tablet_bootstrap.cc:654] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.196384 16473 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.196872 16473 ts_tablet_manager.cc:1403] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.009s
I20260709 12:16:53.186508 16875 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.202621 16875 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.203436 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
W20260709 12:16:53.207473 16246 leader_election.cc:343] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.208230 16765 raft_consensus.cc:2749] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.205737 16772 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.209327 16473 raft_consensus.cc:359] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.210120 16473 raft_consensus.cc:385] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.210412 16473 raft_consensus.cc:740] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.211071 16472 ts_tablet_manager.cc:1434] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:16:53.211688 16846 leader_election.cc:290] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:53.212110 16472 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:53.211990 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:53.212519 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:53.213400 16202 raft_consensus.cc:2393] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:53.213743 16772 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:53.214696 16244 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:53.215044 16477 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:53.215396 16875 raft_consensus.cc:2749] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.212262 16473 consensus_queue.cc:260] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.216106 16426 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.215607 16477 ts_tablet_manager.cc:1403] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.000s
I20260709 12:16:53.224396 16426 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:53.225301 16472 tablet_bootstrap.cc:654] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.225184 16392 leader_election.cc:304] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.226096 16846 raft_consensus.cc:2804] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.226159 16171 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:53.226739 16846 raft_consensus.cc:493] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.227185 16846 raft_consensus.cc:3060] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.229934 16481 ts_tablet_manager.cc:1434] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:16:53.231503 16477 raft_consensus.cc:359] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.232265 16477 raft_consensus.cc:385] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.232537 16477 raft_consensus.cc:740] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.233270 16477 consensus_queue.cc:260] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.235772 16473 ts_tablet_manager.cc:1434] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:16:53.227156 16772 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.236652 16772 raft_consensus.cc:697] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:53.232805 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:53.238184 16354 raft_consensus.cc:2468] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 0.
I20260709 12:16:53.237851 16772 consensus_queue.cc:237] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.240742 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:53.241600 16274 raft_consensus.cc:2393] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371b664722e94372a346a6d621adaa9e in current term 1: Already voted for candidate d4b26d78497741df932d87016bbc9a15 in this term.
I20260709 12:16:53.235028 16477 ts_tablet_manager.cc:1434] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:16:53.255977 16477 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:53.256078 16472 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:53.256579 16472 ts_tablet_manager.cc:1403] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.012s
I20260709 12:16:53.259624 16472 raft_consensus.cc:359] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.260334 16472 raft_consensus.cc:385] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.260617 16472 raft_consensus.cc:740] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.261397 16472 consensus_queue.cc:260] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.264493 16472 ts_tablet_manager.cc:1434] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:53.264334 16893 consensus_queue.cc:1048] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:53.266897 16477 tablet_bootstrap.cc:654] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.269006 16896 raft_consensus.cc:493] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.269531 16896 raft_consensus.cc:515] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.270752 16473 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:53.273075 16896 leader_election.cc:290] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:53.273341 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:53.274979 16320 leader_election.cc:343] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.278081 16473 tablet_bootstrap.cc:654] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.277576 16101 catalog_manager.cc:5697] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.225821 16352 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 1.
I20260709 12:16:53.284435 16169 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: d4b26d78497741df932d87016bbc9a15
I20260709 12:16:53.285283 16472 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: Bootstrap starting.
I20260709 12:16:53.285661 16851 raft_consensus.cc:2804] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.286651 16851 raft_consensus.cc:697] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:16:53.287639 16851 consensus_queue.cc:237] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.296317 16472 tablet_bootstrap.cc:654] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.307250 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:53.308787 16472 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: No bootstrap required, opened a new log
I20260709 12:16:53.309319 16472 ts_tablet_manager.cc:1403] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 12:16:53.312107 16472 raft_consensus.cc:359] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.313038 16472 raft_consensus.cc:385] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:53.317255 16318 leader_election.cc:343] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.317853 16318 leader_election.cc:304] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:53.319064 16895 raft_consensus.cc:2749] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.320475 16473 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.321012 16473 ts_tablet_manager.cc:1403] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:16:53.313403 16472 raft_consensus.cc:740] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.329417 16472 consensus_queue.cc:260] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.331871 16472 ts_tablet_manager.cc:1434] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:16:53.339768 16477 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:53.324239 16473 raft_consensus.cc:359] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.340312 16473 raft_consensus.cc:385] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.340368 16477 ts_tablet_manager.cc:1403] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.020s
I20260709 12:16:53.340693 16473 raft_consensus.cc:740] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.343503 16477 raft_consensus.cc:359] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.344233 16477 raft_consensus.cc:385] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.344506 16477 raft_consensus.cc:740] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.345117 16477 consensus_queue.cc:260] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.347167 16477 ts_tablet_manager.cc:1434] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
W20260709 12:16:53.351701 16171 consensus_peers.cc:597] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e -> Peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Couldn't send request to peer bde8efa60f914da8a818213518c2b4ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:53.352623 16477 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:53.353747 16473 consensus_queue.cc:260] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.354818 16900 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.355302 16900 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.345647 16846 raft_consensus.cc:515] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.359715 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:53.360899 16900 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.361104 16477 tablet_bootstrap.cc:654] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.362082 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:53.362262 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:53.362903 16273 raft_consensus.cc:3060] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.363844 16392 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:53.366852 16900 raft_consensus.cc:2749] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.374935 16473 ts_tablet_manager.cc:1434] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:16:53.377139 16473 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:53.387676 16473 tablet_bootstrap.cc:654] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.402609 16846 leader_election.cc:290] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:53.371255 16273 raft_consensus.cc:2468] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:53.403030 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2d7819347af4afca9881790734e9619" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:53.403735 16352 raft_consensus.cc:3060] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.405669 16392 leader_election.cc:304] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.406529 16846 raft_consensus.cc:2804] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.406626 16477 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: No bootstrap required, opened a new log
I20260709 12:16:53.407207 16846 raft_consensus.cc:697] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:53.407330 16477 ts_tablet_manager.cc:1403] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.025s
I20260709 12:16:53.408177 16846 consensus_queue.cc:237] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.409991 16477 raft_consensus.cc:359] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.410634 16477 raft_consensus.cc:385] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.410867 16477 raft_consensus.cc:740] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.411473 16477 consensus_queue.cc:260] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.411769 16352 raft_consensus.cc:2468] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:53.414906 16477 ts_tablet_manager.cc:1434] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:53.420898 16473 tablet_bootstrap.cc:492] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.421515 16473 ts_tablet_manager.cc:1403] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.001s
I20260709 12:16:53.425400 16473 raft_consensus.cc:359] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.426235 16473 raft_consensus.cc:385] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.426342 16202 raft_consensus.cc:3060] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.426613 16473 raft_consensus.cc:740] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.427896 16473 consensus_queue.cc:260] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.434715 16103 catalog_manager.cc:5697] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.436625 16103 catalog_manager.cc:5697] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 1 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.438001 16473 ts_tablet_manager.cc:1434] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:53.447556 16473 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:53.453009 16895 raft_consensus.cc:493] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.453630 16895 raft_consensus.cc:515] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.454411 16473 tablet_bootstrap.cc:654] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.453732 16101 catalog_manager.cc:5697] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 1 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.456180 16895 leader_election.cc:290] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.460035 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f71fc08eaff42d5901a4921f0051394" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:53.460863 16200 raft_consensus.cc:2468] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 0.
I20260709 12:16:53.461468 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f71fc08eaff42d5901a4921f0051394" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:53.462903 16473 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.463425 16473 ts_tablet_manager.cc:1403] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.009s
W20260709 12:16:53.463610 16320 leader_election.cc:343] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.464385 16318 leader_election.cc:304] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:53.465433 16896 raft_consensus.cc:2804] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.465801 16896 raft_consensus.cc:493] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.466135 16896 raft_consensus.cc:3060] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.466162 16473 raft_consensus.cc:359] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.467121 16473 raft_consensus.cc:385] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.467408 16473 raft_consensus.cc:740] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.468111 16473 consensus_queue.cc:260] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.475410 16896 raft_consensus.cc:515] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.472057 16473 ts_tablet_manager.cc:1434] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:53.484305 16896 leader_election.cc:290] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.487028 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f71fc08eaff42d5901a4921f0051394" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:53.487097 16875 raft_consensus.cc:493] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.487792 16426 raft_consensus.cc:3060] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.487870 16875 raft_consensus.cc:515] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.484409 16473 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: Bootstrap starting.
I20260709 12:16:53.491562 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:53.492084 16875 leader_election.cc:290] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.492177 16200 raft_consensus.cc:2468] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:53.493381 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f71fc08eaff42d5901a4921f0051394" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:53.493727 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:53.494341 16244 leader_election.cc:304] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
W20260709 12:16:53.497777 16246 leader_election.cc:343] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.495744 16473 tablet_bootstrap.cc:654] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.496184 16426 raft_consensus.cc:2468] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:53.500643 16875 raft_consensus.cc:2804] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.501072 16875 raft_consensus.cc:493] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.501387 16875 raft_consensus.cc:3060] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.502610 16320 leader_election.cc:304] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:53.506084 16895 raft_consensus.cc:2804] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.506783 16473 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: No bootstrap required, opened a new log
I20260709 12:16:53.506910 16895 raft_consensus.cc:697] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:53.507573 16473 ts_tablet_manager.cc:1403] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.012s
I20260709 12:16:53.508184 16895 consensus_queue.cc:237] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:53.509172 16202 raft_consensus.cc:3060] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.510517 16473 raft_consensus.cc:359] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.511314 16473 raft_consensus.cc:385] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.511831 16473 raft_consensus.cc:740] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.512624 16473 consensus_queue.cc:260] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.515486 16473 ts_tablet_manager.cc:1434] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:16:53.516990 16875 raft_consensus.cc:515] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.517005 16202 raft_consensus.cc:2468] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:53.520223 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:53.520925 16426 raft_consensus.cc:3060] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.521503 16765 raft_consensus.cc:493] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.522042 16765 raft_consensus.cc:515] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.524300 16765 leader_election.cc:290] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:53.525416 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:53.525691 16875 leader_election.cc:290] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:53.526158 16347 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:53.526707 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e"
I20260709 12:16:53.527334 16202 raft_consensus.cc:3060] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.527428 16244 leader_election.cc:304] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.527660 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:53.528407 16424 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 0.
I20260709 12:16:53.528424 16875 raft_consensus.cc:2804] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.528992 16875 raft_consensus.cc:493] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.529321 16875 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.535001 16202 raft_consensus.cc:2468] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:53.541219 16426 raft_consensus.cc:2468] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:53.545378 16244 leader_election.cc:304] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.546317 16765 raft_consensus.cc:2804] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.546932 16765 raft_consensus.cc:697] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:53.547914 16765 consensus_queue.cc:237] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:53.553273 16202 raft_consensus.cc:3060] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.543000 16875 raft_consensus.cc:515] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.557834 16875 leader_election.cc:290] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:53.566545 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:53.567215 16347 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.569295 16101 catalog_manager.cc:5697] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.573247 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:53.573385 16765 consensus_queue.cc:1048] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:53.573915 16426 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.583357 16426 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:53.583550 16103 catalog_manager.cc:5697] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 1 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.585942 16875 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.586452 16347 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:53.586804 16875 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:53.585983 16246 leader_election.cc:304] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:53.588964 16875 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:53.589565 16765 raft_consensus.cc:2804] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.590065 16765 raft_consensus.cc:697] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:53.590911 16765 consensus_queue.cc:237] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:53.592921 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:53.593300 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b664722e94372a346a6d621adaa9e" is_pre_election: true
I20260709 12:16:53.593750 16352 raft_consensus.cc:2393] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4b26d78497741df932d87016bbc9a15 in current term 1: Already voted for candidate 371b664722e94372a346a6d621adaa9e in this term.
I20260709 12:16:53.596618 16244 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:53.597373 16758 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.610255 16758 raft_consensus.cc:2749] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.627490 16103 catalog_manager.cc:5697] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.629870 16765 consensus_queue.cc:1048] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:53.637617 16891 consensus_queue.cc:1048] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:53.666548 16849 consensus_queue.cc:1048] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:53.834564 16849 consensus_queue.cc:1048] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:53.968942 16853 consensus_queue.cc:1048] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.047313 16900 consensus_queue.cc:1048] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.079715 16959 consensus_queue.cc:1048] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.093010 16959 consensus_queue.cc:1048] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.132560 16896 consensus_queue.cc:1048] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.142714 16426 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.138286 16896 consensus_queue.cc:1048] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.156189 16849 consensus_queue.cc:1048] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.182011 16765 consensus_queue.cc:1048] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.202070 16959 consensus_queue.cc:1048] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:54.487162  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
W20260709 12:16:54.496985 16244 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:16:54.500407 16244 consensus_peers.cc:597] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.509145 16244 consensus_peers.cc:597] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.526858 16392 consensus_peers.cc:597] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.533077 16392 consensus_peers.cc:597] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.538393  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:54.539366  7716 tablet_replica.cc:333] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.540133  7716 raft_consensus.cc:2243] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.540763  7716 raft_consensus.cc:2272] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.544516 16244 consensus_peers.cc:597] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.545415  7716 tablet_replica.cc:333] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.546725  7716 raft_consensus.cc:2243] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.547350  7716 raft_consensus.cc:2272] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.550328  7716 tablet_replica.cc:333] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.551302  7716 raft_consensus.cc:2243] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.552429  7716 raft_consensus.cc:2272] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.562477  7716 tablet_replica.cc:333] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.563478  7716 raft_consensus.cc:2243] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.564591  7716 raft_consensus.cc:2272] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.568619 16244 consensus_peers.cc:597] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.569039 16392 consensus_peers.cc:597] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.570950  7716 tablet_replica.cc:333] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.571892  7716 raft_consensus.cc:2243] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.572371  7716 raft_consensus.cc:2272] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.574892 16244 consensus_peers.cc:597] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.577437  7716 tablet_replica.cc:333] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.578256  7716 raft_consensus.cc:2243] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.579125  7716 raft_consensus.cc:2272] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.581614  7716 tablet_replica.cc:333] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.582298  7716 raft_consensus.cc:2243] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.583078  7716 raft_consensus.cc:2272] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.585139  7716 tablet_replica.cc:333] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.585799  7716 raft_consensus.cc:2243] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.586258  7716 raft_consensus.cc:2272] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.588347  7716 tablet_replica.cc:333] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.588929  7716 raft_consensus.cc:2243] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.589413  7716 raft_consensus.cc:2272] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.591598  7716 tablet_replica.cc:333] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.592203  7716 raft_consensus.cc:2243] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.592681  7716 raft_consensus.cc:2272] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.595567  7716 tablet_replica.cc:333] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.596367  7716 raft_consensus.cc:2243] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.596803  7716 raft_consensus.cc:2272] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.597661 16318 consensus_peers.cc:597] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.599577  7716 tablet_replica.cc:333] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.600529  7716 raft_consensus.cc:2243] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.601146  7716 raft_consensus.cc:2272] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.604095  7716 tablet_replica.cc:333] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
W20260709 12:16:54.604418 16318 consensus_peers.cc:597] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.604869  7716 raft_consensus.cc:2243] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.605362  7716 raft_consensus.cc:2272] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.607306  7716 tablet_replica.cc:333] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.607951  7716 raft_consensus.cc:2243] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.608364  7716 raft_consensus.cc:2272] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.610329  7716 tablet_replica.cc:333] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.610858  7716 raft_consensus.cc:2243] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.611640  7716 raft_consensus.cc:2272] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.613511  7716 tablet_replica.cc:333] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.614050  7716 raft_consensus.cc:2243] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.614825  7716 raft_consensus.cc:2272] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.616742  7716 tablet_replica.cc:333] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.617317  7716 raft_consensus.cc:2243] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.617713  7716 raft_consensus.cc:2272] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.620031  7716 tablet_replica.cc:333] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.620901  7716 raft_consensus.cc:2243] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.621387  7716 raft_consensus.cc:2272] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.621544 16318 consensus_peers.cc:597] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.623413  7716 tablet_replica.cc:333] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.624328  7716 raft_consensus.cc:2243] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.624820  7716 raft_consensus.cc:2272] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.627068  7716 tablet_replica.cc:333] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.627627  7716 raft_consensus.cc:2243] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.628389  7716 raft_consensus.cc:2272] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.630188  7716 tablet_replica.cc:333] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.630780  7716 raft_consensus.cc:2243] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.631299  7716 raft_consensus.cc:2272] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.633158  7716 tablet_replica.cc:333] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.633671  7716 raft_consensus.cc:2243] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.634431  7716 raft_consensus.cc:2272] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.636410  7716 tablet_replica.cc:333] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.636937  7716 raft_consensus.cc:2243] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.637979  7716 raft_consensus.cc:2272] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.640889  7716 tablet_replica.cc:333] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.641510  7716 raft_consensus.cc:2243] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.642253  7716 raft_consensus.cc:2272] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.644353  7716 tablet_replica.cc:333] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.644873  7716 raft_consensus.cc:2243] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.645305  7716 raft_consensus.cc:2272] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.647464  7716 tablet_replica.cc:333] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.648064  7716 raft_consensus.cc:2243] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.648820  7716 raft_consensus.cc:2272] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.651400  7716 tablet_replica.cc:333] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.651943  7716 raft_consensus.cc:2243] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.652451  7716 raft_consensus.cc:2272] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.654397  7716 tablet_replica.cc:333] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.654934  7716 raft_consensus.cc:2243] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.655776  7716 raft_consensus.cc:2272] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.657727  7716 tablet_replica.cc:333] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.658291  7716 raft_consensus.cc:2243] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.658993  7716 raft_consensus.cc:2272] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.660816  7716 tablet_replica.cc:333] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.661376  7716 raft_consensus.cc:2243] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.662454  7716 raft_consensus.cc:2272] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.665055  7716 tablet_replica.cc:333] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
W20260709 12:16:54.665400 16244 consensus_peers.cc:597] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.665635  7716 raft_consensus.cc:2243] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.666231  7716 raft_consensus.cc:2272] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.668704  7716 tablet_replica.cc:333] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.669416  7716 raft_consensus.cc:2243] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.669986  7716 raft_consensus.cc:2272] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.672107 16244 consensus_peers.cc:597] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.672636  7716 tablet_replica.cc:333] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.673445  7716 raft_consensus.cc:2243] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.673894  7716 raft_consensus.cc:2272] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.676120  7716 tablet_replica.cc:333] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.676683  7716 raft_consensus.cc:2243] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.677100  7716 raft_consensus.cc:2272] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.679461  7716 tablet_replica.cc:333] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.680063  7716 raft_consensus.cc:2243] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.680563  7716 raft_consensus.cc:2272] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.682823  7716 tablet_replica.cc:333] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.683550  7716 raft_consensus.cc:2243] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.684080  7716 raft_consensus.cc:2272] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.685912  7716 tablet_replica.cc:333] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.686437  7716 raft_consensus.cc:2243] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.687398  7716 raft_consensus.cc:2272] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.689872  7716 tablet_replica.cc:333] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.690582  7716 raft_consensus.cc:2243] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:54.690944 16244 consensus_peers.cc:597] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.691025  7716 raft_consensus.cc:2272] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.693104  7716 tablet_replica.cc:333] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.693657  7716 raft_consensus.cc:2243] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.694451  7716 raft_consensus.cc:2272] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.696254  7716 tablet_replica.cc:333] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.696763  7716 raft_consensus.cc:2243] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.697147  7716 raft_consensus.cc:2272] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.698911  7716 tablet_replica.cc:333] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.699465  7716 raft_consensus.cc:2243] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.700229  7716 raft_consensus.cc:2272] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.702028  7716 tablet_replica.cc:333] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.702662  7716 raft_consensus.cc:2243] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.703070  7716 raft_consensus.cc:2272] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.705520  7716 tablet_replica.cc:333] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.706040  7716 raft_consensus.cc:2243] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:16:54.706300 16318 consensus_peers.cc:597] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.707059  7716 raft_consensus.cc:2272] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.709370  7716 tablet_replica.cc:333] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.710027  7716 raft_consensus.cc:2243] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.710485  7716 raft_consensus.cc:2272] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.712636 16318 consensus_peers.cc:597] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.712826  7716 tablet_replica.cc:333] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: stopping tablet replica
I20260709 12:16:54.713433  7716 raft_consensus.cc:2243] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.714195  7716 raft_consensus.cc:2272] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.722162 16392 consensus_peers.cc:597] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.749469 16318 consensus_peers.cc:597] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.750873 16392 consensus_peers.cc:597] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.802387  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:16:54.804824 16318 consensus_peers.cc:597] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.832755 16244 consensus_peers.cc:597] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.875841  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:54.883093 16983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:54.883958 16982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:54.884505 16985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:54.885902  7716 server_base.cc:1061] running on GCE node
I20260709 12:16:54.891742  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:54.892061  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:54.892311  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599414892281 us; error 0 us; skew 500 ppm
I20260709 12:16:54.893052  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:54.896975  7716 webserver.cc:533] Webserver started at http://127.7.137.1:44415/ using document root <none> and password file <none>
I20260709 12:16:54.897512  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:54.897717  7716 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:16:54.903873  7716 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:16:54.925465 16990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:54.926558  7716 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.009s	sys 0.004s
I20260709 12:16:54.926962  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "371b664722e94372a346a6d621adaa9e"
format_stamp: "Formatted at 2026-07-09 12:16:42 on dist-test-slave-9kw9"
I20260709 12:16:54.927467  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:16:54.953256 16244 consensus_peers.cc:597] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.958737 16318 consensus_peers.cc:597] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.971446 16244 consensus_peers.cc:597] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.984431  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:54.986286  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:16:54.987766 16449 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6a00 after lost signal to thread 7719
I20260709 12:16:54.989326  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:16:54.990399 16449 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5d20 after lost signal to thread 16137
W20260709 12:16:54.992631 16449 debug-util.cc:398] Leaking SignalData structure 0x7b0800138860 after lost signal to thread 16304
W20260709 12:16:54.993804 16449 debug-util.cc:398] Leaking SignalData structure 0x7b080021b320 after lost signal to thread 16378
W20260709 12:16:54.995069 16449 debug-util.cc:398] Leaking SignalData structure 0x7b08001e22c0 after lost signal to thread 16452
I20260709 12:16:55.000026 16998 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:16:55.012756 16244 consensus_peers.cc:597] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:55.058043 16244 consensus_peers.cc:597] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.409849  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:16:55.410264  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.412s	user 0.005s	sys 0.004s
I20260709 12:16:55.410615  7716 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:16:55.416045 16998 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.433007 16998 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.434144 16998 tablet_bootstrap.cc:492] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.434978 16998 ts_tablet_manager.cc:1403] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:16:55.438149 16998 raft_consensus.cc:359] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.438966 16998 raft_consensus.cc:740] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.439997 16998 consensus_queue.cc:260] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.454619 16998 ts_tablet_manager.cc:1434] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:16:55.455646 16998 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.471884 16998 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.472899 16998 tablet_bootstrap.cc:492] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.473620 16998 ts_tablet_manager.cc:1403] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:16:55.476405 16998 raft_consensus.cc:359] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.477167 16998 raft_consensus.cc:740] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.477942 16998 consensus_queue.cc:260] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.479993 16998 ts_tablet_manager.cc:1434] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:55.480841 16998 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.511844 16998 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.512778 16998 tablet_bootstrap.cc:492] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.513404 16998 ts_tablet_manager.cc:1403] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.012s
I20260709 12:16:55.515836 16998 raft_consensus.cc:359] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.516501 16998 raft_consensus.cc:740] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.517283 16998 consensus_queue.cc:260] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.519379 16998 ts_tablet_manager.cc:1434] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:55.520138 16998 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.536181 16998 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.537206 16998 tablet_bootstrap.cc:492] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.537885 16998 ts_tablet_manager.cc:1403] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:16:55.540525 16998 raft_consensus.cc:359] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.541258 16998 raft_consensus.cc:740] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.542673 16998 consensus_queue.cc:260] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.544819 16998 ts_tablet_manager.cc:1434] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:55.545921 16998 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.601425 16998 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.602519 16998 tablet_bootstrap.cc:492] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.603229 16998 ts_tablet_manager.cc:1403] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.012s
I20260709 12:16:55.605984 16998 raft_consensus.cc:359] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.606711 16998 raft_consensus.cc:740] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.607595 16998 consensus_queue.cc:260] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.609928 16998 ts_tablet_manager.cc:1434] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:55.611337 16998 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.629395 16998 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.630378 16998 tablet_bootstrap.cc:492] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.631032 16998 ts_tablet_manager.cc:1403] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:16:55.633708 16998 raft_consensus.cc:359] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.634431 16998 raft_consensus.cc:740] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.635093 16998 consensus_queue.cc:260] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.637431 16998 ts_tablet_manager.cc:1434] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:55.638260 16998 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.643285 17001 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.643865 17001 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.645967 17001 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.653745 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:55.666023 16852 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.666640 16852 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.668653 16852 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:55.673449 17002 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.673832 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.673946 17002 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.676254 17002 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
W20260709 12:16:55.684664 16392 leader_election.cc:336] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.685184 16392 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:55.686030 16961 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.686522 16961 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.688586 16961 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:55.689016 16961 raft_consensus.cc:2749] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.698444  7716 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:16:55.698864  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.288s	user 0.244s	sys 0.004s
I20260709 12:16:55.705832 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.717680 16995 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.718459 16995 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.721601 16995 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:55.730728 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.731032 17001 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.731596 17001 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.735685 17001 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:55.736840 16392 leader_election.cc:336] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.737560 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:55.745285 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.747598 17002 raft_consensus.cc:493] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.748324 17002 raft_consensus.cc:515] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.750674 17002 leader_election.cc:290] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.751847 16961 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.752720 16961 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.753249 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:55.756168 16318 leader_election.cc:336] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.756712 16318 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:55.757601 17002 raft_consensus.cc:2749] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:55.757651 16318 leader_election.cc:336] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.754997 16961 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:55.758473 16318 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:55.759467 17002 raft_consensus.cc:2749] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.759748 16998 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.739887 16392 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:55.760982 16998 tablet_bootstrap.cc:492] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.761703 16998 ts_tablet_manager.cc:1403] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.124s	user 0.046s	sys 0.066s
I20260709 12:16:55.761739 16961 raft_consensus.cc:2749] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.768282 16998 raft_consensus.cc:359] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.769361 16998 raft_consensus.cc:740] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.769632 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.770304 16998 consensus_queue.cc:260] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:55.771519 16318 leader_election.cc:336] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:55.771894 16392 leader_election.cc:336] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.771994 16318 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:55.772380 16392 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:55.772755 17002 raft_consensus.cc:2749] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.773092 16998 ts_tablet_manager.cc:1434] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:55.773046 16961 raft_consensus.cc:2749] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.774263 16998 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:55.777483 16318 leader_election.cc:336] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.777992 16318 leader_election.cc:304] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:55.778663 17002 raft_consensus.cc:2749] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.806521 16998 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:55.807775 16998 tablet_bootstrap.cc:492] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:55.808574 16998 ts_tablet_manager.cc:1403] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.004s
W20260709 12:16:55.811453 16392 leader_election.cc:336] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.811641 16998 raft_consensus.cc:359] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.812217 16392 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:55.812618 16998 raft_consensus.cc:740] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.813258 16961 raft_consensus.cc:2749] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.813815 16998 consensus_queue.cc:260] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.816082 16998 ts_tablet_manager.cc:1434] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:55.817004 16998 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:55.840302 16956 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.840952 16956 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.843226 16956 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:55.853639 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:55.854769 16352 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:55.856452 16244 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:55.858323 16875 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.858750 16875 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.859109 16875 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:55.860353 16244 leader_election.cc:336] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.864140 16852 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.864768 16852 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.867141 16852 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.869877 16875 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.871625 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.873482 16875 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:55.876972 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:55.879464 16352 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:55.883344 16318 leader_election.cc:336] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.884135 16318 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:55.886720 17002 raft_consensus.cc:2749] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.887092 16352 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:55.892554 16244 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:55.894294 17001 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.894901 16875 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.894897 17001 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.895936 16875 raft_consensus.cc:697] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:55.897289 17001 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.898237 16956 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.897162 16875 consensus_queue.cc:237] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.899037 16956 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.901764 16956 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.902539 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.905244 17002 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.906083 17002 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.909457 17002 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:55.919656 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:55.927074 16103 catalog_manager.cc:5697] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:55.936174 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 71181.1us
I20260709 12:16:55.947077 16875 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.947690 16875 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:55.949687 16875 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:55.950198 16852 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.950430 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:55.950850 16852 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.952741 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.953230 16852 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.953828 16852 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.954316 16852 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.956297 17002 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.956593 16852 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.954339 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.956946 17002 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.959340 16852 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.959529 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.960239 16423 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:55.959946 16852 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:55.961402 16320 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:55.961477 16875 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.962317 16896 raft_consensus.cc:2804] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.962208 16875 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.962807 16896 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.962913 17002 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.963337 16896 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.964128 16875 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:55.964681 16318 leader_election.cc:336] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.965202 16318 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
W20260709 12:16:55.957970 16244 leader_election.cc:336] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.978304 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:55.979106 16423 raft_consensus.cc:2468] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:55.980397 16320 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:55.982028 16852 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:55.979646 16896 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:55.983436 16875 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:55.983963 16875 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:55.984494 16896 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:55.985864 16875 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:55.991477 16392 leader_election.cc:336] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:55.992045 16392 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:56.001320 16961 raft_consensus.cc:2749] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.001454 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.002966 16352 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:56.005941 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.008112 16961 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.009013 16961 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.012974 16961 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.013954 16995 raft_consensus.cc:2749] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.018079 16852 raft_consensus.cc:2804] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.018567 16852 raft_consensus.cc:493] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.018991 16852 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.024528 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.025147 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.025318 16423 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:56.026257 16426 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.029458 17001 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.030182 17001 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:56.031723 16875 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.032490 16875 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.032899 17001 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:56.035046 16875 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.036142 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.037408 16320 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.039776 17025 raft_consensus.cc:2804] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.040198 17025 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.040575 17025 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.040736 16998 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:56.041752 16998 tablet_bootstrap.cc:492] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:56.044031 16998 ts_tablet_manager.cc:1403] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.227s	user 0.048s	sys 0.072s
I20260709 12:16:56.049219 16852 raft_consensus.cc:515] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.049760 16998 raft_consensus.cc:359] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.082690 16998 raft_consensus.cc:740] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.055773 17025 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:56.083570 16998 consensus_queue.cc:260] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.057338 16896 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.084851 16896 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.085843 17025 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:56.086006 16998 ts_tablet_manager.cc:1434] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:16:56.058334 17002 raft_consensus.cc:493] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.087044 16998 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:56.087529 17002 raft_consensus.cc:515] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.089962 17002 leader_election.cc:290] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:56.062194 16318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 92665.9us
I20260709 12:16:56.064937 16426 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
W20260709 12:16:56.065708 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 74260.1us
I20260709 12:16:56.102422 17001 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.103139 16962 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.103945 16962 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.072291 16875 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.073334 17000 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.074076 16758 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.074712 16995 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.073999 16244 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.108561 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e140631c2f341008091adb103aedea0" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.106453 16875 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.109285 16423 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.110675 16875 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.106527 17000 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.106851 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.108453 16956 raft_consensus.cc:2804] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.107066 16995 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.120011 16956 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.107208 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.120643 16956 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.106730 16758 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.103180 17001 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.087055 16896 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.133914 16352 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.134167 16320 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.078200 16961 raft_consensus.cc:493] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.081990 17029 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
W20260709 12:16:56.140329 16318 leader_election.cc:336] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.141412 16318 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
W20260709 12:16:56.143497 16244 leader_election.cc:336] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.146847 16244 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
W20260709 12:16:56.147755 16244 leader_election.cc:336] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.147902 16875 raft_consensus.cc:2749] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.148247 16244 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:56.151206 17033 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.152905 17033 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.155797 17033 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
W20260709 12:16:56.151893 16318 leader_election.cc:336] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.136977 16896 raft_consensus.cc:2804] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.152045 17025 raft_consensus.cc:2749] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.157760 16896 raft_consensus.cc:697] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:56.152215 17034 raft_consensus.cc:2749] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:56.159067 16318 leader_election.cc:336] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.160962 16995 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.163400 17000 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.163403 16353 raft_consensus.cc:2393] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bde8efa60f914da8a818213518c2b4ca in current term 2: Already voted for candidate a7f2df769fee4fb7894cdbb752cab97e in this term.
I20260709 12:16:56.164608 16758 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:56.106274 16962 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.166203 17001 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.166602 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.159125 16896 consensus_queue.cc:237] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.167073 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.167266 16427 raft_consensus.cc:2468] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:56.167670 16426 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.168598 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.169193 16427 raft_consensus.cc:2468] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:56.154361 16956 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:56.174645 16318 leader_election.cc:336] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.184291 16318 leader_election.cc:336] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.185333 16318 leader_election.cc:336] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.185870 16318 leader_election.cc:336] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.186383 16318 leader_election.cc:336] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.182281 16426 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
W20260709 12:16:56.151731 16244 leader_election.cc:336] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.187940 16320 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
W20260709 12:16:56.189743 16244 leader_election.cc:336] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.191108 16244 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:16:56.191334 16320 leader_election.cc:304] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.146106 16961 raft_consensus.cc:515] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.198941 16961 leader_election.cc:290] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.199481 17025 raft_consensus.cc:2804] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.199930 17025 raft_consensus.cc:493] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.146418 17029 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.200311 17025 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.201882 17029 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.202327 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:56.202827 16244 leader_election.cc:336] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.202970 16352 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:56.203300 16244 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:56.198786 16423 raft_consensus.cc:2468] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:16:56.211514 16320 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.199484 16758 raft_consensus.cc:2749] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.205005 16995 raft_consensus.cc:2804] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.207054 16852 leader_election.cc:290] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.207288 17029 raft_consensus.cc:2749] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.220352 16758 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.218853 16962 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.220916 16758 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.221226 16962 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.222900 16956 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:56.215417 17028 raft_consensus.cc:2804] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.223001 16758 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:56.223584 17028 raft_consensus.cc:697] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:56.224212 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.224831 16423 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:56.224515 17028 consensus_queue.cc:237] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:56.226583 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.215447 16995 raft_consensus.cc:493] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.227603 16995 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.228917 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:56.229566 16425 raft_consensus.cc:2468] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:56.232041 16320 leader_election.cc:304] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.227131 16426 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:56.228648 16246 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.233083 16962 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.234476 17033 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.240298 17033 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.241833 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.242466 16352 raft_consensus.cc:2468] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.238032 17002 raft_consensus.cc:2804] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.243893 17002 raft_consensus.cc:697] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:56.238376 16758 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.245594 16758 raft_consensus.cc:493] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.245976 16758 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.242945 17033 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.251930 17002 consensus_queue.cc:237] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.254630 16103 catalog_manager.cc:5697] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.258069 16246 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.259313 17040 raft_consensus.cc:2804] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.259708 17040 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.260075 17040 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.260824 16246 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.263121 16875 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.263630 16875 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.264011 16875 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.270406 16392 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.271318 16962 raft_consensus.cc:2804] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.272284 16392 leader_election.cc:304] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.271739 16962 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.273165 17037 raft_consensus.cc:2804] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.261755 16758 raft_consensus.cc:515] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.282038 16995 raft_consensus.cc:515] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.286145 16875 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:56.289642 16318 leader_election.cc:336] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.287519 16962 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.296577 16426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fd27468a6e4c88ab3ee076f99a4e73" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.287191 17037 raft_consensus.cc:493] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.297183 16426 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.298800 17025 raft_consensus.cc:515] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.301146 16998 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:56.301623 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.297456 17037 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.302788 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e7274549d04acc9c7bb43812b87d79" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.307538 16423 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.307776 16998 tablet_bootstrap.cc:492] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:56.308480 16998 ts_tablet_manager.cc:1403] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.222s	user 0.019s	sys 0.006s
I20260709 12:16:56.311003 16998 raft_consensus.cc:359] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.311515 16425 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.311645 16998 raft_consensus.cc:740] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.312479 16998 consensus_queue.cc:260] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.317608 17025 leader_election.cc:290] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:56.304141 16392 leader_election.cc:336] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.318665 16998 ts_tablet_manager.cc:1434] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:56.304476 16758 leader_election.cc:290] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.304602 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.305225 16875 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.328926 16427 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.321092 16423 raft_consensus.cc:2468] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:16:56.321514 16426 raft_consensus.cc:2468] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:16:56.324023 16425 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:56.324934 16995 leader_election.cc:290] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:56.319582 16392 leader_election.cc:336] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.330984 16392 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
W20260709 12:16:56.325786 16318 leader_election.cc:336] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.326800 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 60893.2us
I20260709 12:16:56.319584 16998 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:56.306316 16962 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.336822 17035 raft_consensus.cc:2749] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:56.348479 16392 leader_election.cc:336] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.348312 16244 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.349098 16246 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.351348 16875 raft_consensus.cc:2804] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.351708 16875 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.352064 16875 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.351841 16427 raft_consensus.cc:2468] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 3.
I20260709 12:16:56.349638 16320 leader_election.cc:304] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.355047 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:56.355734 16352 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:56.357043 16244 leader_election.cc:336] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.357671 16244 leader_election.cc:336] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.353524 16246 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.360069 17034 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.361905 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.362241 17034 raft_consensus.cc:697] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.362615 16353 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 1.
I20260709 12:16:56.363124 17034 consensus_queue.cc:237] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.361390 16103 catalog_manager.cc:5697] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.365311 16103 catalog_manager.cc:5697] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.366840 17045 raft_consensus.cc:2804] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.368254 17045 raft_consensus.cc:697] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 3 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.368300 16962 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.369313 17045 consensus_queue.cc:237] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.371796 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:56.360567 17002 raft_consensus.cc:2804] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.372514 16353 raft_consensus.cc:2468] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.372565 17002 raft_consensus.cc:697] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
W20260709 12:16:56.376209 16392 leader_election.cc:336] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.377815 16244 leader_election.cc:336] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.378253 16392 leader_election.cc:336] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.377166 16352 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
W20260709 12:16:56.378835 16318 leader_election.cc:336] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.378885 16392 leader_election.cc:336] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.380527 16318 leader_election.cc:336] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.383100 16875 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.384619 17002 consensus_queue.cc:237] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.385262 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:56.385914 16353 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.393262 16320 leader_election.cc:304] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
W20260709 12:16:56.391453 16392 leader_election.cc:336] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.410235 16244 leader_election.cc:336] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.410650 16875 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:56.412052 16392 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
W20260709 12:16:56.410825 16244 leader_election.cc:336] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.414041 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.414726 16280 raft_consensus.cc:2468] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.416745 16244 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.417341 16962 raft_consensus.cc:2804] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.417768 16962 raft_consensus.cc:493] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.417963 17050 raft_consensus.cc:2804] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:56.424666 16392 leader_election.cc:336] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.426810 17050 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.427361 17050 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:56.427471 16392 leader_election.cc:336] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.417855 16244 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.408877 17025 raft_consensus.cc:2804] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.429630 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e6d3a14dc24349a70fb2f3910a1fa4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.440994 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
W20260709 12:16:56.441133 16244 leader_election.cc:336] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.441650 16352 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.451227 16352 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:56.438695 16962 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.426252 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.422880 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.444598 17000 raft_consensus.cc:2804] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.455057 16244 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.465193 16392 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.467078 16875 raft_consensus.cc:2804] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.455116 17025 raft_consensus.cc:697] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:56.471503 16352 raft_consensus.cc:1275] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.469476 16961 raft_consensus.cc:2804] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.475382 16961 raft_consensus.cc:493] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.475849 16961 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.475476 17025 consensus_queue.cc:237] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.470049 16273 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.477785 16353 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.468786 16274 raft_consensus.cc:2468] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 1.
I20260709 12:16:56.483084 17040 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.485267 17040 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.486387 16961 raft_consensus.cc:515] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.470114 17000 raft_consensus.cc:697] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.489275 16961 leader_election.cc:290] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.489566 17000 consensus_queue.cc:237] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.500247 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:16:56.500523 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.500958 16423 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.502074 16277 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 1.
I20260709 12:16:56.499652 16875 raft_consensus.cc:697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.507889 16875 consensus_queue.cc:237] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:56.514154 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 45070.1us
I20260709 12:16:56.515465 16318 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.457257 17037 raft_consensus.cc:515] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.519883 16423 raft_consensus.cc:2468] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:56.521216 17037 leader_election.cc:290] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:56.517793 16103 catalog_manager.cc:5697] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:56.518940 16244 leader_election.cc:336] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.524004 16244 leader_election.cc:336] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.527019 17002 raft_consensus.cc:2804] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.527487 17002 raft_consensus.cc:493] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.527859 17002 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.532850 17050 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.543744 16101 catalog_manager.cc:5697] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.548375 16101 catalog_manager.cc:5697] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 2 to 3, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 3 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.549276 16246 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:56.557085 17034 raft_consensus.cc:2804] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.557626 17034 raft_consensus.cc:697] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.558471 17034 consensus_queue.cc:237] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
W20260709 12:16:56.563199 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 96709.8us
I20260709 12:16:56.569199 17040 consensus_queue.cc:1048] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:56.570209 16318 consensus_peers.cc:597] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:56.572626 16244 leader_election.cc:336] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.584367 16392 leader_election.cc:304] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:56.586505 17058 raft_consensus.cc:2749] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.589656 16392 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.590894 17002 raft_consensus.cc:515] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.592188 17058 raft_consensus.cc:2804] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.592783 17058 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.593258 17058 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.593312 17002 leader_election.cc:290] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.594314 17050 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:56.596386 16244 leader_election.cc:336] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.599864 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "d4b26d78497741df932d87016bbc9a15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:56.600458 16352 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.582814 16962 raft_consensus.cc:515] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.603624 16962 leader_election.cc:290] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:16:56.615736 16318 leader_election.cc:336] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.617663 16244 leader_election.cc:336] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.618055 16392 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.621845 17001 raft_consensus.cc:2804] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.622053 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba4353bb62b4c0aa4e854be3297184d" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:56.622690 16277 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.606945 17058 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.625098 16352 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4b26d78497741df932d87016bbc9a15 in term 2.
I20260709 12:16:56.625109 17058 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.627555 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541a370ec014267a500f45686395fb8" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:56.628268 16354 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:56.630244 16244 consensus_peers.cc:597] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:56.632509 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f9ae53f366a4893a34b5bef50a38f1b" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:56.633175 16272 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.633466 16244 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.635875 17000 raft_consensus.cc:2804] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.636350 17000 raft_consensus.cc:697] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Leader. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:16:56.614168 16101 catalog_manager.cc:5697] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.637220 17000 consensus_queue.cc:237] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.622256 17001 raft_consensus.cc:493] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:16:56.639186 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c7f1839b1f45898709d7b951744cd4" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:16:56.641249 16348 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.639564 17004 raft_consensus.cc:493] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.643850 17004 raft_consensus.cc:515] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.639253 17001 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.649475 17004 leader_election.cc:290] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.653860 16354 raft_consensus.cc:2468] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.655953 16392 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.620698 16998 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:56.661862 16998 tablet_bootstrap.cc:492] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:56.662621 16998 ts_tablet_manager.cc:1403] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.343s	user 0.025s	sys 0.006s
I20260709 12:16:56.663328 16277 raft_consensus.cc:2468] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:16:56.671676 16423 raft_consensus.cc:1275] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.664597 16962 raft_consensus.cc:2804] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.676036 17002 consensus_queue.cc:1048] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:56.676872 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.3:38875, user_credentials={real_user=slave}} blocked reactor thread for 43488.8us
I20260709 12:16:56.678282 16962 raft_consensus.cc:697] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
W20260709 12:16:56.680176 16318 consensus_peers.cc:597] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:56.674562 16392 leader_election.cc:304] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:16:56.702343 16318 leader_election.cc:304] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.680042 16962 consensus_queue.cc:237] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.709023 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:56.709760 16277 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.689864 17033 raft_consensus.cc:2804] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.712857 16998 raft_consensus.cc:359] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.710561 17025 raft_consensus.cc:2804] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.717948 16998 raft_consensus.cc:740] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.719216 16998 consensus_queue.cc:260] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.721366 16998 ts_tablet_manager.cc:1434] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.058s	user 0.001s	sys 0.006s
I20260709 12:16:56.722105 16998 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:56.715233 17033 raft_consensus.cc:697] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:56.723549 17033 consensus_queue.cc:237] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.724262 16348 raft_consensus.cc:2468] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.725190 17001 raft_consensus.cc:515] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.745015 17001 leader_election.cc:290] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:56.738605 17025 raft_consensus.cc:697] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:16:56.778384 16277 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.791954 16427 raft_consensus.cc:1275] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.795630 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329094fe65047b2b4440a5d7066ab0a" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:16:56.796463 16271 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.797669 16272 raft_consensus.cc:2468] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.798118 16392 leader_election.cc:304] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
W20260709 12:16:56.800872 16392 leader_election.cc:336] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.801553 16392 leader_election.cc:336] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.805212 16392 leader_election.cc:336] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:16:56.806682 16392 leader_election.cc:336] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:56.806766 16427 raft_consensus.cc:1275] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:56.807727 16392 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
I20260709 12:16:56.808408 16962 raft_consensus.cc:2804] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.809039 17034 consensus_queue.cc:1048] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:56.812707 16423 raft_consensus.cc:1275] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.801616 17033 raft_consensus.cc:2804] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.813660 17033 raft_consensus.cc:697] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:56.815590 17033 consensus_queue.cc:237] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:56.805686 17025 consensus_queue.cc:237] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:56.822310 16103 catalog_manager.cc:5697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.824182 16103 catalog_manager.cc:5697] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.818812 16962 raft_consensus.cc:697] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:56.827459 16103 catalog_manager.cc:5697] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.837267 17046 consensus_queue.cc:1048] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:56.840804 16101 catalog_manager.cc:5697] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:56.842495 16244 consensus_peers.cc:597] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:56.842971 16244 consensus_peers.cc:597] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:56.847417 16244 consensus_peers.cc:597] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:56.852032 16962 consensus_queue.cc:237] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:56.854596 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:56.887908 16271 raft_consensus.cc:2468] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:16:56.865542 17078 consensus_queue.cc:1048] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 12:16:56.894219 16318 consensus_peers.cc:597] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:56.894821 16318 consensus_peers.cc:597] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:56.902441 16100 catalog_manager.cc:5697] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.908164 16424 raft_consensus.cc:1275] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.914095 16425 raft_consensus.cc:1275] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.945724 16424 raft_consensus.cc:1275] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.934788 17040 consensus_queue.cc:1048] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:56.963747 17002 consensus_queue.cc:1048] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:16:56.975486 17004 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.003517 17081 consensus_queue.cc:1048] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:57.006337 16348 raft_consensus.cc:1275] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.021632 16348 raft_consensus.cc:1275] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.023298 17056 consensus_queue.cc:1048] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:57.067519 16103 catalog_manager.cc:5697] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to d4b26d78497741df932d87016bbc9a15 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "d4b26d78497741df932d87016bbc9a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.071493 17034 consensus_queue.cc:1048] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:56.997570 17004 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:57.083104 16318 consensus_peers.cc:597] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.084177 17004 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:57.084225 16392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:35065, user_credentials={real_user=slave}} blocked reactor thread for 264724us
W20260709 12:16:57.102465 16244 consensus_peers.cc:597] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.106012 16998 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:57.104216 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.112536 16428 raft_consensus.cc:1275] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.114290 17029 consensus_queue.cc:1048] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.148684 16347 raft_consensus.cc:1275] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer d4b26d78497741df932d87016bbc9a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:57.151799 16244 consensus_peers.cc:597] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:57.153895 16244 consensus_peers.cc:597] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.156806 16998 tablet_bootstrap.cc:492] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:57.158999 16998 ts_tablet_manager.cc:1403] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.437s	user 0.035s	sys 0.031s
W20260709 12:16:57.173421 16244 consensus_peers.cc:597] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:57.176386 16318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 92726.8us
I20260709 12:16:57.174976 17056 consensus_queue.cc:1048] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:16:57.198980 16101 catalog_manager.cc:5697] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.202011 16101 catalog_manager.cc:5697] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.203068 16101 catalog_manager.cc:5697] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.174517 16998 raft_consensus.cc:359] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:57.218405 16318 consensus_peers.cc:597] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.219197 16998 raft_consensus.cc:740] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
W20260709 12:16:57.219388 16318 consensus_peers.cc:597] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.219564 16392 leader_election.cc:304] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 371b664722e94372a346a6d621adaa9e
W20260709 12:16:57.224629 16244 consensus_peers.cc:597] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.220013 16998 consensus_queue.cc:260] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.223922 16392 leader_election.cc:304] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:16:57.230271 17001 raft_consensus.cc:2804] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.230855 17001 raft_consensus.cc:697] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:57.231807 17001 consensus_queue.cc:237] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:57.227762 17004 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.241494 17004 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:57.243759 17004 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:57.228156 16962 raft_consensus.cc:2804] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.245196 16962 raft_consensus.cc:697] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:16:57.246004 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.246115 16962 consensus_queue.cc:237] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:57.247568 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:57.253942 16992 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
W20260709 12:16:57.257746 16318 consensus_peers.cc:597] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.275849 16318 consensus_peers.cc:597] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.277926 16392 leader_election.cc:336] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:16:57.286501 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4130f8e68e4e1186f8b3e11d38a05c" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:57.288183 17004 raft_consensus.cc:2749] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.310928 17004 raft_consensus.cc:493] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.324594 17004 raft_consensus.cc:515] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
W20260709 12:16:57.326568 16244 consensus_peers.cc:597] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.327523 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.301025 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:57.332162 17004 leader_election.cc:290] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:57.332746 17004 raft_consensus.cc:493] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.333161 17004 raft_consensus.cc:515] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:57.335877 16354 raft_consensus.cc:1275] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.336493 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.338191 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311a9b9c003249ef8438269658bcf3e1" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:57.341917 16272 raft_consensus.cc:1275] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:57.347105 16392 consensus_peers.cc:597] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:57.347640 16392 consensus_peers.cc:597] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.348004 16392 consensus_peers.cc:597] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.350656 16392 consensus_peers.cc:597] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.342875 17004 leader_election.cc:290] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:57.393831 16998 ts_tablet_manager.cc:1434] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.234s	user 0.018s	sys 0.028s
I20260709 12:16:57.394845 16998 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:57.397204 17113 raft_consensus.cc:493] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.363425 17002 consensus_queue.cc:1048] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:16:57.387296 17004 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.402233 16992 leader_election.cc:304] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.379550 16961 consensus_queue.cc:1048] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:16:57.423098 16318 consensus_peers.cc:597] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.430982 16318 consensus_peers.cc:597] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.431560 16318 consensus_peers.cc:597] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.408176 17004 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.434028 17004 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:16:57.432349 16392 consensus_peers.cc:597] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.441605 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d00760f88247f1a179973d1c7cc34e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
W20260709 12:16:57.441949 16392 consensus_peers.cc:597] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:57.435858 16318 consensus_peers.cc:597] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.451289 17112 raft_consensus.cc:493] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.451871 17112 raft_consensus.cc:515] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.454010 17112 leader_election.cc:290] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:16:57.455868 16351 raft_consensus.cc:1275] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.441622 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
W20260709 12:16:57.458534 16244 consensus_peers.cc:597] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.459340 16244 consensus_peers.cc:597] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.459781 16244 consensus_peers.cc:597] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.460155 16244 consensus_peers.cc:597] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.462863 17115 raft_consensus.cc:2749] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:57.466825 16244 consensus_peers.cc:597] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.481953 16350 raft_consensus.cc:1275] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.402946 17113 raft_consensus.cc:515] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:57.482271 16272 raft_consensus.cc:1275] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.482609 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.493217 17035 consensus_queue.cc:1048] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.403638 16994 leader_election.cc:304] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.494392 17112 raft_consensus.cc:2749] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:57.494616 16994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 97191.1us
I20260709 12:16:57.495550 16994 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.496790 16994 leader_election.cc:304] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.497561 17004 raft_consensus.cc:2749] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.497946 17112 raft_consensus.cc:2749] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.480647 17115 raft_consensus.cc:493] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.514103 17115 raft_consensus.cc:515] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
W20260709 12:16:57.515048 16318 consensus_peers.cc:597] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.517163 17115 leader_election.cc:290] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:57.544682 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:57.544632 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
W20260709 12:16:57.548009 16244 consensus_peers.cc:597] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.568116 16392 consensus_peers.cc:597] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.567759 16992 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.572750 17115 raft_consensus.cc:2749] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.552489 17113 leader_election.cc:290] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:57.589505 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:57.592027 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926305cc352545b3b98774de0464f46b" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:57.591892 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b249075c4bd41b7b53b295ee5b2fc89" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:57.592486 17035 consensus_queue.cc:1048] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.594882 16347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0013e821aa88410fa79bc656b03ec146" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:57.595100 16961 consensus_queue.cc:1048] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:57.597343 16392 consensus_peers.cc:597] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.603901 16101 catalog_manager.cc:5697] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.607211 16101 catalog_manager.cc:5697] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from 371b664722e94372a346a6d621adaa9e (127.7.137.1) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.599653 16994 leader_election.cc:304] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.620625 16992 leader_election.cc:304] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:57.646751 16992 leader_election.cc:304] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:57.648116 17113 raft_consensus.cc:2749] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.648777 17113 raft_consensus.cc:2749] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.654084 16276 raft_consensus.cc:1275] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.659152 17113 raft_consensus.cc:2749] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.660311 17033 consensus_queue.cc:1048] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:16:57.667891 16244 consensus_peers.cc:597] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.661806 16994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.137.4:43779, user_credentials={real_user=slave}} blocked reactor thread for 63153.4us
W20260709 12:16:57.680835 16244 consensus_peers.cc:597] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.699290 16998 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:57.699817 16392 consensus_peers.cc:597] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:57.707396 16998 tablet_bootstrap.cc:492] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:57.708182 16998 ts_tablet_manager.cc:1403] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.314s	user 0.014s	sys 0.010s
W20260709 12:16:57.714484 16244 consensus_peers.cc:597] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:57.719276 16392 consensus_peers.cc:597] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.710711 16998 raft_consensus.cc:359] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.725063 16998 raft_consensus.cc:740] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.725943 16998 consensus_queue.cc:260] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.731894 16998 ts_tablet_manager.cc:1434] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
W20260709 12:16:57.735065 16392 consensus_peers.cc:597] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.735872 16998 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:57.838122 16998 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:57.839305 16998 tablet_bootstrap.cc:492] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:57.840008 16998 ts_tablet_manager.cc:1403] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.006s
I20260709 12:16:57.851928 16276 raft_consensus.cc:1275] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.852085 16998 raft_consensus.cc:359] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:57.852983 16998 raft_consensus.cc:740] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.853694 16998 consensus_queue.cc:260] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:57.854575 17033 consensus_queue.cc:1048] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.855760 16998 ts_tablet_manager.cc:1434] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:16:57.856619 16998 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:57.877663 16998 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:57.879113 16998 tablet_bootstrap.cc:492] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:57.880060 16998 ts_tablet_manager.cc:1403] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 12:16:57.889613 16998 raft_consensus.cc:359] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.890448 16998 raft_consensus.cc:740] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.891345 16998 consensus_queue.cc:260] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.893848 16998 ts_tablet_manager.cc:1434] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:57.894718 16998 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:57.950440 16998 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:57.951534 16998 tablet_bootstrap.cc:492] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:57.958819 16998 ts_tablet_manager.cc:1403] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.009s
I20260709 12:16:57.962430 16998 raft_consensus.cc:359] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.963195 16998 raft_consensus.cc:740] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.964609 16998 consensus_queue.cc:260] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:57.978123 16998 ts_tablet_manager.cc:1434] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:16:57.979063 16998 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.040409 16998 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.041429 16998 tablet_bootstrap.cc:492] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.042111 16998 ts_tablet_manager.cc:1403] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.008s
I20260709 12:16:58.044734 16998 raft_consensus.cc:359] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.045432 16998 raft_consensus.cc:740] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.046176 16998 consensus_queue.cc:260] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.046725 17113 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.047343 17113 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.050624 17113 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:16:58.052148 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4b26d78497741df932d87016bbc9a15" is_pre_election: true
I20260709 12:16:58.056020 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:58.057658 16998 ts_tablet_manager.cc:1434] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:16:58.058761 16998 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.060743 16994 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15
I20260709 12:16:58.063606 17113 raft_consensus.cc:2749] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.088109 16998 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.090572 16998 tablet_bootstrap.cc:492] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.091293 16998 ts_tablet_manager.cc:1403] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:16:58.093986 16998 raft_consensus.cc:359] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.094908 16998 raft_consensus.cc:740] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.095739 16998 consensus_queue.cc:260] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.099023 16998 ts_tablet_manager.cc:1434] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:58.099771 16998 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.142925  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:46255
I20260709 12:16:58.146863 17159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:46255 every 8 connection(s)
I20260709 12:16:58.204589 17127 raft_consensus.cc:3060] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.205350 17120 raft_consensus.cc:3060] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.223423 17160 heartbeater.cc:344] Connected to a master server at 127.7.137.62:40141
I20260709 12:16:58.223989 17160 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:58.225026 17160 heartbeater.cc:507] Master 127.7.137.62:40141 requested a full tablet report, sending...
W20260709 12:16:58.246379 16244 consensus_peers.cc:597] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:58.265316 17125 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.280570 17118 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.286388 17098 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.297294 17095 raft_consensus.cc:3060] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.347543 16998 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.349720 16998 tablet_bootstrap.cc:492] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.350914 16998 ts_tablet_manager.cc:1403] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.251s	user 0.080s	sys 0.090s
I20260709 12:16:58.354288 16998 raft_consensus.cc:359] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.355291 16998 raft_consensus.cc:740] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.356221 16998 consensus_queue.cc:260] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.358968 16998 ts_tablet_manager.cc:1434] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:58.360082 16998 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.364447 17113 raft_consensus.cc:493] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.365075 17113 raft_consensus.cc:515] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.368690 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e" is_pre_election: true
I20260709 12:16:58.374562 17113 leader_election.cc:290] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:16:58.376327 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115b0258196c44cf8e08f3a410ef0b5e" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bde8efa60f914da8a818213518c2b4ca" is_pre_election: true
I20260709 12:16:58.382422 16994 leader_election.cc:304] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b664722e94372a346a6d621adaa9e; no voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca
I20260709 12:16:58.387323 17113 raft_consensus.cc:2749] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.395177 16998 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.396852 16998 tablet_bootstrap.cc:492] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.397773 16998 ts_tablet_manager.cc:1403] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.038s	user 0.031s	sys 0.001s
I20260709 12:16:58.401844 16998 raft_consensus.cc:359] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.402796 16998 raft_consensus.cc:740] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.403861 16998 consensus_queue.cc:260] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.406672 16998 ts_tablet_manager.cc:1434] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:58.407759 16998 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.448597 17095 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.477468 16998 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.478854 16998 tablet_bootstrap.cc:492] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.479633 16998 ts_tablet_manager.cc:1403] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.003s
I20260709 12:16:58.482499 16998 raft_consensus.cc:359] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:58.483271 16998 raft_consensus.cc:740] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.483952 16998 consensus_queue.cc:260] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:58.486115 16998 ts_tablet_manager.cc:1434] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:58.486969 16998 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.495496 16101 ts_manager.cc:194] Re-registered known tserver with Master: 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:16:58.511176 16998 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.512115 16998 tablet_bootstrap.cc:492] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.512694 16998 ts_tablet_manager.cc:1403] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:16:58.515007 16998 raft_consensus.cc:359] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.515597 16998 raft_consensus.cc:740] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.516290 16998 consensus_queue.cc:260] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:58.518100 16998 ts_tablet_manager.cc:1434] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:58.518841 16998 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.550172 16101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56364
I20260709 12:16:58.556056 17160 heartbeater.cc:499] Master 127.7.137.62:40141 was elected leader, sending a full tablet report...
I20260709 12:16:58.630200 17095 raft_consensus.cc:3060] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.644426 16998 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.645524 16998 tablet_bootstrap.cc:492] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.646147 16998 ts_tablet_manager.cc:1403] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.127s	user 0.023s	sys 0.043s
I20260709 12:16:58.648957 16998 raft_consensus.cc:359] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.649699 16998 raft_consensus.cc:740] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.650556 16998 consensus_queue.cc:260] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.657855 16998 ts_tablet_manager.cc:1434] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:16:58.658883 16998 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.684769 16998 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.685837 16998 tablet_bootstrap.cc:492] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.686568 16998 ts_tablet_manager.cc:1403] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.002s
I20260709 12:16:58.689339 16998 raft_consensus.cc:359] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:58.690049 16998 raft_consensus.cc:740] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.690860 16998 consensus_queue.cc:260] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:58.693008 16998 ts_tablet_manager.cc:1434] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:16:58.694476 16998 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:58.724215 17098 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:58.888455 16244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:46255, user_credentials={real_user=slave}} blocked reactor thread for 73390.8us
W20260709 12:16:58.971917 16318 consensus_peers.cc:597] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:58.976325 16998 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:58.986267 16998 tablet_bootstrap.cc:492] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:58.987027 16998 ts_tablet_manager.cc:1403] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.293s	user 0.078s	sys 0.083s
I20260709 12:16:58.989984 16998 raft_consensus.cc:359] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.990731 16998 raft_consensus.cc:740] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.991504 16998 consensus_queue.cc:260] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:58.993840 16998 ts_tablet_manager.cc:1434] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:58.995381 16998 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.047678 16998 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.048888 16998 tablet_bootstrap.cc:492] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.049563 16998 ts_tablet_manager.cc:1403] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.025s
I20260709 12:16:59.051607 16998 raft_consensus.cc:359] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.052727 16998 raft_consensus.cc:740] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.053454 16998 consensus_queue.cc:260] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.064286 16998 ts_tablet_manager.cc:1434] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:16:59.080576 16998 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:59.080958 16318 consensus_peers.cc:597] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:59.105389 16998 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.106509 16998 tablet_bootstrap.cc:492] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.107160 16998 ts_tablet_manager.cc:1403] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 12:16:59.109899 16998 raft_consensus.cc:359] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.110466 16998 raft_consensus.cc:740] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.111091 16998 consensus_queue.cc:260] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.115902 16998 ts_tablet_manager.cc:1434] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:59.116753 16998 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.131935 16998 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.132933 16998 tablet_bootstrap.cc:492] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.133618 16998 ts_tablet_manager.cc:1403] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:16:59.136205 16998 raft_consensus.cc:359] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.136859 16998 raft_consensus.cc:740] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.138885 16998 consensus_queue.cc:260] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.144054 16998 ts_tablet_manager.cc:1434] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:59.144862 16998 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.148679 17095 raft_consensus.cc:3060] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.176230 16244 consensus_peers.cc:597] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:59.195363 16998 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.196569 16998 tablet_bootstrap.cc:492] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.197322 16998 ts_tablet_manager.cc:1403] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.012s
I20260709 12:16:59.200081 16998 raft_consensus.cc:359] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.200770 16998 raft_consensus.cc:740] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.206211 16998 consensus_queue.cc:260] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.208017 16998 ts_tablet_manager.cc:1434] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:59.208935 16998 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:59.236655 16392 consensus_peers.cc:597] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:59.239881 17120 raft_consensus.cc:3060] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.298907 16998 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.300223 16998 tablet_bootstrap.cc:492] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.310981 16998 ts_tablet_manager.cc:1403] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.025s
I20260709 12:16:59.312995 16998 raft_consensus.cc:359] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.313534 16998 raft_consensus.cc:740] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.314136 16998 consensus_queue.cc:260] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.315986 16998 ts_tablet_manager.cc:1434] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:59.316776 16998 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.338181 16998 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.339167 16998 tablet_bootstrap.cc:492] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.339911 16998 ts_tablet_manager.cc:1403] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:16:59.342491 16998 raft_consensus.cc:359] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:59.343262 16998 raft_consensus.cc:740] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.344148 16998 consensus_queue.cc:260] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:16:59.346486 16998 ts_tablet_manager.cc:1434] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:59.347261 16998 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:59.353227 16244 consensus_peers.cc:597] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:59.365801 16998 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.366930 16998 tablet_bootstrap.cc:492] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.367686 16998 ts_tablet_manager.cc:1403] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:16:59.370409 16998 raft_consensus.cc:359] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.371138 16998 raft_consensus.cc:740] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.371831 16998 consensus_queue.cc:260] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.374035 16998 ts_tablet_manager.cc:1434] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:59.375138 16998 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.392376 16998 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.393319 16998 tablet_bootstrap.cc:492] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.393859 16998 ts_tablet_manager.cc:1403] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:16:59.395736 16998 raft_consensus.cc:359] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.396237 16998 raft_consensus.cc:740] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.396785 16998 consensus_queue.cc:260] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.398350 16998 ts_tablet_manager.cc:1434] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:59.399783 16998 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.443425 16998 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.444381 16998 tablet_bootstrap.cc:492] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.445080 16998 ts_tablet_manager.cc:1403] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.008s
I20260709 12:16:59.449081 16998 raft_consensus.cc:359] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.449743 16998 raft_consensus.cc:740] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.450418 16998 consensus_queue.cc:260] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.452569 16998 ts_tablet_manager.cc:1434] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:59.453367 16998 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.481238 16998 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.482275 16998 tablet_bootstrap.cc:492] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.482973 16998 ts_tablet_manager.cc:1403] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:16:59.485579 16998 raft_consensus.cc:359] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.486290 16998 raft_consensus.cc:740] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.487169 16998 consensus_queue.cc:260] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.490073 16998 ts_tablet_manager.cc:1434] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:59.491667 16998 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
W20260709 12:16:59.500608 16244 consensus_peers.cc:597] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:59.627025 16998 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.639065 16998 tablet_bootstrap.cc:492] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.639940 16998 ts_tablet_manager.cc:1403] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.149s	user 0.052s	sys 0.025s
I20260709 12:16:59.643096 16998 raft_consensus.cc:359] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.643884 16998 raft_consensus.cc:740] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.644610 16998 consensus_queue.cc:260] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.646823 16998 ts_tablet_manager.cc:1434] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:59.648048 16998 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.673349 16998 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.674510 16998 tablet_bootstrap.cc:492] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.675283 16998 ts_tablet_manager.cc:1403] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 12:16:59.678563 16998 raft_consensus.cc:359] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.679358 16998 raft_consensus.cc:740] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.680101 16998 consensus_queue.cc:260] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.682384 16998 ts_tablet_manager.cc:1434] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:59.683295 16998 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.684924 17120 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.716344 17120 raft_consensus.cc:3060] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.718216 16998 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.719344 16998 tablet_bootstrap.cc:492] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.720062 16998 ts_tablet_manager.cc:1403] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.007s
I20260709 12:16:59.722561 16998 raft_consensus.cc:359] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.723306 16998 raft_consensus.cc:740] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.723999 16998 consensus_queue.cc:260] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:16:59.725997 16998 ts_tablet_manager.cc:1434] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:59.726822 16998 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.755491 16998 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.758879 16998 tablet_bootstrap.cc:492] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.759668 16998 ts_tablet_manager.cc:1403] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 12:16:59.762624 16998 raft_consensus.cc:359] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.763814 16998 raft_consensus.cc:740] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.764762 16998 consensus_queue.cc:260] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.773844 16998 ts_tablet_manager.cc:1434] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:16:59.774847 16998 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.787724 17127 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.853087 16998 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.854275 16998 tablet_bootstrap.cc:492] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.854995 16998 ts_tablet_manager.cc:1403] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.080s	user 0.046s	sys 0.008s
I20260709 12:16:59.859925 16998 raft_consensus.cc:359] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.860735 16998 raft_consensus.cc:740] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.862031 16998 consensus_queue.cc:260] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.864395 16998 ts_tablet_manager.cc:1434] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:16:59.865365 16998 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.887905 16998 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.888974 16998 tablet_bootstrap.cc:492] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.889784 16998 ts_tablet_manager.cc:1403] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:16:59.892488 16998 raft_consensus.cc:359] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.893275 16998 raft_consensus.cc:740] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.894001 16998 consensus_queue.cc:260] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:16:59.895761 16998 ts_tablet_manager.cc:1434] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:59.896607 16998 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.935110 16998 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.936204 16998 tablet_bootstrap.cc:492] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.936933 16998 ts_tablet_manager.cc:1403] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.012s
I20260709 12:16:59.939570 16998 raft_consensus.cc:359] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.940619 16998 raft_consensus.cc:740] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.941360 16998 consensus_queue.cc:260] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.943809 16998 ts_tablet_manager.cc:1434] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:59.944691 16998 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:16:59.955193 17127 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.955945 16318 consensus_peers.cc:597] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:59.984745 16998 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:59.985770 16998 tablet_bootstrap.cc:492] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:16:59.986440 16998 ts_tablet_manager.cc:1403] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.042s	user 0.036s	sys 0.003s
I20260709 12:16:59.988832 16998 raft_consensus.cc:359] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.989526 16998 raft_consensus.cc:740] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.990198 16998 consensus_queue.cc:260] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:16:59.993546 16998 ts_tablet_manager.cc:1434] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:59.994365 16998 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:17:00.017063 17127 raft_consensus.cc:3060] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.057117 16998 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:00.058158 16998 tablet_bootstrap.cc:492] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:17:00.058904 16998 ts_tablet_manager.cc:1403] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.030s
I20260709 12:17:00.066496 16998 raft_consensus.cc:359] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:00.067360 16998 raft_consensus.cc:740] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.068260 16998 consensus_queue.cc:260] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:00.070485 16998 ts_tablet_manager.cc:1434] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:17:00.071576 17098 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.076399 16998 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Bootstrap starting.
I20260709 12:17:00.102393 17098 raft_consensus.cc:3060] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.124090 16998 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:00.125484 16998 tablet_bootstrap.cc:492] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Bootstrap complete.
I20260709 12:17:00.126865 16998 ts_tablet_manager.cc:1403] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.002s
I20260709 12:17:00.129621 16998 raft_consensus.cc:359] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:00.130498 16998 raft_consensus.cc:740] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.131532 16998 consensus_queue.cc:260] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:00.152801 16998 ts_tablet_manager.cc:1434] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:17:00.421156 17098 raft_consensus.cc:3060] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:04.196738 16449 debug-util.cc:398] Leaking SignalData structure 0x7b080005f480 after lost signal to thread 7719
W20260709 12:17:04.197783 16449 debug-util.cc:398] Leaking SignalData structure 0x7b080011aa80 after lost signal to thread 16137
W20260709 12:17:04.198849 16449 debug-util.cc:398] Leaking SignalData structure 0x7b0800333ca0 after lost signal to thread 16304
W20260709 12:17:04.199759 16449 debug-util.cc:398] Leaking SignalData structure 0x7b0800306e00 after lost signal to thread 16378
W20260709 12:17:04.200727 16449 debug-util.cc:398] Leaking SignalData structure 0x7b08001478a0 after lost signal to thread 16452
W20260709 12:17:04.201824 16449 debug-util.cc:398] Leaking SignalData structure 0x7b0800083180 after lost signal to thread 17159
I20260709 12:17:08.511372  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.570585 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457ef541e8004732abf224552592d3dd"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:08.571393 16352 raft_consensus.cc:606] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:08.573918 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:08.574365 16352 raft_consensus.cc:606] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:08.587052 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "862350edca82469998bc1533fcd8f418"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:08.587627 16276 raft_consensus.cc:606] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:08.600564 16421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:08.600947 17225 raft_consensus.cc:993] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:08.601070 16421 raft_consensus.cc:606] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:08.601603 17247 raft_consensus.cc:1081] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:08.603329 16352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "862350edca82469998bc1533fcd8f418"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51194
I20260709 12:17:08.603909 16352 raft_consensus.cc:493] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.604151 16348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:08.604314 16352 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.604738 16348 raft_consensus.cc:606] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Received request to transfer leadership to TS bde8efa60f914da8a818213518c2b4ca
I20260709 12:17:08.605834  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:08.607475  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:08.608460  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.612877 16352 raft_consensus.cc:515] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.615851 16352 leader_election.cc:290] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:08.616526 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:08.617340 16276 raft_consensus.cc:3055] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.617611 16276 raft_consensus.cc:740] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:08.618175 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862350edca82469998bc1533fcd8f418" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:08.618764 16421 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.618484 16276 consensus_queue.cc:260] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.619812 16276 raft_consensus.cc:3060] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.625936 16276 raft_consensus.cc:2468] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:08.627209 16318 leader_election.cc:304] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:08.628434 17248 raft_consensus.cc:2804] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.632656 17250 raft_consensus.cc:993] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:08.626410 16421 raft_consensus.cc:2468] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:08.633461 17250 raft_consensus.cc:1081] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Signalling peer bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:08.636024 16421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:17:08.636550 16421 raft_consensus.cc:493] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.636950 16421 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.644603 16421 raft_consensus.cc:515] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.647136 16421 leader_election.cc:290] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:08.648589 17248 raft_consensus.cc:697] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:08.649740 17248 consensus_queue.cc:237] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.651505 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:08.651736 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e0c1be74c24bfc83cd8c2b649c857d" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:08.652155 16276 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.652313 16352 raft_consensus.cc:3055] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.652709 16352 raft_consensus.cc:740] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:08.653460 16352 consensus_queue.cc:260] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.654479 16352 raft_consensus.cc:3060] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.660137 16276 raft_consensus.cc:2468] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:08.661448 16392 leader_election.cc:304] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:08.662400 17246 raft_consensus.cc:2804] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.662910 17246 raft_consensus.cc:697] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:08.663820 17246 consensus_queue.cc:237] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.665778 16352 raft_consensus.cc:2468] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:08.680478 16103 catalog_manager.cc:5697] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:08.682999 16101 catalog_manager.cc:5697] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:08.875864 17255 raft_consensus.cc:993] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:08.876334 17250 raft_consensus.cc:1081] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:08.877815 17125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45862
I20260709 12:17:08.878443 17125 raft_consensus.cc:493] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.878791 17125 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.886193 17125 raft_consensus.cc:515] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:08.888806 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:08.889302 16348 raft_consensus.cc:3055] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.889539 16348 raft_consensus.cc:740] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:08.890262 16348 consensus_queue.cc:260] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:08.891152 16348 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.896559 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b08e7c028cd4260a57cc16d538a6431" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:08.897459 16427 raft_consensus.cc:3060] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.898240 16348 raft_consensus.cc:2468] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:08.899371 16992 leader_election.cc:304] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:08.901664 17263 raft_consensus.cc:2804] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.905105 17125 leader_election.cc:290] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:08.907421 16427 raft_consensus.cc:2468] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:08.923413 17263 raft_consensus.cc:697] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:08.925173 17250 raft_consensus.cc:993] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:08.925837 17255 raft_consensus.cc:1081] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:08.925240 17263 consensus_queue.cc:237] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:08.927572 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457ef541e8004732abf224552592d3dd"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45862
I20260709 12:17:08.928113 17118 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.928450 17118 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.940886 17118 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.944365 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:08.944976 16352 raft_consensus.cc:3055] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.945194 16352 raft_consensus.cc:740] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:08.945382 16101 catalog_manager.cc:5697] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 1 to 2, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:08.945914 16352 consensus_queue.cc:260] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.947154 16352 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.948010 17118 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:08.948328 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457ef541e8004732abf224552592d3dd" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:08.948936 16428 raft_consensus.cc:3060] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.957760 16428 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:08.958467 16352 raft_consensus.cc:2468] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:08.958891 16994 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:08.959820 17263 raft_consensus.cc:2804] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.960278 17263 raft_consensus.cc:697] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:08.961062 17263 consensus_queue.cc:237] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:08.985149 16101 catalog_manager.cc:5697] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.080478 16428 raft_consensus.cc:1275] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.081828 17255 consensus_queue.cc:1048] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.092299 16276 raft_consensus.cc:1275] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.095084 17255 consensus_queue.cc:1048] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.174911 17272 raft_consensus.cc:993] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:09.175791 17235 raft_consensus.cc:1081] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:09.177327 16348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51196
I20260709 12:17:09.177759 16348 raft_consensus.cc:493] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:09.178107 16348 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.183575 16348 raft_consensus.cc:515] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:09.186662 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:09.187319 16271 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.187624 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e128886ac9ad43e8b89a82573e4512fb" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:09.188220 16427 raft_consensus.cc:3055] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:09.188519 16427 raft_consensus.cc:740] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:09.189303 16427 consensus_queue.cc:260] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:09.190786 16427 raft_consensus.cc:3060] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.194540 16271 raft_consensus.cc:2468] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:09.186084 16348 leader_election.cc:290] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:09.196815 16318 leader_election.cc:304] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:09.197569 16427 raft_consensus.cc:2468] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:09.197726 17248 raft_consensus.cc:2804] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:09.198297 17248 raft_consensus.cc:697] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:09.199107 17248 consensus_queue.cc:237] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:09.208485 16103 catalog_manager.cc:5697] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.223097 16271 raft_consensus.cc:1275] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.224376 17235 consensus_queue.cc:1048] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.233101 16348 raft_consensus.cc:1275] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.235029 17272 consensus_queue.cc:1048] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.405790 16427 raft_consensus.cc:1275] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:09.407086 17263 consensus_queue.cc:1048] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:09.420833 16348 raft_consensus.cc:1275] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:09.425540 17263 consensus_queue.cc:1048] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:09.533936 16352 raft_consensus.cc:1275] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.535161 17263 consensus_queue.cc:1048] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.549494 16428 raft_consensus.cc:1275] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.550835 17263 consensus_queue.cc:1048] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.611157 16278 raft_consensus.cc:1275] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.612751 17248 consensus_queue.cc:1048] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.628736 16428 raft_consensus.cc:1275] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.630347 17285 consensus_queue.cc:1048] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:09.715835  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.756902 16428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:09.757522 16428 raft_consensus.cc:606] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:09.760365 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:09.761039 16352 raft_consensus.cc:606] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:09.763546 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70a614d403d5457387fe78a772c1a022"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:09.764042 16271 raft_consensus.cc:606] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:09.766304 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96914659c82446db831047bbe79634a6"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:09.766750 16271 raft_consensus.cc:606] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:09.769039 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:09.769510 16352 raft_consensus.cc:606] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Received request to transfer leadership to TS bde8efa60f914da8a818213518c2b4ca
I20260709 12:17:09.770591  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:09.772017  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.772737  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.849974 17280 raft_consensus.cc:993] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:09.850556 17225 raft_consensus.cc:1081] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:09.851922 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70a614d403d5457387fe78a772c1a022"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:09.852360 17118 raft_consensus.cc:493] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:09.852593 17118 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.857348 17118 raft_consensus.cc:515] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:09.858776 17118 leader_election.cc:290] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:17:09.859612 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:09.859747 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70a614d403d5457387fe78a772c1a022" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:09.860301 16427 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.860383 16271 raft_consensus.cc:3055] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.860827 16271 raft_consensus.cc:740] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:09.861565 16271 consensus_queue.cc:260] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:09.862507 16271 raft_consensus.cc:3060] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.865227 16427 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:09.866344 16994 leader_election.cc:304] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:09.867194 17282 raft_consensus.cc:2804] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.867468 16271 raft_consensus.cc:2468] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:09.867642 17282 raft_consensus.cc:697] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:09.868780 17282 consensus_queue.cc:237] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:09.880429 16101 catalog_manager.cc:5697] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.035979 17248 raft_consensus.cc:993] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:10.036476 17248 raft_consensus.cc:1081] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Signalling peer bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:10.038031 16427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:17:10.038586 16427 raft_consensus.cc:493] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.038956 16427 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.051559 16427 raft_consensus.cc:515] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:10.055073 16427 leader_election.cc:290] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:10.059348 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:10.060037 16278 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.064424 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fffe1c659d7f45fa93bdafacea3f9ce1" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:10.065059 16352 raft_consensus.cc:3055] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:10.065359 16352 raft_consensus.cc:740] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:10.065405 17235 raft_consensus.cc:993] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.065930 17235 raft_consensus.cc:1081] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.066166 16352 consensus_queue.cc:260] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:10.067538 16352 raft_consensus.cc:3060] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.067967 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45856
I20260709 12:17:10.068534 17118 raft_consensus.cc:493] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.068593 16278 raft_consensus.cc:2468] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:10.068925 17118 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.071269 16392 leader_election.cc:304] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:10.071816 17285 raft_consensus.cc:993] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.072409 17255 raft_consensus.cc:1081] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.072664 17291 raft_consensus.cc:2804] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:10.073524 17291 raft_consensus.cc:697] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:10.074209 17125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45862
I20260709 12:17:10.074815 17125 raft_consensus.cc:493] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.074501 17291 consensus_queue.cc:237] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:10.075194 17125 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.075331 16352 raft_consensus.cc:2468] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:10.095320 17118 raft_consensus.cc:515] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:10.095607 17125 raft_consensus.cc:515] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.097224 17118 leader_election.cc:290] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:17:10.097497 17125 leader_election.cc:290] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:10.098117 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:10.098754 16427 raft_consensus.cc:3055] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.098801 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:10.099123 16427 raft_consensus.cc:740] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:10.099480 16278 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.099799 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6242d48e3df44f7aa37579a1cf56386f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:10.099963 16427 consensus_queue.cc:260] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:10.100366 16352 raft_consensus.cc:3055] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:10.101107 16427 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.101326 16352 raft_consensus.cc:740] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:10.102124 16352 consensus_queue.cc:260] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.103163 16352 raft_consensus.cc:3060] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.106995 16101 catalog_manager.cc:5697] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.107741 16427 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:10.109057 16994 leader_election.cc:304] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:10.099501 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2369e1f2303b4bd18b96d22c3b994929" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:10.110225 16271 raft_consensus.cc:3060] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.110936 16352 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:10.112128 17282 raft_consensus.cc:2804] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.112668 17282 raft_consensus.cc:697] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:10.113452 17282 consensus_queue.cc:237] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:10.114508 16278 raft_consensus.cc:2468] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:10.117231 16271 raft_consensus.cc:2468] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:10.112156 16992 leader_election.cc:304] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:10.119275 17264 raft_consensus.cc:2804] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:10.128607 17264 raft_consensus.cc:697] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:10.129575 17264 consensus_queue.cc:237] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.136920 17280 raft_consensus.cc:993] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.137416 17247 raft_consensus.cc:1081] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.138093 16101 catalog_manager.cc:5697] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.138816 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96914659c82446db831047bbe79634a6"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:10.139376 17118 raft_consensus.cc:493] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.139719 17118 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.147123 17118 raft_consensus.cc:515] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.148727 17118 leader_election.cc:290] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:10.149320 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:10.149646 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96914659c82446db831047bbe79634a6" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:10.149947 16271 raft_consensus.cc:3055] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.150250 16352 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.150285 16271 raft_consensus.cc:740] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:10.151245 16271 consensus_queue.cc:260] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.152261 16271 raft_consensus.cc:3060] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.158156 16352 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:10.159368 16992 leader_election.cc:304] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:10.159888 16271 raft_consensus.cc:2468] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:10.160115 17264 raft_consensus.cc:2804] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.159507 16101 catalog_manager.cc:5697] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 1 to 2, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.160710 17264 raft_consensus.cc:697] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:10.161651 17264 consensus_queue.cc:237] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:10.174347 16101 catalog_manager.cc:5697] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.296310 16271 raft_consensus.cc:1275] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.297477 17264 consensus_queue.cc:1048] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.321934 16428 raft_consensus.cc:1275] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.323510 17293 consensus_queue.cc:1048] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.534441 16427 raft_consensus.cc:1275] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.535909 17293 consensus_queue.cc:1048] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.548650 16271 raft_consensus.cc:1275] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.549846 17264 consensus_queue.cc:1048] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.631771 16352 raft_consensus.cc:1275] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.633100 17291 consensus_queue.cc:1048] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.641942 16271 raft_consensus.cc:1275] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.643914 17306 consensus_queue.cc:1048] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.690954 16352 raft_consensus.cc:1275] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.692215 17264 consensus_queue.cc:1048] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.701709 16271 raft_consensus.cc:1275] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.703792 17293 consensus_queue.cc:1048] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.715197 16271 raft_consensus.cc:1275] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.716617 17264 consensus_queue.cc:1048] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.726388 16352 raft_consensus.cc:1275] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.727977 17282 consensus_queue.cc:1048] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.814589  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.856506 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:10.857084 16271 raft_consensus.cc:606] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:10.859766 16428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:10.860323 16428 raft_consensus.cc:606] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:10.862769 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:10.863389 16271 raft_consensus.cc:606] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:10.865445 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:10.865921 16271 raft_consensus.cc:606] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:10.868520 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:10.869560 16271 raft_consensus.cc:606] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:10.870754  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:10.872488  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.873242  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.993149 17306 raft_consensus.cc:993] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.993685 17291 raft_consensus.cc:1081] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:10.995323 17125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45856
I20260709 12:17:10.995863 17125 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.996153 17125 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.002076 17125 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:11.003716 17125 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:11.004426 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:11.005106 16352 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.007074 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ea0d617a664190b1f5e4cf3b807bd5" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:11.007735 16428 raft_consensus.cc:3055] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:11.008033 16428 raft_consensus.cc:740] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:11.010705 17247 raft_consensus.cc:993] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.011188 17247 raft_consensus.cc:1081] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.012249 16352 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.010048 16428 consensus_queue.cc:260] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:11.014055 16992 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:11.016263 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:11.016821 17118 raft_consensus.cc:493] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.017145 17118 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.014210 16428 raft_consensus.cc:3060] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.023507 17264 raft_consensus.cc:2804] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.024091 17264 raft_consensus.cc:697] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:11.025002 17264 consensus_queue.cc:237] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:11.026648 17247 raft_consensus.cc:993] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.027112 17247 raft_consensus.cc:1081] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.027623 17280 raft_consensus.cc:993] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.028076 17247 raft_consensus.cc:1081] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:11.027890 17118 raft_consensus.cc:515] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.029986 17125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:11.030933 17125 raft_consensus.cc:493] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.031535 17125 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.033020 17087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:11.033619 17087 raft_consensus.cc:493] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.033962 17087 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.037802 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:11.038506 16352 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.040475 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b10175cba84c73816eb6b8bfb0ed55" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:11.041067 16278 raft_consensus.cc:3055] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:11.040688 17125 raft_consensus.cc:515] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.041399 16278 raft_consensus.cc:740] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:11.042177 16278 consensus_queue.cc:260] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.042969 17125 leader_election.cc:290] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:11.043365 16278 raft_consensus.cc:3060] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.048087 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:11.044859 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2900d9ea1c427ab2b3dea2db3a6e61" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:11.048671 16276 raft_consensus.cc:3055] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:11.048748 16353 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.049054 16276 raft_consensus.cc:740] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:11.049924 16276 consensus_queue.cc:260] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.051132 16276 raft_consensus.cc:3060] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.060465 17087 raft_consensus.cc:515] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.066011 16276 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:11.068958 16992 leader_election.cc:304] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:11.069897 17087 leader_election.cc:290] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:11.070241 17282 raft_consensus.cc:2804] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:11.060282 16353 raft_consensus.cc:2468] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:11.071843 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:11.072492 16348 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.070808 17282 raft_consensus.cc:697] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:11.074474 17282 consensus_queue.cc:237] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.081024 16103 catalog_manager.cc:5697] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.093117 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f740872ebf4b868aae02d23315877f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:11.093842 16276 raft_consensus.cc:3055] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:11.094214 16276 raft_consensus.cc:740] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:11.099890 16276 consensus_queue.cc:260] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.102687 16276 raft_consensus.cc:3060] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.105541 16348 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.107197 16992 leader_election.cc:304] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:11.108047 17293 raft_consensus.cc:2804] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.108521 17293 raft_consensus.cc:697] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:11.109396 17293 consensus_queue.cc:237] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.110549 16276 raft_consensus.cc:2468] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.115487 17118 leader_election.cc:290] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:11.127733 16278 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.120790 16352 raft_consensus.cc:2468] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.133894 16992 leader_election.cc:304] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:11.136102 17293 raft_consensus.cc:2804] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.136909 17293 raft_consensus.cc:697] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:11.137912 17293 consensus_queue.cc:237] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:11.125129 16428 raft_consensus.cc:2468] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:11.174525 16103 catalog_manager.cc:5697] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.175957 16103 catalog_manager.cc:5697] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 1 to 2, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.177168 16103 catalog_manager.cc:5697] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.181699 17280 raft_consensus.cc:993] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:11.182258 17280 raft_consensus.cc:1081] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:11.183974 16352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51194
I20260709 12:17:11.184486 16352 raft_consensus.cc:493] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:11.184815 16352 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.191489 16352 raft_consensus.cc:515] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:11.193344 16352 leader_election.cc:290] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:11.194332 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:11.194927 16427 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.198474 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14f4ff55edf4aec8fec38b5631debbe" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:11.199016 16278 raft_consensus.cc:3055] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:11.199363 16278 raft_consensus.cc:740] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:11.200070 16278 consensus_queue.cc:260] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:11.200899 16427 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:11.201393 16278 raft_consensus.cc:3060] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.202119 16320 leader_election.cc:304] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:11.203155 17300 raft_consensus.cc:2804] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:11.203685 17300 raft_consensus.cc:697] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:11.204586 17300 consensus_queue.cc:237] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:11.207791 16278 raft_consensus.cc:2468] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:11.216306 16103 catalog_manager.cc:5697] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.441156 16353 raft_consensus.cc:1275] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.442721 17293 consensus_queue.cc:1048] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.453128 16427 raft_consensus.cc:1275] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.454687 17293 consensus_queue.cc:1048] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.511936 16276 raft_consensus.cc:1275] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.513146 17293 consensus_queue.cc:1048] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.522257 16352 raft_consensus.cc:1275] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.524559 17293 consensus_queue.cc:1048] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.538491 16271 raft_consensus.cc:1275] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.540932 17293 consensus_queue.cc:1048] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.541999 16352 raft_consensus.cc:1275] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.543576 17293 consensus_queue.cc:1048] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.553691 16353 raft_consensus.cc:1275] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.558138 17264 consensus_queue.cc:1048] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.585608 16276 raft_consensus.cc:1275] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.589363 17293 consensus_queue.cc:1048] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.652338 16271 raft_consensus.cc:1275] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.653443 17285 consensus_queue.cc:1048] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.663530 16427 raft_consensus.cc:1275] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.664976 17300 consensus_queue.cc:1048] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.909612  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:11.945148 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26698bcad1684a86a906817a779878ba"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:11.945658 16276 raft_consensus.cc:606] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:11.948055 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:11.948508 16353 raft_consensus.cc:606] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:11.950656 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:11.951095 16276 raft_consensus.cc:606] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:11.953265 16271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde"
dest_uuid: "d4b26d78497741df932d87016bbc9a15"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:51518
I20260709 12:17:11.953786 16271 raft_consensus.cc:606] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:11.954803  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:11.955951  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:11.956466  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.258420 17225 raft_consensus.cc:993] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.258901 17280 raft_consensus.cc:1081] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.260274 17087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:12.260735 17087 raft_consensus.cc:493] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.261024 17087 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.267007 17087 raft_consensus.cc:515] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:12.269241 17087 leader_election.cc:290] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:12.270542 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:12.270949 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d18ca29fb0b4817b4d87bc6840c4b04" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:12.271152 16276 raft_consensus.cc:3055] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:12.271590 16352 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.272168 16276 raft_consensus.cc:740] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:12.272936 16276 consensus_queue.cc:260] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:12.273890 16276 raft_consensus.cc:3060] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.277138 16352 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:12.278298 16992 leader_election.cc:304] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e; no voters: 
I20260709 12:17:12.278900 16276 raft_consensus.cc:2468] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:12.279181 17264 raft_consensus.cc:2804] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:12.279811 17264 raft_consensus.cc:697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:12.280683 17264 consensus_queue.cc:237] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } }
I20260709 12:17:12.287348 17280 raft_consensus.cc:993] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.287791 17225 raft_consensus.cc:1081] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.289305 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45852
I20260709 12:17:12.289734 17118 raft_consensus.cc:493] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.289979 17118 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.293828 16100 catalog_manager.cc:5697] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.297483 17118 raft_consensus.cc:515] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:12.300047 17118 leader_election.cc:290] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:17:12.300902 16427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:12.301494 16427 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.310813 16427 raft_consensus.cc:2468] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:12.311100 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3baaf1b0f43f59cfe39fba8bb4dde" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:12.313094 16994 leader_election.cc:304] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:12.313464 16276 raft_consensus.cc:3055] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:12.313817 16276 raft_consensus.cc:740] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:12.313932 17264 raft_consensus.cc:2804] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:12.314785 17264 raft_consensus.cc:697] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:12.314859 16276 consensus_queue.cc:260] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:12.316058 16276 raft_consensus.cc:3060] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.315780 17264 consensus_queue.cc:237] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:12.324316 16276 raft_consensus.cc:2468] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:12.330394 16100 catalog_manager.cc:5697] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 1 to 2, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.333523 17280 raft_consensus.cc:993] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:12.334026 17225 raft_consensus.cc:1081] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:12.335656 16352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26698bcad1684a86a906817a779878ba"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51194
I20260709 12:17:12.336130 16352 raft_consensus.cc:493] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.336395 16352 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.341624 16352 raft_consensus.cc:515] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:12.343216 16352 leader_election.cc:290] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:12.344868 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:12.345530 16428 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.346400 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:12.346922 16276 raft_consensus.cc:3055] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:12.347154 16276 raft_consensus.cc:740] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4b26d78497741df932d87016bbc9a15, State: Running, Role: LEADER
I20260709 12:17:12.347882 16276 consensus_queue.cc:260] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:12.348773 16276 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:12.350768 16428 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:12.351878 16320 leader_election.cc:304] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:12.352581 17300 raft_consensus.cc:2804] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:12.353048 17300 raft_consensus.cc:697] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:12.353929 17300 consensus_queue.cc:237] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:12.354508 16276 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:12.369133 16100 catalog_manager.cc:5697] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from d4b26d78497741df932d87016bbc9a15 (127.7.137.2) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.561662 17335 raft_consensus.cc:993] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.563731 17335 raft_consensus.cc:1081] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:12.574479 17087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45862
I20260709 12:17:12.575775 17087 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.576339 17087 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.594379 17087 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:12.600292 17087 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Requested vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:12.600636 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:12.601917 16353 raft_consensus.cc:3055] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:12.602424 16353 raft_consensus.cc:740] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:12.605556 16353 consensus_queue.cc:260] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:12.607359 16353 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.608767 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300c2bb3f55044b295cab5e11e366867" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:12.609455 16428 raft_consensus.cc:3060] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.618755 16428 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:12.618752 16353 raft_consensus.cc:2468] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 3.
I20260709 12:17:12.620083 16994 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:12.620988 17282 raft_consensus.cc:2804] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:12.621454 17282 raft_consensus.cc:697] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:12.622629 17282 consensus_queue.cc:237] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:12.637658 16100 catalog_manager.cc:5697] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 2 to 3, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 3 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.750257 16428 raft_consensus.cc:1275] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:12.751505 17282 consensus_queue.cc:1048] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.764101 16276 raft_consensus.cc:1275] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:12.768643 17354 consensus_queue.cc:1048] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:12.782490 16276 raft_consensus.cc:1275] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:12.783828 17300 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.799672 16428 raft_consensus.cc:1275] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:12.801141 17300 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.804910 16276 raft_consensus.cc:1275] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:12.806348 17354 consensus_queue.cc:1048] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:12.827054 16352 raft_consensus.cc:1275] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:12.829046 17264 consensus_queue.cc:1048] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.998829  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.042994 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26698bcad1684a86a906817a779878ba"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:13.043725 16352 raft_consensus.cc:606] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Received request to transfer leadership to TS bde8efa60f914da8a818213518c2b4ca
I20260709 12:17:13.045055  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:13.046802  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:13.047792  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.114343 16428 raft_consensus.cc:1275] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:13.115666 17282 consensus_queue.cc:1048] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.130303 16352 raft_consensus.cc:1275] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:13.131662 17354 consensus_queue.cc:1048] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.366717 17300 raft_consensus.cc:993] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:13.367341 17300 raft_consensus.cc:1081] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Signalling peer bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:13.372517 16421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26698bcad1684a86a906817a779878ba"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:17:13.373152 16421 raft_consensus.cc:493] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:13.373533 16421 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.384290 16421 raft_consensus.cc:515] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:13.386253 16421 leader_election.cc:290] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:13.387593 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:13.388294 16273 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.388427 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26698bcad1684a86a906817a779878ba" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:13.389057 16352 raft_consensus.cc:3055] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.389323 16352 raft_consensus.cc:740] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:13.390095 16352 consensus_queue.cc:260] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:13.391350 16352 raft_consensus.cc:3060] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.400303 16352 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 3.
I20260709 12:17:13.401530 16392 leader_election.cc:304] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:13.406096 16273 raft_consensus.cc:2468] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 3.
I20260709 12:17:13.407891 17306 raft_consensus.cc:2804] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:13.415169 17306 raft_consensus.cc:697] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 3 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:13.416244 17306 consensus_queue.cc:237] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:13.435488 16103 catalog_manager.cc:5697] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 2 to 3, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 3 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.944924 16273 raft_consensus.cc:1275] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:13.946192 17306 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.956694 16352 raft_consensus.cc:1275] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:13.958353 17365 consensus_queue.cc:1048] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:14.086211  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:14.123302 16428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863095d43c5442399227ac8c352a6213"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:14.123768 16428 raft_consensus.cc:606] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:14.125021  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:14.126195  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:14.126740  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:14.348729 17350 raft_consensus.cc:993] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:14.349545 17373 raft_consensus.cc:1081] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:14.351081 16353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863095d43c5442399227ac8c352a6213"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51196
I20260709 12:17:14.351671 16353 raft_consensus.cc:493] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.352012 16353 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.360026 16353 raft_consensus.cc:515] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:14.364004 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:14.364665 16276 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.375773 16276 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:14.377242 16318 leader_election.cc:304] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:14.377375 16353 leader_election.cc:290] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:14.378333 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:14.378795 17248 raft_consensus.cc:2804] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:14.378945 16428 raft_consensus.cc:3055] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:14.379392 16428 raft_consensus.cc:740] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:14.381256 16428 consensus_queue.cc:260] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:14.383023 17248 raft_consensus.cc:697] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:14.383759 16428 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.385681 17248 consensus_queue.cc:237] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:14.397503 16103 catalog_manager.cc:5697] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.401603 16428 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:14.770206 16428 raft_consensus.cc:1275] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.771386 17248 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:14.795734 16273 raft_consensus.cc:1275] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.797322 17248 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:15.165038  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:15.203559 16348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863095d43c5442399227ac8c352a6213"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:15.204200 16348 raft_consensus.cc:606] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Received request to transfer leadership to TS bde8efa60f914da8a818213518c2b4ca
I20260709 12:17:15.205508  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:15.207145  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:15.207916  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:15.395278 17377 raft_consensus.cc:993] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:15.395877 17389 raft_consensus.cc:1081] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Signalling peer bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:15.397395 16421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863095d43c5442399227ac8c352a6213"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:17:15.397905 16421 raft_consensus.cc:493] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:15.398198 16421 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.404062 16421 raft_consensus.cc:515] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:15.406987 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:15.407671 16352 raft_consensus.cc:3055] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.408000 16352 raft_consensus.cc:740] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:15.408715 16352 consensus_queue.cc:260] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:15.406093 16421 leader_election.cc:290] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:15.409953 16352 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.412104 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863095d43c5442399227ac8c352a6213" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:15.412711 16276 raft_consensus.cc:3060] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.418256 16352 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 3.
I20260709 12:17:15.420923 16392 leader_election.cc:304] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, bde8efa60f914da8a818213518c2b4ca; no voters: 
I20260709 12:17:15.421850 17306 raft_consensus.cc:2804] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:15.421885 16276 raft_consensus.cc:2468] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 3.
I20260709 12:17:15.422502 17306 raft_consensus.cc:697] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 3 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:15.424177 17306 consensus_queue.cc:237] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:15.434554 16100 catalog_manager.cc:5697] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 2 to 3, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 3 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.926826 16276 raft_consensus.cc:1275] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:15.928088 17388 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.941401 16352 raft_consensus.cc:1275] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:15.943298 17388 consensus_queue.cc:1048] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:16.248359  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:16.285277 16421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:16.285816 16421 raft_consensus.cc:606] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Received request to transfer leadership to TS a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:16.287001  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:16.288825  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:16.289640  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:16.748663 17395 raft_consensus.cc:993] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: : Instructing follower a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:16.749234 17395 raft_consensus.cc:1081] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Signalling peer a7f2df769fee4fb7894cdbb752cab97e to start an election
I20260709 12:17:16.750782 16353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
 from {username='slave'} at 127.0.0.1:51196
I20260709 12:17:16.751288 16353 raft_consensus.cc:493] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:16.751574 16353 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.756656 16353 raft_consensus.cc:515] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:16.758316 16353 leader_election.cc:290] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779)
I20260709 12:17:16.759433 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:16.759302 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5109a72f97348a6b66b2a2541c30448" candidate_uuid: "a7f2df769fee4fb7894cdbb752cab97e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:16.760228 16273 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.760365 16421 raft_consensus.cc:3055] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.760867 16421 raft_consensus.cc:740] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:16.761654 16421 consensus_queue.cc:260] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:16.762737 16421 raft_consensus.cc:3060] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.765321 16273 raft_consensus.cc:2468] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:16.767637 16318 leader_election.cc:304] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7f2df769fee4fb7894cdbb752cab97e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:16.768253 16421 raft_consensus.cc:2468] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7f2df769fee4fb7894cdbb752cab97e in term 2.
I20260709 12:17:16.768543 17389 raft_consensus.cc:2804] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:16.769148 17389 raft_consensus.cc:697] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Becoming Leader. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:16.770063 17389 consensus_queue.cc:237] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:16.780421 16100 catalog_manager.cc:5697] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e reported cstate change: term changed from 1 to 2, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3). New cstate: current_term: 2 leader_uuid: "a7f2df769fee4fb7894cdbb752cab97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.204989 16421 raft_consensus.cc:1275] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:17.206265 17377 consensus_queue.cc:1048] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.219871 16276 raft_consensus.cc:1275] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer a7f2df769fee4fb7894cdbb752cab97e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:17.221478 17409 consensus_queue.cc:1048] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.331108  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.370008 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565"
dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
mode: GRACEFUL
new_leader_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:57764
I20260709 12:17:17.370610 16352 raft_consensus.cc:606] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Received request to transfer leadership to TS bde8efa60f914da8a818213518c2b4ca
I20260709 12:17:17.371994  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:17.373234  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:17.373849  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.577191 17409 raft_consensus.cc:993] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: : Instructing follower bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:17.577664 17389 raft_consensus.cc:1081] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Signalling peer bde8efa60f914da8a818213518c2b4ca to start an election
I20260709 12:17:17.579058 16428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:17:17.579586 16428 raft_consensus.cc:493] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.579877 16428 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.584690 16428 raft_consensus.cc:515] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:17.586002 16428 leader_election.cc:290] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Requested vote from peers d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
I20260709 12:17:17.586670 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:17.587302 16273 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.587991 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab64c621e79c4de99600ba8b24da4565" candidate_uuid: "bde8efa60f914da8a818213518c2b4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7f2df769fee4fb7894cdbb752cab97e"
I20260709 12:17:17.588567 16353 raft_consensus.cc:3055] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.588860 16353 raft_consensus.cc:740] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7f2df769fee4fb7894cdbb752cab97e, State: Running, Role: LEADER
I20260709 12:17:17.589618 16353 consensus_queue.cc:260] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:17.590926 16353 raft_consensus.cc:3060] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.596863 16273 raft_consensus.cc:2468] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:17.597533 16353 raft_consensus.cc:2468] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bde8efa60f914da8a818213518c2b4ca in term 2.
I20260709 12:17:17.598057 16392 leader_election.cc:304] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:17.599406 17395 raft_consensus.cc:2804] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:17.599967 17395 raft_consensus.cc:697] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Becoming Leader. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:17.600943 17395 consensus_queue.cc:237] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:17.611662 16101 catalog_manager.cc:5697] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca reported cstate change: term changed from 1 to 2, leader changed from a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3) to bde8efa60f914da8a818213518c2b4ca (127.7.137.4). New cstate: current_term: 2 leader_uuid: "bde8efa60f914da8a818213518c2b4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:18.057116 16353 raft_consensus.cc:1275] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:18.058396 17395 consensus_queue.cc:1048] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:18.074229 16276 raft_consensus.cc:1275] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer bde8efa60f914da8a818213518c2b4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:18.076117 17413 consensus_queue.cc:1048] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:18.411417  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.447347 16421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f"
dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
mode: GRACEFUL
new_leader_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:50566
I20260709 12:17:18.447836 16421 raft_consensus.cc:606] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Received request to transfer leadership to TS 371b664722e94372a346a6d621adaa9e
I20260709 12:17:18.448863  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:18.449990  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:18.450522  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.932415 17395 raft_consensus.cc:993] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: : Instructing follower 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:18.932857 17388 raft_consensus.cc:1081] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Signalling peer 371b664722e94372a346a6d621adaa9e to start an election
I20260709 12:17:18.934199 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f"
dest_uuid: "371b664722e94372a346a6d621adaa9e"
 from {username='slave'} at 127.0.0.1:45856
I20260709 12:17:18.934653 17118 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:18.934929 17118 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.940788 17118 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:18.942694 17118 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Requested vote from peers bde8efa60f914da8a818213518c2b4ca (127.7.137.4:43779), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:17:18.943351 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bde8efa60f914da8a818213518c2b4ca"
I20260709 12:17:18.943992 16428 raft_consensus.cc:3055] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:18.943840 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced4db8ec1524a7b8e3ff437ea389c1f" candidate_uuid: "371b664722e94372a346a6d621adaa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d4b26d78497741df932d87016bbc9a15"
I20260709 12:17:18.944346 16428 raft_consensus.cc:740] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bde8efa60f914da8a818213518c2b4ca, State: Running, Role: LEADER
I20260709 12:17:18.944582 16273 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.945372 16428 consensus_queue.cc:260] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:18.946684 16428 raft_consensus.cc:3060] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.951154 16273 raft_consensus.cc:2468] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:18.951623 16428 raft_consensus.cc:2468] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b664722e94372a346a6d621adaa9e in term 2.
I20260709 12:17:18.952529 16992 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15; no voters: 
I20260709 12:17:18.953378 17282 raft_consensus.cc:2804] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:18.953857 17282 raft_consensus.cc:697] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Becoming Leader. State: Replica: 371b664722e94372a346a6d621adaa9e, State: Running, Role: LEADER
I20260709 12:17:18.954664 17282 consensus_queue.cc:237] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:18.963780 16100 catalog_manager.cc:5697] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e reported cstate change: term changed from 1 to 2, leader changed from bde8efa60f914da8a818213518c2b4ca (127.7.137.4) to 371b664722e94372a346a6d621adaa9e (127.7.137.1). New cstate: current_term: 2 leader_uuid: "371b664722e94372a346a6d621adaa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.346660 16421 raft_consensus.cc:1275] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.347790 17426 consensus_queue.cc:1048] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:19.364668 16276 raft_consensus.cc:1275] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Refusing update from remote peer 371b664722e94372a346a6d621adaa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:19.366259 17435 consensus_queue.cc:1048] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:19.488726  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.526134  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:19.527501  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:19.528005  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.566357  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.605146  7716 tablet_server.cc:179] TabletServer@127.7.137.1:46255 shutting down...
W20260709 12:17:19.626163 16392 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 283 similar messages]
I20260709 12:17:19.642586  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:19.643779  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.644965  7716 raft_consensus.cc:2243] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.645514  7716 raft_consensus.cc:2272] T b4b31f6cc7b54ab1b202f40bc200510e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.649868  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.651526  7716 raft_consensus.cc:2243] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.652215  7716 raft_consensus.cc:2272] T b329094fe65047b2b4440a5d7066ab0a P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.659013 16392 consensus_peers.cc:597] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.658636  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.660884  7716 raft_consensus.cc:2243] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.662953  7716 raft_consensus.cc:2272] T 4b08e7c028cd4260a57cc16d538a6431 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.669235  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.670284  7716 raft_consensus.cc:2243] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.671001  7716 raft_consensus.cc:2272] T 1671729a63334f38b4e87d414002c770 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.674229  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.675134  7716 raft_consensus.cc:2243] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:17:19.675401 16392 consensus_peers.cc:597] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.676476  7716 raft_consensus.cc:2272] T 300c2bb3f55044b295cab5e11e366867 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.679450 16244 consensus_peers.cc:597] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.680117  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.681216  7716 raft_consensus.cc:2243] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.682451  7716 raft_consensus.cc:2272] T f1b10175cba84c73816eb6b8bfb0ed55 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.688504  7716 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:19.689131 16392 consensus_peers.cc:597] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.689462  7716 raft_consensus.cc:2243] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.691582  7716 raft_consensus.cc:2272] T 6f9ae53f366a4893a34b5bef50a38f1b P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.691845 16244 consensus_peers.cc:597] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.694535 16244 consensus_peers.cc:597] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.695464  7716 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:19.696341 16318 consensus_peers.cc:597] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.697175 16244 consensus_peers.cc:597] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.697780  7716 raft_consensus.cc:2243] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.698648  7716 raft_consensus.cc:2272] T 520520ce482b48638578a08a887f961f P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.707072  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.708746  7716 raft_consensus.cc:2243] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.709400  7716 raft_consensus.cc:2272] T 48becf037f204145949737e10924ba94 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.711565 16318 consensus_peers.cc:597] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.712320 16318 consensus_peers.cc:597] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.712962 16318 consensus_peers.cc:597] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.714031  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.714972  7716 raft_consensus.cc:2243] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.715939  7716 raft_consensus.cc:2272] T 4d18ca29fb0b4817b4d87bc6840c4b04 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.720072  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.721046  7716 raft_consensus.cc:2243] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.721979  7716 raft_consensus.cc:2272] T ed67f1fe7bfc40cbaa81904b04e85bbe P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.723531 16244 consensus_peers.cc:597] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.724946 16392 consensus_peers.cc:597] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.725157  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.726784  7716 raft_consensus.cc:2243] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:17:19.727522 16318 consensus_peers.cc:597] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.727909  7716 raft_consensus.cc:2272] T 457ef541e8004732abf224552592d3dd P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.730962  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.731724  7716 raft_consensus.cc:2243] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.732218  7716 raft_consensus.cc:2272] T 05fd27468a6e4c88ab3ee076f99a4e73 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.734912  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.735688  7716 raft_consensus.cc:2243] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.736209  7716 raft_consensus.cc:2272] T 68c7f1839b1f45898709d7b951744cd4 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.738485  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.739145  7716 raft_consensus.cc:2243] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.739655  7716 raft_consensus.cc:2272] T eb645de5083941e0a7dd5d4e4cf1a798 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.741811  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.742370  7716 raft_consensus.cc:2243] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.742822  7716 raft_consensus.cc:2272] T 6ba4353bb62b4c0aa4e854be3297184d P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.745290  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.745918  7716 raft_consensus.cc:2243] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.746433  7716 raft_consensus.cc:2272] T 0013e821aa88410fa79bc656b03ec146 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.749390  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.750063  7716 raft_consensus.cc:2243] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.750974  7716 raft_consensus.cc:2272] T 52ea0d617a664190b1f5e4cf3b807bd5 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.754034  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.754839  7716 raft_consensus.cc:2243] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.755971  7716 raft_consensus.cc:2272] T 2369e1f2303b4bd18b96d22c3b994929 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.756860 16244 consensus_peers.cc:597] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.758971  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.759851  7716 raft_consensus.cc:2243] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.760730  7716 raft_consensus.cc:2272] T ced4db8ec1524a7b8e3ff437ea389c1f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.763741  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.764354  7716 raft_consensus.cc:2243] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.764786  7716 raft_consensus.cc:2272] T e9773066f8824befb0ba38e00f26711b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.766850  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.767464  7716 raft_consensus.cc:2243] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.767881  7716 raft_consensus.cc:2272] T 87730c15a7404b79bbd0af9b86a540eb P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.770164  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.770711  7716 raft_consensus.cc:2243] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.771171  7716 raft_consensus.cc:2272] T 0e140631c2f341008091adb103aedea0 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.773245  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.773821  7716 raft_consensus.cc:2243] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.774623  7716 raft_consensus.cc:2272] T d2f740872ebf4b868aae02d23315877f P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.776937  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.777513  7716 raft_consensus.cc:2243] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.777966  7716 raft_consensus.cc:2272] T 097c0d5bee584f93ac4b342c7b129ecd P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.779969  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.780495  7716 raft_consensus.cc:2243] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.780879  7716 raft_consensus.cc:2272] T 4b249075c4bd41b7b53b295ee5b2fc89 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.783088  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.783736  7716 raft_consensus.cc:2243] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.784170  7716 raft_consensus.cc:2272] T e0f5375d913f4705865397203673a5f5 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.786208  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.786747  7716 raft_consensus.cc:2243] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.787125  7716 raft_consensus.cc:2272] T 4ea523de666d4596bdfd1b53225aff83 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.789367  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.790079  7716 raft_consensus.cc:2243] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.790552  7716 raft_consensus.cc:2272] T 2f71fc08eaff42d5901a4921f0051394 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.793403  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.794152  7716 raft_consensus.cc:2243] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.795315  7716 raft_consensus.cc:2272] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.798184  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.798983  7716 raft_consensus.cc:2243] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.799585  7716 raft_consensus.cc:2272] T 115b0258196c44cf8e08f3a410ef0b5e P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.802248  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.802994  7716 raft_consensus.cc:2243] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.803562  7716 raft_consensus.cc:2272] T 311a9b9c003249ef8438269658bcf3e1 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.805280 16244 consensus_peers.cc:597] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.806344  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.807005  7716 raft_consensus.cc:2243] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.807844  7716 raft_consensus.cc:2272] T 96914659c82446db831047bbe79634a6 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.810093  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.810832  7716 raft_consensus.cc:2243] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.811353  7716 raft_consensus.cc:2272] T 83df294335c64a35b675edbe966445f4 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.813640  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.814180  7716 raft_consensus.cc:2243] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.814594  7716 raft_consensus.cc:2272] T 243ed9c1ffe244289120a4bac0d23ca6 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.815755 16392 consensus_peers.cc:597] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.816784  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.817493  7716 raft_consensus.cc:2243] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.818336  7716 raft_consensus.cc:2272] T 6242d48e3df44f7aa37579a1cf56386f P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.820415  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.820953  7716 raft_consensus.cc:2243] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.821367  7716 raft_consensus.cc:2272] T 926305cc352545b3b98774de0464f46b P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.823377  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.824023  7716 raft_consensus.cc:2243] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.824584  7716 raft_consensus.cc:2272] T 49e6d3a14dc24349a70fb2f3910a1fa4 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.826623  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.827171  7716 raft_consensus.cc:2243] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.827622  7716 raft_consensus.cc:2272] T d6155e95b762495aab0bd4e75cfbe8f8 P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.830256  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.830946  7716 raft_consensus.cc:2243] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.831532  7716 raft_consensus.cc:2272] T 35d00760f88247f1a179973d1c7cc34e P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.833315 16244 consensus_peers.cc:597] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.834048  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.834681  7716 raft_consensus.cc:2243] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.835685  7716 raft_consensus.cc:2272] T 70a614d403d5457387fe78a772c1a022 P 371b664722e94372a346a6d621adaa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.838160  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.838708  7716 raft_consensus.cc:2243] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.839150  7716 raft_consensus.cc:2272] T 9541a370ec014267a500f45686395fb8 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.841279  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.841777  7716 raft_consensus.cc:2243] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:19.842507  7716 raft_consensus.cc:2272] T efd3baaf1b0f43f59cfe39fba8bb4dde P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.844503  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.844990  7716 raft_consensus.cc:2243] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.845422  7716 raft_consensus.cc:2272] T 52e7274549d04acc9c7bb43812b87d79 P 371b664722e94372a346a6d621adaa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.847572  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:19.848030  7716 raft_consensus.cc:2243] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.848543  7716 raft_consensus.cc:2272] T 2e4130f8e68e4e1186f8b3e11d38a05c P 371b664722e94372a346a6d621adaa9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:19.850591 16244 consensus_peers.cc:597] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.858402 16244 consensus_peers.cc:597] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.883276 16318 consensus_peers.cc:597] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.916994 16392 consensus_peers.cc:597] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.930603  7716 tablet_server.cc:196] TabletServer@127.7.137.1:46255 shutdown complete.
W20260709 12:17:19.959403 16392 consensus_peers.cc:597] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.959643 16318 consensus_peers.cc:597] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.967531 16244 consensus_peers.cc:597] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:19.983464 16318 consensus_peers.cc:597] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.022948  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:17:20.040179 16392 consensus_peers.cc:597] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.050019 16392 consensus_peers.cc:597] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.075742 16244 consensus_peers.cc:597] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.081247 16392 consensus_peers.cc:597] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.089259  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:17:20.089776 16318 consensus_peers.cc:597] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.092319 16318 consensus_peers.cc:597] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.093079  7716 tablet_replica.cc:333] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.094080  7716 raft_consensus.cc:2243] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.094748  7716 raft_consensus.cc:2272] T f14f4ff55edf4aec8fec38b5631debbe P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.096750 16392 consensus_peers.cc:597] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.097533  7716 tablet_replica.cc:333] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.098340  7716 raft_consensus.cc:2243] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.099135  7716 raft_consensus.cc:2272] T 2e4130f8e68e4e1186f8b3e11d38a05c P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.100487 16318 consensus_peers.cc:597] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e -> Peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Couldn't send request to peer 371b664722e94372a346a6d621adaa9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.101675  7716 tablet_replica.cc:333] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.102380  7716 raft_consensus.cc:2243] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.102921  7716 raft_consensus.cc:2272] T 96914659c82446db831047bbe79634a6 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.105207  7716 tablet_replica.cc:333] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.105819  7716 raft_consensus.cc:2243] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.106235  7716 raft_consensus.cc:2272] T b2d7819347af4afca9881790734e9619 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.108340  7716 tablet_replica.cc:333] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.108952  7716 raft_consensus.cc:2243] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.109483  7716 raft_consensus.cc:2272] T 70a614d403d5457387fe78a772c1a022 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.112457  7716 tablet_replica.cc:333] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.113256  7716 raft_consensus.cc:2243] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.114200  7716 raft_consensus.cc:2272] T 311a9b9c003249ef8438269658bcf3e1 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.116218  7716 tablet_replica.cc:333] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.116792  7716 raft_consensus.cc:2243] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.117265  7716 raft_consensus.cc:2272] T f2e0c1be74c24bfc83cd8c2b649c857d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.119644  7716 tablet_replica.cc:333] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.120255  7716 raft_consensus.cc:2243] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.120787  7716 raft_consensus.cc:2272] T f1b10175cba84c73816eb6b8bfb0ed55 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.123600  7716 tablet_replica.cc:333] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.124409  7716 raft_consensus.cc:2243] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.125243  7716 raft_consensus.cc:2272] T 87730c15a7404b79bbd0af9b86a540eb P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.127513  7716 tablet_replica.cc:333] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.129912  7716 raft_consensus.cc:2243] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.130437  7716 raft_consensus.cc:2272] T 863095d43c5442399227ac8c352a6213 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.133148  7716 tablet_replica.cc:333] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.133944  7716 raft_consensus.cc:2243] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.134507  7716 raft_consensus.cc:2272] T 48becf037f204145949737e10924ba94 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.137856  7716 tablet_replica.cc:333] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.138715  7716 raft_consensus.cc:2243] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.139441  7716 raft_consensus.cc:2272] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.139889 16318 consensus_peers.cc:597] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.141616  7716 tablet_replica.cc:333] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.142210  7716 raft_consensus.cc:2243] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.142925  7716 raft_consensus.cc:2272] T 4ea523de666d4596bdfd1b53225aff83 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.145162  7716 tablet_replica.cc:333] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.145696  7716 raft_consensus.cc:2243] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.146081  7716 raft_consensus.cc:2272] T d2f740872ebf4b868aae02d23315877f P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.148242  7716 tablet_replica.cc:333] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.149359  7716 raft_consensus.cc:2243] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.150110  7716 raft_consensus.cc:2272] T 097c0d5bee584f93ac4b342c7b129ecd P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.152135  7716 tablet_replica.cc:333] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.152707  7716 raft_consensus.cc:2243] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.153471  7716 raft_consensus.cc:2272] T 4b249075c4bd41b7b53b295ee5b2fc89 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.155575  7716 tablet_replica.cc:333] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.156208  7716 raft_consensus.cc:2243] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.156970  7716 raft_consensus.cc:2272] T e0f5375d913f4705865397203673a5f5 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.159204  7716 tablet_replica.cc:333] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.159821  7716 raft_consensus.cc:2243] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.160354  7716 raft_consensus.cc:2272] T fffe1c659d7f45fa93bdafacea3f9ce1 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.163379  7716 tablet_replica.cc:333] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.164167  7716 raft_consensus.cc:2243] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.165170  7716 raft_consensus.cc:2272] T 988b9e49e49b4d469474bbc23cf32e6d P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.167847  7716 tablet_replica.cc:333] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.168658  7716 raft_consensus.cc:2243] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.169160  7716 raft_consensus.cc:2272] T 6f9ae53f366a4893a34b5bef50a38f1b P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.171435  7716 tablet_replica.cc:333] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.171892  7716 raft_consensus.cc:2243] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.172232  7716 raft_consensus.cc:2272] T 83df294335c64a35b675edbe966445f4 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.174012  7716 tablet_replica.cc:333] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.174502  7716 raft_consensus.cc:2243] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.174860  7716 raft_consensus.cc:2272] T ced4db8ec1524a7b8e3ff437ea389c1f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.177317  7716 tablet_replica.cc:333] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.177814  7716 raft_consensus.cc:2243] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.178709  7716 raft_consensus.cc:2272] T 0013e821aa88410fa79bc656b03ec146 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.180680  7716 tablet_replica.cc:333] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.181210  7716 raft_consensus.cc:2243] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.181695  7716 raft_consensus.cc:2272] T 2369e1f2303b4bd18b96d22c3b994929 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.184013  7716 tablet_replica.cc:333] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.184650  7716 raft_consensus.cc:2243] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.185174  7716 raft_consensus.cc:2272] T ab64c621e79c4de99600ba8b24da4565 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.185881 16392 consensus_peers.cc:597] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.187753  7716 tablet_replica.cc:333] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.188683  7716 raft_consensus.cc:2243] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.189273  7716 raft_consensus.cc:2272] T 06d90126bf2c4c43b7021634cef076aa P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.191949  7716 tablet_replica.cc:333] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
W20260709 12:17:20.192034 16392 consensus_peers.cc:597] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.192739  7716 raft_consensus.cc:2243] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.193686  7716 raft_consensus.cc:2272] T 35d00760f88247f1a179973d1c7cc34e P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.196463  7716 tablet_replica.cc:333] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.197237  7716 raft_consensus.cc:2243] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.198230  7716 raft_consensus.cc:2272] T 49e6d3a14dc24349a70fb2f3910a1fa4 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.201051  7716 tablet_replica.cc:333] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
W20260709 12:17:20.201496 16318 consensus_peers.cc:597] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.201844  7716 raft_consensus.cc:2243] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.202443  7716 raft_consensus.cc:2272] T 862350edca82469998bc1533fcd8f418 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.205176  7716 tablet_replica.cc:333] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.205855  7716 raft_consensus.cc:2243] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.206845  7716 raft_consensus.cc:2272] T 0bff55b8f07d462d9bdf2065695fa373 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.208940 16318 consensus_peers.cc:597] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.209498  7716 tablet_replica.cc:333] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.210351  7716 raft_consensus.cc:2243] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.210846  7716 raft_consensus.cc:2272] T 4d18ca29fb0b4817b4d87bc6840c4b04 P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.213084  7716 tablet_replica.cc:333] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.213765  7716 raft_consensus.cc:2243] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.214365  7716 raft_consensus.cc:2272] T 26698bcad1684a86a906817a779878ba P d4b26d78497741df932d87016bbc9a15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.217427  7716 tablet_replica.cc:333] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
W20260709 12:17:20.218119 16318 consensus_peers.cc:597] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.218283  7716 raft_consensus.cc:2243] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.218883  7716 raft_consensus.cc:2272] T 9cf91fbb29104b44a4abee852fbe043e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.221318  7716 tablet_replica.cc:333] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.221977  7716 raft_consensus.cc:2243] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.222411  7716 raft_consensus.cc:2272] T e128886ac9ad43e8b89a82573e4512fb P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.224628  7716 tablet_replica.cc:333] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.225147  7716 raft_consensus.cc:2243] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.225987  7716 raft_consensus.cc:2272] T b4b31f6cc7b54ab1b202f40bc200510e P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.228168  7716 tablet_replica.cc:333] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.228689  7716 raft_consensus.cc:2243] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.229583  7716 raft_consensus.cc:2272] T eb645de5083941e0a7dd5d4e4cf1a798 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.231633  7716 tablet_replica.cc:333] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.232299  7716 raft_consensus.cc:2243] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.232878  7716 raft_consensus.cc:2272] T a5109a72f97348a6b66b2a2541c30448 P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.235421  7716 tablet_replica.cc:333] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.236261  7716 raft_consensus.cc:2243] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.236912  7716 raft_consensus.cc:2272] T ed67f1fe7bfc40cbaa81904b04e85bbe P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.237026 16392 consensus_peers.cc:597] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.239727  7716 tablet_replica.cc:333] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.240577  7716 raft_consensus.cc:2243] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.241158  7716 raft_consensus.cc:2272] T 6ba4353bb62b4c0aa4e854be3297184d P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.244259  7716 tablet_replica.cc:333] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.245034  7716 raft_consensus.cc:2243] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.245659  7716 raft_consensus.cc:2272] T efd3baaf1b0f43f59cfe39fba8bb4dde P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.246080 16392 consensus_peers.cc:597] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.247844  7716 tablet_replica.cc:333] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.248487  7716 raft_consensus.cc:2243] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.248958  7716 raft_consensus.cc:2272] T e9773066f8824befb0ba38e00f26711b P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.251330  7716 tablet_replica.cc:333] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.251895  7716 raft_consensus.cc:2243] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.252427  7716 raft_consensus.cc:2272] T 6242d48e3df44f7aa37579a1cf56386f P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.255467  7716 tablet_replica.cc:333] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.256222  7716 raft_consensus.cc:2243] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.257355  7716 raft_consensus.cc:2272] T 243ed9c1ffe244289120a4bac0d23ca6 P d4b26d78497741df932d87016bbc9a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.260004  7716 tablet_replica.cc:333] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15: stopping tablet replica
I20260709 12:17:20.260499  7716 raft_consensus.cc:2243] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.260993  7716 raft_consensus.cc:2272] T b329094fe65047b2b4440a5d7066ab0a P d4b26d78497741df932d87016bbc9a15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.271456 16392 consensus_peers.cc:597] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.281388 16318 consensus_peers.cc:597] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.339349  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
W20260709 12:17:20.400288 16318 consensus_peers.cc:597] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.421898  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
W20260709 12:17:20.463596 16392 consensus_peers.cc:597] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.468657 16392 consensus_peers.cc:597] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.470474  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:20.471312  7716 tablet_replica.cc:333] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.471989  7716 raft_consensus.cc:2243] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.472817  7716 raft_consensus.cc:2272] T f14f4ff55edf4aec8fec38b5631debbe P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.474818  7716 tablet_replica.cc:333] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.475485  7716 raft_consensus.cc:2243] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.475932  7716 raft_consensus.cc:2272] T 311a9b9c003249ef8438269658bcf3e1 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.477887  7716 tablet_replica.cc:333] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.478456  7716 raft_consensus.cc:2243] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.478878  7716 raft_consensus.cc:2272] T b2d7819347af4afca9881790734e9619 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.481487  7716 tablet_replica.cc:333] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.482379  7716 raft_consensus.cc:2243] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.482941  7716 raft_consensus.cc:2272] T f1b10175cba84c73816eb6b8bfb0ed55 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.485484  7716 tablet_replica.cc:333] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.486038  7716 raft_consensus.cc:2243] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.486490  7716 raft_consensus.cc:2272] T d6155e95b762495aab0bd4e75cfbe8f8 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.488688  7716 tablet_replica.cc:333] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.489256  7716 raft_consensus.cc:2243] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.489759  7716 raft_consensus.cc:2272] T 96914659c82446db831047bbe79634a6 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.491590  7716 tablet_replica.cc:333] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.492129  7716 raft_consensus.cc:2243] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.492956  7716 raft_consensus.cc:2272] T 2f71fc08eaff42d5901a4921f0051394 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.494874  7716 tablet_replica.cc:333] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.495532  7716 raft_consensus.cc:2243] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.496111  7716 raft_consensus.cc:2272] T 4d2900d9ea1c427ab2b3dea2db3a6e61 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.498018  7716 tablet_replica.cc:333] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.498580  7716 raft_consensus.cc:2243] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.499409  7716 raft_consensus.cc:2272] T e128886ac9ad43e8b89a82573e4512fb P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.501327  7716 tablet_replica.cc:333] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.501879  7716 raft_consensus.cc:2243] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.502327  7716 raft_consensus.cc:2272] T f2e0c1be74c24bfc83cd8c2b649c857d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.504419  7716 tablet_replica.cc:333] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.504990  7716 raft_consensus.cc:2243] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.505429  7716 raft_consensus.cc:2272] T e0f5375d913f4705865397203673a5f5 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.507566  7716 tablet_replica.cc:333] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.508365  7716 raft_consensus.cc:2243] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.508792  7716 raft_consensus.cc:2272] T 863095d43c5442399227ac8c352a6213 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.511461  7716 tablet_replica.cc:333] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.512177  7716 raft_consensus.cc:2243] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.512949  7716 raft_consensus.cc:2272] T 0e140631c2f341008091adb103aedea0 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.515340  7716 tablet_replica.cc:333] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.516098  7716 raft_consensus.cc:2243] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.517004  7716 raft_consensus.cc:2272] T 48becf037f204145949737e10924ba94 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.518293 16392 consensus_peers.cc:597] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.519598  7716 tablet_replica.cc:333] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.520503  7716 raft_consensus.cc:2243] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.521461  7716 raft_consensus.cc:2272] T 1671729a63334f38b4e87d414002c770 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.523747  7716 tablet_replica.cc:333] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.524233  7716 raft_consensus.cc:2243] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.524602  7716 raft_consensus.cc:2272] T 4b08e7c028cd4260a57cc16d538a6431 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.526429  7716 tablet_replica.cc:333] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.526923  7716 raft_consensus.cc:2243] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.527376  7716 raft_consensus.cc:2272] T 4d18ca29fb0b4817b4d87bc6840c4b04 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.529201  7716 tablet_replica.cc:333] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.529918  7716 raft_consensus.cc:2243] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.530300  7716 raft_consensus.cc:2272] T ab64c621e79c4de99600ba8b24da4565 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.532276  7716 tablet_replica.cc:333] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.532765  7716 raft_consensus.cc:2243] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.533200  7716 raft_consensus.cc:2272] T 06d90126bf2c4c43b7021634cef076aa P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.535064  7716 tablet_replica.cc:333] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.535688  7716 raft_consensus.cc:2243] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.536093  7716 raft_consensus.cc:2272] T 115b0258196c44cf8e08f3a410ef0b5e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.538321  7716 tablet_replica.cc:333] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.538925  7716 raft_consensus.cc:2243] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.539767  7716 raft_consensus.cc:2272] T 862350edca82469998bc1533fcd8f418 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.541676  7716 tablet_replica.cc:333] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.542220  7716 raft_consensus.cc:2243] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.542982  7716 raft_consensus.cc:2272] T ed67f1fe7bfc40cbaa81904b04e85bbe P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.544811  7716 tablet_replica.cc:333] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.545351  7716 raft_consensus.cc:2243] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.545775  7716 raft_consensus.cc:2272] T 457ef541e8004732abf224552592d3dd P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.547926  7716 tablet_replica.cc:333] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.548627  7716 raft_consensus.cc:2243] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.549562  7716 raft_consensus.cc:2272] T 05fd27468a6e4c88ab3ee076f99a4e73 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.552002  7716 tablet_replica.cc:333] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.552493  7716 raft_consensus.cc:2243] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.552867  7716 raft_consensus.cc:2272] T fffe1c659d7f45fa93bdafacea3f9ce1 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.554544  7716 tablet_replica.cc:333] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.555007  7716 raft_consensus.cc:2243] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.555440  7716 raft_consensus.cc:2272] T 300c2bb3f55044b295cab5e11e366867 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.557284  7716 tablet_replica.cc:333] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.557853  7716 raft_consensus.cc:2243] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.558300  7716 raft_consensus.cc:2272] T 9541a370ec014267a500f45686395fb8 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.560086  7716 tablet_replica.cc:333] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.560544  7716 raft_consensus.cc:2243] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.561363  7716 raft_consensus.cc:2272] T 52e7274549d04acc9c7bb43812b87d79 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.563163  7716 tablet_replica.cc:333] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.563807  7716 raft_consensus.cc:2243] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.564214  7716 raft_consensus.cc:2272] T 520520ce482b48638578a08a887f961f P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.566792  7716 tablet_replica.cc:333] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.567646  7716 raft_consensus.cc:2243] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.568156  7716 raft_consensus.cc:2272] T 988b9e49e49b4d469474bbc23cf32e6d P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.570951  7716 tablet_replica.cc:333] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.571748  7716 raft_consensus.cc:2243] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.572270  7716 raft_consensus.cc:2272] T 0bff55b8f07d462d9bdf2065695fa373 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.574399 16392 consensus_peers.cc:597] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca -> Peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Couldn't send request to peer d4b26d78497741df932d87016bbc9a15. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.575004  7716 tablet_replica.cc:333] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.575677  7716 raft_consensus.cc:2243] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.576139  7716 raft_consensus.cc:2272] T 6242d48e3df44f7aa37579a1cf56386f P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.578194  7716 tablet_replica.cc:333] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.578747  7716 raft_consensus.cc:2243] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.579360  7716 raft_consensus.cc:2272] T 243ed9c1ffe244289120a4bac0d23ca6 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.581954  7716 tablet_replica.cc:333] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.582664  7716 raft_consensus.cc:2243] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.583385  7716 raft_consensus.cc:2272] T 926305cc352545b3b98774de0464f46b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.583300 16392 consensus_peers.cc:597] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.585587  7716 tablet_replica.cc:333] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.586148  7716 raft_consensus.cc:2243] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.586570  7716 raft_consensus.cc:2272] T 52ea0d617a664190b1f5e4cf3b807bd5 P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.588502  7716 tablet_replica.cc:333] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.589025  7716 raft_consensus.cc:2243] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.589424  7716 raft_consensus.cc:2272] T 0013e821aa88410fa79bc656b03ec146 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.591336  7716 tablet_replica.cc:333] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.591827  7716 raft_consensus.cc:2243] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.592244  7716 raft_consensus.cc:2272] T 68c7f1839b1f45898709d7b951744cd4 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.594116  7716 tablet_replica.cc:333] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.594640  7716 raft_consensus.cc:2243] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.595062  7716 raft_consensus.cc:2272] T eb645de5083941e0a7dd5d4e4cf1a798 P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.596933  7716 tablet_replica.cc:333] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.597462  7716 raft_consensus.cc:2243] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.598312  7716 raft_consensus.cc:2272] T a5109a72f97348a6b66b2a2541c30448 P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.600911  7716 tablet_replica.cc:333] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.601655  7716 raft_consensus.cc:2243] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.602597  7716 raft_consensus.cc:2272] T 6ba4353bb62b4c0aa4e854be3297184d P a7f2df769fee4fb7894cdbb752cab97e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.604661  7716 tablet_replica.cc:333] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.605224  7716 raft_consensus.cc:2243] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.605971  7716 raft_consensus.cc:2272] T e9773066f8824befb0ba38e00f26711b P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.608436  7716 tablet_replica.cc:333] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.608927  7716 raft_consensus.cc:2243] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.609359  7716 raft_consensus.cc:2272] T d2f740872ebf4b868aae02d23315877f P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.611102  7716 tablet_replica.cc:333] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.611626  7716 raft_consensus.cc:2243] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.612406  7716 raft_consensus.cc:2272] T 9cf91fbb29104b44a4abee852fbe043e P a7f2df769fee4fb7894cdbb752cab97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.614146  7716 tablet_replica.cc:333] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e: stopping tablet replica
I20260709 12:17:20.614588  7716 raft_consensus.cc:2243] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.614976  7716 raft_consensus.cc:2272] T 26698bcad1684a86a906817a779878ba P a7f2df769fee4fb7894cdbb752cab97e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.619614 16392 consensus_peers.cc:597] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.648945 16392 consensus_peers.cc:597] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.652038 16392 consensus_peers.cc:597] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.659384 16392 consensus_peers.cc:597] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.671226 17445 raft_consensus.cc:493] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:17:20.671831 17445 raft_consensus.cc:515] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } }
I20260709 12:17:20.673995 17445 leader_election.cc:290] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875)
W20260709 12:17:20.677861 16392 consensus_peers.cc:597] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:20.678218 16392 leader_election.cc:336] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111)
W20260709 12:17:20.678715 16392 leader_election.cc:336] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:17:20.679018 16392 leader_election.cc:304] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:20.679603 17445 raft_consensus.cc:2749] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.689930  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
W20260709 12:17:20.698522 16392 consensus_peers.cc:597] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.762487  7716 tablet_server.cc:179] TabletServer@127.7.137.4:0 shutting down...
I20260709 12:17:20.780135 17445 raft_consensus.cc:493] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:17:20.781178 17445 raft_consensus.cc:515] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:20.783382 17445 leader_election.cc:290] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:17:20.784178 17445 raft_consensus.cc:493] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:17:20.784710 17445 raft_consensus.cc:515] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:20.806881 17445 leader_election.cc:290] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
W20260709 12:17:20.813980 16392 leader_election.cc:336] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:17:20.815943 16392 leader_election.cc:336] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111)
I20260709 12:17:20.816310 16392 leader_election.cc:304] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:20.819198 17448 raft_consensus.cc:2749] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:20.821134 16392 leader_election.cc:336] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111)
W20260709 12:17:20.825903 16392 leader_election.cc:336] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:17:20.826269 16392 leader_election.cc:304] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:20.826869 17448 raft_consensus.cc:2749] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.839537  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:20.840618  7716 tablet_replica.cc:333] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.841761  7716 raft_consensus.cc:2243] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.842408  7716 raft_consensus.cc:2272] T 2e4130f8e68e4e1186f8b3e11d38a05c P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.844667  7716 tablet_replica.cc:333] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.845261  7716 raft_consensus.cc:2243] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.845695  7716 raft_consensus.cc:2272] T f14f4ff55edf4aec8fec38b5631debbe P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.847824  7716 tablet_replica.cc:333] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.848369  7716 raft_consensus.cc:2243] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.849345  7716 raft_consensus.cc:2272] T 68c7f1839b1f45898709d7b951744cd4 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.851697  7716 tablet_replica.cc:333] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.852339  7716 raft_consensus.cc:2243] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.852854  7716 raft_consensus.cc:2272] T 70a614d403d5457387fe78a772c1a022 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.854946  7716 tablet_replica.cc:333] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.855659  7716 raft_consensus.cc:2243] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.856564  7716 raft_consensus.cc:2272] T b2d7819347af4afca9881790734e9619 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.858896  7716 tablet_replica.cc:333] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.859658  7716 raft_consensus.cc:2243] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.860157  7716 raft_consensus.cc:2272] T 0e140631c2f341008091adb103aedea0 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.861493 17448 raft_consensus.cc:493] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:17:20.861898 17448 raft_consensus.cc:515] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } } peers { permanent_uuid: "d4b26d78497741df932d87016bbc9a15" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35065 } }
I20260709 12:17:20.862775  7716 tablet_replica.cc:333] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.863683 17448 leader_election.cc:290] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255), d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065)
I20260709 12:17:20.863750  7716 raft_consensus.cc:2243] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.864670  7716 raft_consensus.cc:2272] T 097c0d5bee584f93ac4b342c7b129ecd P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.865800 17448 raft_consensus.cc:493] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 371b664722e94372a346a6d621adaa9e)
I20260709 12:17:20.866189 17448 raft_consensus.cc:515] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7f2df769fee4fb7894cdbb752cab97e" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38875 } } peers { permanent_uuid: "bde8efa60f914da8a818213518c2b4ca" member_type: VOTER last_known_addr { host: "127.7.137.4" port: 43779 } } peers { permanent_uuid: "371b664722e94372a346a6d621adaa9e" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 46255 } }
I20260709 12:17:20.867486  7716 tablet_replica.cc:333] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.867704 17448 leader_election.cc:290] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875), 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255)
I20260709 12:17:20.868448  7716 raft_consensus.cc:2243] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.869107  7716 raft_consensus.cc:2272] T 4b249075c4bd41b7b53b295ee5b2fc89 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.870858 16392 leader_election.cc:336] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
I20260709 12:17:20.872017  7716 tablet_replica.cc:333] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
W20260709 12:17:20.872138 16392 leader_election.cc:336] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d4b26d78497741df932d87016bbc9a15 (127.7.137.2:35065): Network error: Client connection negotiation failed: client connection to 127.7.137.2:35065: connect: Connection refused (error 111)
I20260709 12:17:20.872608 16392 leader_election.cc:304] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, d4b26d78497741df932d87016bbc9a15
I20260709 12:17:20.872998  7716 raft_consensus.cc:2243] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.873306 17448 raft_consensus.cc:2749] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.873634  7716 raft_consensus.cc:2272] T 87730c15a7404b79bbd0af9b86a540eb P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.875135 16392 leader_election.cc:336] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 371b664722e94372a346a6d621adaa9e (127.7.137.1:46255): Network error: Client connection negotiation failed: client connection to 127.7.137.1:46255: connect: Connection refused (error 111)
W20260709 12:17:20.875929 16392 leader_election.cc:336] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111)
I20260709 12:17:20.876323 16392 leader_election.cc:304] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde8efa60f914da8a818213518c2b4ca; no voters: 371b664722e94372a346a6d621adaa9e, a7f2df769fee4fb7894cdbb752cab97e
I20260709 12:17:20.876546  7716 tablet_replica.cc:333] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.877046 17448 raft_consensus.cc:2749] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.877499  7716 raft_consensus.cc:2243] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.878422  7716 raft_consensus.cc:2272] T 863095d43c5442399227ac8c352a6213 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.880548  7716 tablet_replica.cc:333] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.881166  7716 raft_consensus.cc:2243] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.881989  7716 raft_consensus.cc:2272] T f2e0c1be74c24bfc83cd8c2b649c857d P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.884161  7716 tablet_replica.cc:333] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.884804  7716 raft_consensus.cc:2243] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.885260  7716 raft_consensus.cc:2272] T 2f71fc08eaff42d5901a4921f0051394 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.887322  7716 tablet_replica.cc:333] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.887917  7716 raft_consensus.cc:2243] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.888357  7716 raft_consensus.cc:2272] T 4ea523de666d4596bdfd1b53225aff83 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.890508  7716 tablet_replica.cc:333] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.891330  7716 raft_consensus.cc:2243] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.892128  7716 raft_consensus.cc:2272] T ab64c621e79c4de99600ba8b24da4565 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.894060  7716 tablet_replica.cc:333] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.894722  7716 raft_consensus.cc:2243] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.895669  7716 raft_consensus.cc:2272] T 06d90126bf2c4c43b7021634cef076aa P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.897789  7716 tablet_replica.cc:333] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.898394  7716 raft_consensus.cc:2243] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.898885  7716 raft_consensus.cc:2272] T 300c2bb3f55044b295cab5e11e366867 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.901377  7716 tablet_replica.cc:333] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.901968  7716 raft_consensus.cc:2243] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.902804  7716 raft_consensus.cc:2272] T fffe1c659d7f45fa93bdafacea3f9ce1 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.905015  7716 tablet_replica.cc:333] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.905594  7716 raft_consensus.cc:2243] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.906057  7716 raft_consensus.cc:2272] T 0bff55b8f07d462d9bdf2065695fa373 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.908067  7716 tablet_replica.cc:333] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.908700  7716 raft_consensus.cc:2243] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.909789  7716 raft_consensus.cc:2272] T 6f9ae53f366a4893a34b5bef50a38f1b P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.912894  7716 tablet_replica.cc:333] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.913724  7716 raft_consensus.cc:2243] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.914851  7716 raft_consensus.cc:2272] T 520520ce482b48638578a08a887f961f P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.917735  7716 tablet_replica.cc:333] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.918489  7716 raft_consensus.cc:2243] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.918993  7716 raft_consensus.cc:2272] T 988b9e49e49b4d469474bbc23cf32e6d P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.921526  7716 tablet_replica.cc:333] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.922343  7716 raft_consensus.cc:2243] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.922816  7716 raft_consensus.cc:2272] T 862350edca82469998bc1533fcd8f418 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:20.923174 16392 consensus_peers.cc:597] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca -> Peer a7f2df769fee4fb7894cdbb752cab97e (127.7.137.3:38875): Couldn't send request to peer a7f2df769fee4fb7894cdbb752cab97e. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.3:38875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.925287  7716 tablet_replica.cc:333] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.925997  7716 raft_consensus.cc:2243] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.926764  7716 raft_consensus.cc:2272] T d6155e95b762495aab0bd4e75cfbe8f8 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.928839  7716 tablet_replica.cc:333] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.929375  7716 raft_consensus.cc:2243] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.929771  7716 raft_consensus.cc:2272] T 35d00760f88247f1a179973d1c7cc34e P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.932098  7716 tablet_replica.cc:333] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.932608  7716 raft_consensus.cc:2243] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.932993  7716 raft_consensus.cc:2272] T 49e6d3a14dc24349a70fb2f3910a1fa4 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.934969  7716 tablet_replica.cc:333] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.935582  7716 raft_consensus.cc:2243] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.936375  7716 raft_consensus.cc:2272] T 115b0258196c44cf8e08f3a410ef0b5e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.938186  7716 tablet_replica.cc:333] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.938710  7716 raft_consensus.cc:2243] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.939114  7716 raft_consensus.cc:2272] T e128886ac9ad43e8b89a82573e4512fb P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.941113  7716 tablet_replica.cc:333] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.941604  7716 raft_consensus.cc:2243] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.941982  7716 raft_consensus.cc:2272] T b4b31f6cc7b54ab1b202f40bc200510e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.943867  7716 tablet_replica.cc:333] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.944377  7716 raft_consensus.cc:2243] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.944746  7716 raft_consensus.cc:2272] T a5109a72f97348a6b66b2a2541c30448 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.946559  7716 tablet_replica.cc:333] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.947094  7716 raft_consensus.cc:2243] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.947556  7716 raft_consensus.cc:2272] T 9cf91fbb29104b44a4abee852fbe043e P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.949848  7716 tablet_replica.cc:333] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.950630  7716 raft_consensus.cc:2243] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.951515  7716 raft_consensus.cc:2272] T 26698bcad1684a86a906817a779878ba P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.954351  7716 tablet_replica.cc:333] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.954871  7716 raft_consensus.cc:2243] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.956048  7716 raft_consensus.cc:2272] T 83df294335c64a35b675edbe966445f4 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.958325  7716 tablet_replica.cc:333] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.958877  7716 raft_consensus.cc:2243] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.959288  7716 raft_consensus.cc:2272] T 926305cc352545b3b98774de0464f46b P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.961262  7716 tablet_replica.cc:333] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.961807  7716 raft_consensus.cc:2243] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.962198  7716 raft_consensus.cc:2272] T 1671729a63334f38b4e87d414002c770 P bde8efa60f914da8a818213518c2b4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.964213  7716 tablet_replica.cc:333] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.964725  7716 raft_consensus.cc:2243] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.965108  7716 raft_consensus.cc:2272] T 4b08e7c028cd4260a57cc16d538a6431 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.967074  7716 tablet_replica.cc:333] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.967686  7716 raft_consensus.cc:2243] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.968407  7716 raft_consensus.cc:2272] T b329094fe65047b2b4440a5d7066ab0a P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.970440  7716 tablet_replica.cc:333] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.970957  7716 raft_consensus.cc:2243] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.971396  7716 raft_consensus.cc:2272] T 52ea0d617a664190b1f5e4cf3b807bd5 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.973299  7716 tablet_replica.cc:333] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.973867  7716 raft_consensus.cc:2243] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.974272  7716 raft_consensus.cc:2272] T 2369e1f2303b4bd18b96d22c3b994929 P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.976349  7716 tablet_replica.cc:333] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.976843  7716 raft_consensus.cc:2243] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.977198  7716 raft_consensus.cc:2272] T ced4db8ec1524a7b8e3ff437ea389c1f P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.979069  7716 tablet_replica.cc:333] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.979610  7716 raft_consensus.cc:2243] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.979998  7716 raft_consensus.cc:2272] T 05fd27468a6e4c88ab3ee076f99a4e73 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.981954  7716 tablet_replica.cc:333] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.982417  7716 raft_consensus.cc:2243] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.982882  7716 raft_consensus.cc:2272] T 457ef541e8004732abf224552592d3dd P bde8efa60f914da8a818213518c2b4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.984851  7716 tablet_replica.cc:333] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.985301  7716 raft_consensus.cc:2243] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.985677  7716 raft_consensus.cc:2272] T 52e7274549d04acc9c7bb43812b87d79 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.987674  7716 tablet_replica.cc:333] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.988173  7716 raft_consensus.cc:2243] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.988617  7716 raft_consensus.cc:2272] T efd3baaf1b0f43f59cfe39fba8bb4dde P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.990706  7716 tablet_replica.cc:333] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca: stopping tablet replica
I20260709 12:17:20.991146  7716 raft_consensus.cc:2243] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:20.991986  7716 raft_consensus.cc:2272] T 9541a370ec014267a500f45686395fb8 P bde8efa60f914da8a818213518c2b4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:21.100757  7716 tablet_server.cc:196] TabletServer@127.7.137.4:0 shutdown complete.
I20260709 12:17:21.163407  7716 master.cc:562] Master@127.7.137.62:40141 shutting down...
I20260709 12:17:21.189839  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:21.190416  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:21.190766  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1211a968cb1f4a969cf8b631e94e6d1e: stopping tablet replica
I20260709 12:17:21.212723  7716 master.cc:584] Master@127.7.137.62:40141 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39341 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:17:21.301575  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:36405
I20260709 12:17:21.302784  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:21.308790 17450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.309227 17451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.309597 17453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.310261  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:21.312390  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:21.312579  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:21.312698  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599441312681 us; error 0 us; skew 500 ppm
I20260709 12:17:21.313164  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:21.315652  7716 webserver.cc:533] Webserver started at http://127.7.137.62:32889/ using document root <none> and password file <none>
I20260709 12:17:21.316126  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:21.316279  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:21.316493  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:21.317605  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "327435828e4249b39af691623fa17164"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.322459  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:17:21.325857 17458 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.326617  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:21.326930  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "327435828e4249b39af691623fa17164"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.327226  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:21.346805  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:21.348106  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:21.387349  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:36405
I20260709 12:17:21.387528 17509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:36405 every 8 connection(s)
I20260709 12:17:21.391319 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.402372 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164: Bootstrap starting.
I20260709 12:17:21.407732 17510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:21.412268 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164: No bootstrap required, opened a new log
I20260709 12:17:21.414610 17510 raft_consensus.cc:359] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER }
I20260709 12:17:21.415153 17510 raft_consensus.cc:385] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:21.415441 17510 raft_consensus.cc:740] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 327435828e4249b39af691623fa17164, State: Initialized, Role: FOLLOWER
I20260709 12:17:21.416119 17510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER }
I20260709 12:17:21.416594 17510 raft_consensus.cc:399] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:21.416791 17510 raft_consensus.cc:493] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:21.417124 17510 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:21.421811 17510 raft_consensus.cc:515] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER }
I20260709 12:17:21.422305 17510 leader_election.cc:304] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 327435828e4249b39af691623fa17164; no voters: 
I20260709 12:17:21.423511 17510 leader_election.cc:290] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:21.423900 17513 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:21.425256 17513 raft_consensus.cc:697] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 1 LEADER]: Becoming Leader. State: Replica: 327435828e4249b39af691623fa17164, State: Running, Role: LEADER
I20260709 12:17:21.425921 17513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER }
I20260709 12:17:21.426728 17510 sys_catalog.cc:565] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:21.430488 17514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "327435828e4249b39af691623fa17164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER } }
I20260709 12:17:21.431164 17514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:21.432255 17515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 327435828e4249b39af691623fa17164. Latest consensus state: current_term: 1 leader_uuid: "327435828e4249b39af691623fa17164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "327435828e4249b39af691623fa17164" member_type: VOTER } }
I20260709 12:17:21.432837 17515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:21.433737 17520 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:21.442016 17520 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:21.443742  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:21.451030 17520 catalog_manager.cc:1383] Generated new cluster ID: 07d0a21fcee3465eab2333dc76f24b7b
I20260709 12:17:21.451359 17520 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:21.473994 17520 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:21.475378 17520 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:21.492729 17520 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164: Generated new TSK 0
I20260709 12:17:21.493316 17520 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:21.510330  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:21.516392 17531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.517495 17532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.519521 17534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.519632  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:21.520875  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:21.521088  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:21.521270  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599441521233 us; error 0 us; skew 500 ppm
I20260709 12:17:21.521807  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:21.524143  7716 webserver.cc:533] Webserver started at http://127.7.137.1:34165/ using document root <none> and password file <none>
I20260709 12:17:21.524643  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:21.524833  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:21.525113  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:21.526261  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "0a2df87e2090478582b7790e0512801c"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.530903  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:21.534241 17539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.535058  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:21.535442  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "0a2df87e2090478582b7790e0512801c"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.535749  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:21.549207  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:21.550426  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:21.551975  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:21.554242  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:21.554455  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.554726  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:21.554919  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.594203  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:38335
I20260709 12:17:21.594272 17601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:38335 every 8 connection(s)
I20260709 12:17:21.599447  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:21.608389 17606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.609057 17607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.610008 17609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.610491  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:21.612046  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:21.612295  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:21.612515  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599441612494 us; error 0 us; skew 500 ppm
I20260709 12:17:21.613128  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:21.613139 17602 heartbeater.cc:344] Connected to a master server at 127.7.137.62:36405
I20260709 12:17:21.613663 17602 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:21.614440 17602 heartbeater.cc:507] Master 127.7.137.62:36405 requested a full tablet report, sending...
I20260709 12:17:21.616111  7716 webserver.cc:533] Webserver started at http://127.7.137.2:36463/ using document root <none> and password file <none>
I20260709 12:17:21.616665  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:21.616587 17475 ts_manager.cc:194] Registered new tserver with Master: 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335)
I20260709 12:17:21.616973  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:21.617290  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:21.618397  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "8457735a4d7f4beb9609ce77cd81666f"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.618528 17475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34230
I20260709 12:17:21.622875  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:21.626471 17614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.627373  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:21.627693  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "8457735a4d7f4beb9609ce77cd81666f"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.628008  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:21.645015  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:21.646279  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:21.647773  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:21.650024  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:21.650276  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.650519  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:21.650699  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.689791  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:45319
I20260709 12:17:21.689898 17676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:45319 every 8 connection(s)
I20260709 12:17:21.694586  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:21.701853 17680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:21.703459 17681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.706044  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:21.706382 17683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:21.707156 17677 heartbeater.cc:344] Connected to a master server at 127.7.137.62:36405
I20260709 12:17:21.707607 17677 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:21.707628  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:21.707993  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:21.708170  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599441708154 us; error 0 us; skew 500 ppm
I20260709 12:17:21.708511 17677 heartbeater.cc:507] Master 127.7.137.62:36405 requested a full tablet report, sending...
I20260709 12:17:21.708851  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:21.710726 17475 ts_manager.cc:194] Registered new tserver with Master: 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:21.711488  7716 webserver.cc:533] Webserver started at http://127.7.137.3:40103/ using document root <none> and password file <none>
I20260709 12:17:21.712019  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:21.712246  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:21.712291 17475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34234
I20260709 12:17:21.712530  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:21.713946  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "b74acd19890a458f98454c07f4aa2cc0"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.718324  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:17:21.721813 17688 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.722640  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:17:21.722942  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "b74acd19890a458f98454c07f4aa2cc0"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:21.723277  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:21.751624  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:21.752907  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:21.754449  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:21.756702  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:21.756948  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.757200  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:21.757376  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:21.797165  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:44769
I20260709 12:17:21.797269 17750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:44769 every 8 connection(s)
I20260709 12:17:21.811079 17751 heartbeater.cc:344] Connected to a master server at 127.7.137.62:36405
I20260709 12:17:21.811650 17751 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:21.812376 17751 heartbeater.cc:507] Master 127.7.137.62:36405 requested a full tablet report, sending...
I20260709 12:17:21.814301 17475 ts_manager.cc:194] Registered new tserver with Master: b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:21.814926  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014594773s
I20260709 12:17:21.816080 17475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34248
I20260709 12:17:21.841923 17475 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34264:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:21.844810 17475 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:21.931286 17642 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe7c5b5180448eb8cd082bfb4fc54f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:21.931888 17635 tablet_service.cc:1511] Processing CreateTablet for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:21.932863 17642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe7c5b5180448eb8cd082bfb4fc54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.933043 17716 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe7c5b5180448eb8cd082bfb4fc54f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:21.933535 17635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.934495 17716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe7c5b5180448eb8cd082bfb4fc54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.934764 17641 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4cb57977d340a3bd4069c11359d70f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:21.936170 17641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4cb57977d340a3bd4069c11359d70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.938351 17640 tablet_service.cc:1511] Processing CreateTablet for tablet c34f383ee15044faac4933b73f3451cb (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:21.939728 17640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34f383ee15044faac4933b73f3451cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.941211 17559 tablet_service.cc:1511] Processing CreateTablet for tablet d43bd05efaab4998be91fd08b4d1e246 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:21.942592 17559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43bd05efaab4998be91fd08b4d1e246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.942216 17639 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07c4507dba42e89154f09ae353078d (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:21.943905 17715 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4cb57977d340a3bd4069c11359d70f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:21.943979 17638 tablet_service.cc:1511] Processing CreateTablet for tablet 860cf0a6e471414f8e74347bf5bfa527 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:21.944877 17639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07c4507dba42e89154f09ae353078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.945359 17715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4cb57977d340a3bd4069c11359d70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.946182 17637 tablet_service.cc:1511] Processing CreateTablet for tablet fc8b4dff1b0645efbfefc6316a97f6e2 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:21.947504 17637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8b4dff1b0645efbfefc6316a97f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.948335 17714 tablet_service.cc:1511] Processing CreateTablet for tablet c34f383ee15044faac4933b73f3451cb (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:21.949095 17708 tablet_service.cc:1511] Processing CreateTablet for tablet d43bd05efaab4998be91fd08b4d1e246 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:21.949738 17714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34f383ee15044faac4933b73f3451cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.950400 17708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43bd05efaab4998be91fd08b4d1e246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.951809 17713 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07c4507dba42e89154f09ae353078d (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:21.952328 17636 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4e619a86f3497aa72be716a848816c (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:21.953166 17713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07c4507dba42e89154f09ae353078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.953626 17636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4e619a86f3497aa72be716a848816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.956380 17567 tablet_service.cc:1511] Processing CreateTablet for tablet 52fe7c5b5180448eb8cd082bfb4fc54f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:17:21.956457 17712 tablet_service.cc:1511] Processing CreateTablet for tablet 860cf0a6e471414f8e74347bf5bfa527 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:21.957790 17567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fe7c5b5180448eb8cd082bfb4fc54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.957885 17712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860cf0a6e471414f8e74347bf5bfa527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.960453 17711 tablet_service.cc:1511] Processing CreateTablet for tablet fc8b4dff1b0645efbfefc6316a97f6e2 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:21.960561 17563 tablet_service.cc:1511] Processing CreateTablet for tablet 860cf0a6e471414f8e74347bf5bfa527 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:17:21.961306 17634 tablet_service.cc:1511] Processing CreateTablet for tablet d43bd05efaab4998be91fd08b4d1e246 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:17:21.961807 17711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8b4dff1b0645efbfefc6316a97f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.961993 17563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860cf0a6e471414f8e74347bf5bfa527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.962581 17634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43bd05efaab4998be91fd08b4d1e246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.964344 17564 tablet_service.cc:1511] Processing CreateTablet for tablet 7e07c4507dba42e89154f09ae353078d (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:17:21.964437 17710 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4e619a86f3497aa72be716a848816c (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:21.965822 17564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e07c4507dba42e89154f09ae353078d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.966907 17709 tablet_service.cc:1511] Processing CreateTablet for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:21.968000 17638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860cf0a6e471414f8e74347bf5bfa527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.968276 17561 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4e619a86f3497aa72be716a848816c (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:17:21.969522 17561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4e619a86f3497aa72be716a848816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.965843 17710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4e619a86f3497aa72be716a848816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.972306 17560 tablet_service.cc:1511] Processing CreateTablet for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:17:21.973623 17560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.964352 17562 tablet_service.cc:1511] Processing CreateTablet for tablet fc8b4dff1b0645efbfefc6316a97f6e2 (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:17:21.975673 17709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a779fcf10a2f47d2bcdcbb8ee78d5a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.976578 17562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8b4dff1b0645efbfefc6316a97f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.967119 17566 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4cb57977d340a3bd4069c11359d70f (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:17:21.979130 17566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4cb57977d340a3bd4069c11359d70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.965431 17565 tablet_service.cc:1511] Processing CreateTablet for tablet c34f383ee15044faac4933b73f3451cb (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:17:21.982069 17565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34f383ee15044faac4933b73f3451cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:22.013547 17707 tablet_service.cc:1511] Processing CreateTablet for tablet 14260072640b4597880312929f41eebd (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:22.015060 17707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14260072640b4597880312929f41eebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:22.021517 17558 tablet_service.cc:1511] Processing CreateTablet for tablet 14260072640b4597880312929f41eebd (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:22.023002 17558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14260072640b4597880312929f41eebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:22.029480 17633 tablet_service.cc:1511] Processing CreateTablet for tablet 14260072640b4597880312929f41eebd (DEFAULT_TABLE table=test-workload [id=13f0178b198a4ea0966c4f49b706b8ac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:17:22.030925 17633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14260072640b4597880312929f41eebd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:22.126997 17462 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.137.3:44769, user_credentials={real_user=slave}} blocked reactor thread for 55773.9us
I20260709 12:17:22.169340 17766 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.186208 17767 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.195669 17767 tablet_bootstrap.cc:654] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.201406 17766 tablet_bootstrap.cc:654] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.205123 17768 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.206701 17767 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.207499 17767 ts_tablet_manager.cc:1403] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:17:22.210958 17767 raft_consensus.cc:359] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.211723 17767 raft_consensus.cc:385] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.212076 17767 raft_consensus.cc:740] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.212438 17766 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.212626 17768 tablet_bootstrap.cc:654] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.212958 17766 ts_tablet_manager.cc:1403] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:17:22.212838 17767 consensus_queue.cc:260] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.215288 17677 heartbeater.cc:499] Master 127.7.137.62:36405 was elected leader, sending a full tablet report...
I20260709 12:17:22.215713 17767 ts_tablet_manager.cc:1434] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:17:22.216336 17766 raft_consensus.cc:359] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.216804 17767 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.217118 17766 raft_consensus.cc:385] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.217415 17766 raft_consensus.cc:740] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.218269 17766 consensus_queue.cc:260] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.224366 17768 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.224921 17768 ts_tablet_manager.cc:1403] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:17:22.228307 17767 tablet_bootstrap.cc:654] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.228998 17751 heartbeater.cc:499] Master 127.7.137.62:36405 was elected leader, sending a full tablet report...
I20260709 12:17:22.228288 17766 ts_tablet_manager.cc:1434] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.001s
I20260709 12:17:22.230326 17766 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.237103 17766 tablet_bootstrap.cc:654] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.228065 17768 raft_consensus.cc:359] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.238062 17768 raft_consensus.cc:385] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.238384 17768 raft_consensus.cc:740] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.239137 17768 consensus_queue.cc:260] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.246585 17766 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.247551 17766 ts_tablet_manager.cc:1403] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:17:22.251818 17766 raft_consensus.cc:359] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.252992 17766 raft_consensus.cc:385] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.253504 17766 raft_consensus.cc:740] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.254701 17766 consensus_queue.cc:260] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.258268 17766 ts_tablet_manager.cc:1434] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:22.259805 17766 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.262687 17602 heartbeater.cc:499] Master 127.7.137.62:36405 was elected leader, sending a full tablet report...
I20260709 12:17:22.263029 17768 ts_tablet_manager.cc:1434] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.010s
I20260709 12:17:22.267467 17766 tablet_bootstrap.cc:654] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.268597 17768 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.275111 17767 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.275801 17767 ts_tablet_manager.cc:1403] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.023s
I20260709 12:17:22.278184 17768 tablet_bootstrap.cc:654] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.279031 17767 raft_consensus.cc:359] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.279939 17767 raft_consensus.cc:385] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.280315 17767 raft_consensus.cc:740] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.281934 17773 raft_consensus.cc:493] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.282485 17773 raft_consensus.cc:515] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.282112 17766 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.283702 17766 ts_tablet_manager.cc:1403] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 12:17:22.285110 17773 leader_election.cc:290] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.281268 17767 consensus_queue.cc:260] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.289263 17766 raft_consensus.cc:359] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.290313 17766 raft_consensus.cc:385] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.290719 17766 raft_consensus.cc:740] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.291644 17766 consensus_queue.cc:260] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.287168 17767 ts_tablet_manager.cc:1434] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:22.293207 17767 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.295775 17768 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.296209 17766 ts_tablet_manager.cc:1434] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:17:22.296351 17768 ts_tablet_manager.cc:1403] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 12:17:22.298942 17766 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.299475 17768 raft_consensus.cc:359] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.300276 17768 raft_consensus.cc:385] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.300285 17767 tablet_bootstrap.cc:654] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.300709 17768 raft_consensus.cc:740] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
W20260709 12:17:22.301558 17752 tablet.cc:2406] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:22.301559 17768 consensus_queue.cc:260] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.303946 17768 ts_tablet_manager.cc:1434] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:22.304956 17768 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.306363 17766 tablet_bootstrap.cc:654] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.309212 17781 raft_consensus.cc:493] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.310366 17781 raft_consensus.cc:515] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.312188 17768 tablet_bootstrap.cc:654] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.315861 17781 leader_election.cc:290] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335)
I20260709 12:17:22.317890 17767 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.318759 17767 ts_tablet_manager.cc:1403] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 12:17:22.325663 17768 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.325243 17767 raft_consensus.cc:359] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.326419 17768 ts_tablet_manager.cc:1403] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 12:17:22.330880 17768 raft_consensus.cc:359] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.326759 17767 raft_consensus.cc:385] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.332677 17767 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.333127 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.331980 17768 raft_consensus.cc:385] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.333956 17577 raft_consensus.cc:2468] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
I20260709 12:17:22.333593 17767 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.333582 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.333843 17768 raft_consensus.cc:740] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.335731 17689 leader_election.cc:304] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.336745 17767 ts_tablet_manager.cc:1434] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:17:22.336609 17768 consensus_queue.cc:260] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
W20260709 12:17:22.337174 17689 leader_election.cc:343] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.338027 17773 raft_consensus.cc:2804] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.338457 17773 raft_consensus.cc:493] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.338747 17773 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.340701 17766 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.341249 17766 ts_tablet_manager.cc:1403] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.023s
I20260709 12:17:22.338049 17767 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.344408 17766 raft_consensus.cc:359] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.345196 17766 raft_consensus.cc:385] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.345502 17766 raft_consensus.cc:740] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.346263 17766 consensus_queue.cc:260] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.348512 17766 ts_tablet_manager.cc:1434] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:17:22.349615 17766 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.350494 17768 ts_tablet_manager.cc:1434] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 12:17:22.350811 17767 tablet_bootstrap.cc:654] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.351717 17768 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.356309 17766 tablet_bootstrap.cc:654] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.358929 17768 tablet_bootstrap.cc:654] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.362735 17767 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.363351 17767 ts_tablet_manager.cc:1403] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:17:22.366423 17767 raft_consensus.cc:359] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.374076 17767 raft_consensus.cc:385] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.374486 17767 raft_consensus.cc:740] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.375648 17767 consensus_queue.cc:260] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.380096 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.381637 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.383292 17767 ts_tablet_manager.cc:1434] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
W20260709 12:17:22.383437 17689 leader_election.cc:343] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:22.384512 17689 leader_election.cc:343] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.384647 17767 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.384964 17689 leader_election.cc:304] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:22.385808 17781 raft_consensus.cc:2749] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.374204 17773 raft_consensus.cc:515] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.387997 17766 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.388759 17766 ts_tablet_manager.cc:1403] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:17:22.389564 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.390228 17576 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.393647 17766 raft_consensus.cc:359] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.394729 17766 raft_consensus.cc:385] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.395470 17767 tablet_bootstrap.cc:654] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.395131 17766 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.396615 17766 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.398012 17768 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.398564 17768 ts_tablet_manager.cc:1403] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.031s
I20260709 12:17:22.398998 17766 ts_tablet_manager.cc:1434] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:22.400115 17766 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.401674 17768 raft_consensus.cc:359] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.402449 17768 raft_consensus.cc:385] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.402758 17768 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.403705 17768 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.407205 17766 tablet_bootstrap.cc:654] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.408011 17773 leader_election.cc:290] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.406939 17576 raft_consensus.cc:2468] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.410193 17689 leader_election.cc:304] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.411916 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.413552 17767 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.414141 17767 ts_tablet_manager.cc:1403] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
W20260709 12:17:22.415310 17689 leader_election.cc:343] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.416721 17773 raft_consensus.cc:2804] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.417459 17773 raft_consensus.cc:697] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:22.418499 17773 consensus_queue.cc:237] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.418687 17767 raft_consensus.cc:359] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.420332 17767 raft_consensus.cc:385] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.421424 17768 ts_tablet_manager.cc:1434] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:17:22.421077 17767 raft_consensus.cc:740] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.425264 17767 consensus_queue.cc:260] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.429190 17768 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.435132 17767 ts_tablet_manager.cc:1434] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 12:17:22.437321 17768 tablet_bootstrap.cc:654] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:22.438943 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:22.439685 17766 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.440214 17766 ts_tablet_manager.cc:1403] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.014s
I20260709 12:17:22.441396 17767 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.444208 17766 raft_consensus.cc:359] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.444948 17766 raft_consensus.cc:385] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.445241 17766 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.451397 17768 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.451063 17766 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.450780 17473 catalog_manager.cc:5697] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.451934 17768 ts_tablet_manager.cc:1403] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:17:22.452797 17767 tablet_bootstrap.cc:654] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.453841 17766 ts_tablet_manager.cc:1434] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:17:22.454916 17766 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.455149 17768 raft_consensus.cc:359] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.456023 17768 raft_consensus.cc:385] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.456336 17768 raft_consensus.cc:740] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.457399 17768 consensus_queue.cc:260] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.460304 17773 raft_consensus.cc:493] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.460561 17767 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.461226 17767 ts_tablet_manager.cc:1403] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 12:17:22.460871 17773 raft_consensus.cc:515] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.463897 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.464401 17768 ts_tablet_manager.cc:1434] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:22.464581 17576 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
I20260709 12:17:22.464658 17767 raft_consensus.cc:359] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.465569 17767 raft_consensus.cc:385] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.465673 17768 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.466125 17689 leader_election.cc:304] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.467082 17781 raft_consensus.cc:2804] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.467476 17781 raft_consensus.cc:493] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.467804 17781 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.468549 17766 tablet_bootstrap.cc:654] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.472962 17768 tablet_bootstrap.cc:654] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.478885 17771 raft_consensus.cc:493] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.479677 17771 raft_consensus.cc:515] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.483928 17781 raft_consensus.cc:515] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.501035 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.501955 17576 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.518194 17771 leader_election.cc:290] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.549067 17773 leader_election.cc:290] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.562465 17576 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.578635 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.581231 17773 raft_consensus.cc:493] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.581518 17689 leader_election.cc:343] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.582046 17773 raft_consensus.cc:515] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.583413 17689 leader_election.cc:304] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.584856 17773 leader_election.cc:290] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.585687 17773 raft_consensus.cc:2804] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.586249 17773 raft_consensus.cc:697] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:22.587384 17773 consensus_queue.cc:237] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.591967 17781 leader_election.cc:290] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.601590 17781 raft_consensus.cc:493] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.602880 17767 raft_consensus.cc:740] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.607215 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.609719 17781 raft_consensus.cc:515] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.611800 17576 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
I20260709 12:17:22.617488 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.619889 17767 consensus_queue.cc:260] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.622648 17767 ts_tablet_manager.cc:1434] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.000s
I20260709 12:17:22.623164 17766 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.623615 17767 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.624007 17766 ts_tablet_manager.cc:1403] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.169s	user 0.081s	sys 0.074s
I20260709 12:17:22.629578 17781 leader_election.cc:290] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.630378 17768 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.630851 17768 ts_tablet_manager.cc:1403] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.165s	user 0.048s	sys 0.097s
I20260709 12:17:22.666412 17651 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
I20260709 12:17:22.667227 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.669425 17576 raft_consensus.cc:2393] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8457735a4d7f4beb9609ce77cd81666f in current term 1: Already voted for candidate b74acd19890a458f98454c07f4aa2cc0 in this term.
I20260709 12:17:22.670734 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.671590 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.675328 17689 leader_election.cc:304] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.675549 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
W20260709 12:17:22.676908 17689 leader_election.cc:343] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.676926 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.678305 17652 raft_consensus.cc:2468] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
W20260709 12:17:22.678639 17689 leader_election.cc:343] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.680269 17775 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.680451 17781 raft_consensus.cc:2804] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.681118 17781 raft_consensus.cc:493] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.681602 17781 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.628491 17766 raft_consensus.cc:359] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.681342 17775 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.682404 17766 raft_consensus.cc:385] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.682900 17766 raft_consensus.cc:740] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.683398 17771 raft_consensus.cc:493] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.678830 17618 leader_election.cc:304] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f; no voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:22.684378 17771 raft_consensus.cc:515] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.684367 17766 consensus_queue.cc:260] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.697914 17768 raft_consensus.cc:359] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.700111 17771 leader_election.cc:290] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.700958 17771 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.704550 17766 ts_tablet_manager.cc:1434] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.002s
I20260709 12:17:22.702481 17775 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.707008 17766 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.709825 17767 tablet_bootstrap.cc:654] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.699159 17768 raft_consensus.cc:385] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.710428 17768 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.716046 17689 leader_election.cc:304] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c
I20260709 12:17:22.718943 17773 raft_consensus.cc:2804] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.719548 17773 raft_consensus.cc:493] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.720578 17805 raft_consensus.cc:493] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.720827 17773 raft_consensus.cc:3060] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.723507 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
W20260709 12:17:22.725947 17615 leader_election.cc:343] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.712121 17768 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.726521 17805 raft_consensus.cc:515] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.741894 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.742700 17576 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:22.743183 17768 ts_tablet_manager.cc:1434] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.112s	user 0.013s	sys 0.001s
I20260709 12:17:22.744306 17615 leader_election.cc:304] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:22.746419 17805 leader_election.cc:290] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.747136 17805 raft_consensus.cc:2804] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.747614 17805 raft_consensus.cc:493] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.748044 17805 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.760169 17781 raft_consensus.cc:515] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.761265 17766 tablet_bootstrap.cc:654] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.761301 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:22.762777 17781 leader_election.cc:290] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.763979 17768 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:22.765021 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:22.769563 17773 raft_consensus.cc:515] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.771948 17773 leader_election.cc:290] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.773140 17768 tablet_bootstrap.cc:654] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.772249 17473 catalog_manager.cc:5697] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.774616 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.775007 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.775859 17576 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.776688 17540 leader_election.cc:343] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.780390 17767 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
W20260709 12:17:22.782729 17618 leader_election.cc:343] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.783357 17618 leader_election.cc:304] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f; no voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:22.783697 17771 raft_consensus.cc:2749] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.784775 17771 raft_consensus.cc:493] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.782945 17767 ts_tablet_manager.cc:1403] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.032s
I20260709 12:17:22.785547 17771 raft_consensus.cc:515] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.793486 17576 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.794173 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.795418 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:22.795738 17808 raft_consensus.cc:2749] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.796327 17726 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a2df87e2090478582b7790e0512801c in term 0.
I20260709 12:17:22.797427 17771 leader_election.cc:290] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.798054 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.798632 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.798895 17577 raft_consensus.cc:2468] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:22.799371 17651 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.798532 17805 raft_consensus.cc:515] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.800552 17615 leader_election.cc:304] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:22.801333 17771 raft_consensus.cc:2804] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.801766 17771 raft_consensus.cc:493] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.801892 17805 leader_election.cc:290] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.802219 17771 raft_consensus.cc:3060] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.802670 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.803345 17577 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.803965 17618 leader_election.cc:343] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.804072 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.804790 17652 raft_consensus.cc:3060] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.809329 17766 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.809945 17766 ts_tablet_manager.cc:1403] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.002s
I20260709 12:17:22.809567 17767 raft_consensus.cc:359] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.810503 17767 raft_consensus.cc:385] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.810791 17767 raft_consensus.cc:740] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.811699 17767 consensus_queue.cc:260] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.814716 17767 ts_tablet_manager.cc:1434] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
W20260709 12:17:22.815225 17689 leader_election.cc:343] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.816247 17767 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.817864 17689 leader_election.cc:304] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:22.817095 17768 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:22.821058 17651 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.823717 17768 ts_tablet_manager.cc:1403] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.006s
I20260709 12:17:22.825273 17767 tablet_bootstrap.cc:654] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.825075 17771 raft_consensus.cc:515] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.828116 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.827095 17768 raft_consensus.cc:359] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.828763 17576 raft_consensus.cc:3060] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.828869 17766 raft_consensus.cc:359] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.829779 17766 raft_consensus.cc:385] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.830090 17766 raft_consensus.cc:740] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.830978 17766 consensus_queue.cc:260] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.833657 17766 ts_tablet_manager.cc:1434] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:17:22.834200 17781 raft_consensus.cc:2804] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.834980 17766 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.835017 17781 raft_consensus.cc:697] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:22.836570 17781 consensus_queue.cc:237] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.837656 17576 raft_consensus.cc:2468] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:22.838371 17543 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:22.839741 17775 raft_consensus.cc:2804] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.840202 17775 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.840559 17775 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.841686 17766 tablet_bootstrap.cc:654] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.828931 17768 raft_consensus.cc:385] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.842787 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:22.843485 17768 raft_consensus.cc:740] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.839751 17771 leader_election.cc:290] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.844548 17768 consensus_queue.cc:260] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.845893 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:22.847863 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
W20260709 12:17:22.849400 17618 leader_election.cc:343] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.849701 17773 raft_consensus.cc:493] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.850361 17773 raft_consensus.cc:515] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.839732 17615 leader_election.cc:304] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
W20260709 12:17:22.850986 17618 leader_election.cc:343] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.851854 17771 raft_consensus.cc:2804] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:22.852195 17618 leader_election.cc:343] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.852389 17771 raft_consensus.cc:697] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:22.852532 17773 leader_election.cc:290] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.855731 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.849383 17652 raft_consensus.cc:2468] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.858453 17771 consensus_queue.cc:237] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.860013 17689 leader_election.cc:304] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c
I20260709 12:17:22.861711 17577 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:22.861996 17775 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.862560 17773 raft_consensus.cc:2804] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.861352 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.863430 17773 raft_consensus.cc:697] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
W20260709 12:17:22.863379 17689 leader_election.cc:343] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:22.865000 17689 leader_election.cc:343] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.865494 17689 leader_election.cc:304] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:22.864841 17773 consensus_queue.cc:237] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.866438 17766 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.866358 17800 raft_consensus.cc:2749] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:22.867472 17766 ts_tablet_manager.cc:1403] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 12:17:22.867512 17767 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.868273 17767 ts_tablet_manager.cc:1403] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.006s
I20260709 12:17:22.870930 17766 raft_consensus.cc:359] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.871680 17766 raft_consensus.cc:385] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.872026 17766 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.872578 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.872804 17766 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.872962 17775 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 election: Requested vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.874181 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:22.874917 17725 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.874785 17540 leader_election.cc:343] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.873291 17767 raft_consensus.cc:359] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.877033 17767 raft_consensus.cc:385] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:22.877485 17767 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:22.881076 17615 leader_election.cc:304] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:22.882603 17767 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.883519 17810 raft_consensus.cc:2804] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.884055 17810 raft_consensus.cc:697] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:22.884955 17767 ts_tablet_manager.cc:1434] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:17:22.885190 17810 consensus_queue.cc:237] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.886276 17767 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:22.888249 17766 ts_tablet_manager.cc:1434] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:17:22.893433 17766 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: Bootstrap starting.
I20260709 12:17:22.901857 17773 raft_consensus.cc:493] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.902498 17773 raft_consensus.cc:515] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.903863 17725 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a2df87e2090478582b7790e0512801c in term 1.
I20260709 12:17:22.904862 17766 tablet_bootstrap.cc:654] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.907862 17773 leader_election.cc:290] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.908291 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:22.910473 17543 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:22.911715 17775 raft_consensus.cc:2804] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:22.912191 17775 raft_consensus.cc:697] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 LEADER]: Becoming Leader. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Running, Role: LEADER
I20260709 12:17:22.913221 17775 consensus_queue.cc:237] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.902485 17473 catalog_manager.cc:5697] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.913717 17472 catalog_manager.cc:5697] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 1 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.918980 17767 tablet_bootstrap.cc:654] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.921236 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.921936 17652 raft_consensus.cc:2468] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 0.
I20260709 12:17:22.922626 17768 ts_tablet_manager.cc:1434] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.099s	user 0.016s	sys 0.016s
I20260709 12:17:22.927104 17768 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
W20260709 12:17:22.920857 17689 leader_election.cc:343] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.929590 17689 leader_election.cc:304] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c
I20260709 12:17:22.930629 17773 raft_consensus.cc:2804] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:22.931250 17773 raft_consensus.cc:493] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.931747 17773 raft_consensus.cc:3060] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:22.942099 17781 consensus_queue.cc:1048] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:22.945858 17775 raft_consensus.cc:493] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.946616 17775 raft_consensus.cc:515] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.952930 17775 leader_election.cc:290] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:22.955186 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:22.958113 17773 raft_consensus.cc:515] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.962298 17773 leader_election.cc:290] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:22.963774 17768 tablet_bootstrap.cc:654] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:22.964983 17766 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: No bootstrap required, opened a new log
I20260709 12:17:22.965772 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:22.965903 17651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:22.978909 17651 raft_consensus.cc:3060] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:22.979948 17689 leader_election.cc:343] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:22.973213 17475 catalog_manager.cc:5697] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 1 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.982575 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a779fcf10a2f47d2bcdcbb8ee78d5a24" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:22.983770 17652 raft_consensus.cc:2393] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a2df87e2090478582b7790e0512801c in current term 1: Already voted for candidate b74acd19890a458f98454c07f4aa2cc0 in this term.
I20260709 12:17:22.986562 17651 raft_consensus.cc:2468] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 1.
I20260709 12:17:22.972465 17767 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:22.989609 17767 ts_tablet_manager.cc:1403] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.005s
I20260709 12:17:22.990396 17473 catalog_manager.cc:5697] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.991923 17766 ts_tablet_manager.cc:1403] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.017s
I20260709 12:17:22.997200 17767 raft_consensus.cc:359] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:22.993939 17689 leader_election.cc:304] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c
I20260709 12:17:23.000185 17540 leader_election.cc:304] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a2df87e2090478582b7790e0512801c; no voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:23.002646 17822 raft_consensus.cc:3060] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.008459 17773 consensus_queue.cc:1048] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.012182 17822 raft_consensus.cc:2749] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:23.014846 17768 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:23.015555 17768 ts_tablet_manager.cc:1403] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.009s
I20260709 12:17:23.001263 17800 raft_consensus.cc:2804] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:23.016396 17800 raft_consensus.cc:697] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:23.017213 17800 consensus_queue.cc:237] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.017874 17768 raft_consensus.cc:359] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.018378 17768 raft_consensus.cc:385] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.018534 17768 raft_consensus.cc:740] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.019110 17768 consensus_queue.cc:260] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.001223 17472 catalog_manager.cc:5697] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a2df87e2090478582b7790e0512801c (127.7.137.1). New cstate: current_term: 1 leader_uuid: "0a2df87e2090478582b7790e0512801c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.000681 17767 raft_consensus.cc:385] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.020746 17767 raft_consensus.cc:740] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.021255 17768 ts_tablet_manager.cc:1434] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:17:22.999902 17766 raft_consensus.cc:359] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.022478 17768 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:23.022534 17766 raft_consensus.cc:385] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.022933 17766 raft_consensus.cc:740] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.023689 17766 consensus_queue.cc:260] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.025764 17766 ts_tablet_manager.cc:1434] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 12:17:23.029413 17768 tablet_bootstrap.cc:654] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:23.029532 17767 consensus_queue.cc:260] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.036839 17767 ts_tablet_manager.cc:1434] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:17:23.038599 17767 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: Bootstrap starting.
I20260709 12:17:23.042081 17475 catalog_manager.cc:5697] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:23.047578 17767 tablet_bootstrap.cc:654] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:23.048787 17773 raft_consensus.cc:493] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.049325 17773 raft_consensus.cc:515] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.051496 17773 leader_election.cc:290] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:23.053399 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:23.053980 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:23.054819 17577 raft_consensus.cc:2393] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b74acd19890a458f98454c07f4aa2cc0 in current term 1: Already voted for candidate 8457735a4d7f4beb9609ce77cd81666f in this term.
I20260709 12:17:23.057422 17652 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.066960 17689 leader_election.cc:304] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:23.068734 17767 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: No bootstrap required, opened a new log
I20260709 12:17:23.069000 17800 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.069319 17767 ts_tablet_manager.cc:1403] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.023s
I20260709 12:17:23.072520 17767 raft_consensus.cc:359] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.073202 17767 raft_consensus.cc:385] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.073489 17767 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.074298 17767 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.075455 17773 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.076548 17767 ts_tablet_manager.cc:1434] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:17:23.078157 17800 raft_consensus.cc:2749] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:23.084044 17768 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:23.084542 17768 ts_tablet_manager.cc:1403] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.028s
I20260709 12:17:23.087759 17768 raft_consensus.cc:359] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.088848 17768 raft_consensus.cc:385] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.089270 17822 raft_consensus.cc:493] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.089834 17822 raft_consensus.cc:515] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.093168 17822 leader_election.cc:290] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:23.093616 17768 raft_consensus.cc:740] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.094102 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:23.094944 17652 raft_consensus.cc:2393] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a2df87e2090478582b7790e0512801c in current term 1: Already voted for candidate b74acd19890a458f98454c07f4aa2cc0 in this term.
I20260709 12:17:23.094462 17768 consensus_queue.cc:260] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.096136 17781 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.096625 17768 ts_tablet_manager.cc:1434] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:23.098400 17768 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:23.098332 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4cb57977d340a3bd4069c11359d70f" candidate_uuid: "0a2df87e2090478582b7790e0512801c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:23.099996 17543 leader_election.cc:304] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a2df87e2090478582b7790e0512801c; no voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:23.102679 17775 raft_consensus.cc:3060] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.105298 17768 tablet_bootstrap.cc:654] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:23.113873 17775 raft_consensus.cc:2749] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:23.118927 17768 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: No bootstrap required, opened a new log
I20260709 12:17:23.119531 17768 ts_tablet_manager.cc:1403] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 12:17:23.122123 17768 raft_consensus.cc:359] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.122622 17768 raft_consensus.cc:385] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:23.122857 17768 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:23.123490 17768 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.125118 17768 ts_tablet_manager.cc:1434] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:17:23.141068 17810 raft_consensus.cc:493] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.141613 17810 raft_consensus.cc:515] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.143471 17810 leader_election.cc:290] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:23.144174 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:23.144461 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:23.144909 17577 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:23.145145 17725 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:23.146030 17615 leader_election.cc:304] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:23.146531 17800 raft_consensus.cc:493] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.146816 17810 raft_consensus.cc:2804] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:23.147328 17810 raft_consensus.cc:493] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.147037 17800 raft_consensus.cc:515] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.147670 17810 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.149124 17800 leader_election.cc:290] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:23.149827 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:23.150395 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860cf0a6e471414f8e74347bf5bfa527" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
I20260709 12:17:23.150612 17577 raft_consensus.cc:2393] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b74acd19890a458f98454c07f4aa2cc0 in current term 1: Already voted for candidate 8457735a4d7f4beb9609ce77cd81666f in this term.
I20260709 12:17:23.152503 17689 leader_election.cc:304] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:23.153290 17800 raft_consensus.cc:3060] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.155644 17810 raft_consensus.cc:515] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.157289 17810 leader_election.cc:290] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:23.158262 17577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:23.158419 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:23.158773 17800 raft_consensus.cc:2749] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:23.158788 17577 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.159034 17725 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.164045 17577 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:23.164045 17725 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:23.165243 17615 leader_election.cc:304] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:23.166019 17810 raft_consensus.cc:2804] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:23.166419 17810 raft_consensus.cc:697] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:23.167196 17810 consensus_queue.cc:237] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.174250 17474 catalog_manager.cc:5697] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 1 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.268303 17800 consensus_queue.cc:1048] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.279161 17800 consensus_queue.cc:1048] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.280656 17773 consensus_queue.cc:1048] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.296463 17800 consensus_queue.cc:1048] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.301369 17775 consensus_queue.cc:1048] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.309267 17810 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.323935 17808 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.333907 17652 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.336809 17810 consensus_queue.cc:1048] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.343158 17822 consensus_queue.cc:1048] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.355578 17810 consensus_queue.cc:1048] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:23.442863 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:23.478682 17810 raft_consensus.cc:493] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.479305 17810 raft_consensus.cc:515] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.481187 17810 leader_election.cc:290] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:23.481961 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c" is_pre_election: true
I20260709 12:17:23.482205 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:23.482604 17576 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:23.482869 17726 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 0.
I20260709 12:17:23.483827 17615 leader_election.cc:304] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:23.484493 17810 raft_consensus.cc:2804] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:23.484866 17810 raft_consensus.cc:493] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.485160 17810 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.490247 17810 raft_consensus.cc:515] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.492002 17810 leader_election.cc:290] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:23.492726 17576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:23.493036 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:23.493417 17576 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.493592 17726 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:23.501332 17726 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:23.501338 17576 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:23.502786 17615 leader_election.cc:304] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:23.503633 17810 raft_consensus.cc:2804] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:23.504096 17810 raft_consensus.cc:697] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:23.504917 17810 consensus_queue.cc:237] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:23.511760 17474 catalog_manager.cc:5697] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 1 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.549212 17800 consensus_queue.cc:1048] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.557346 17810 consensus_queue.cc:1048] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.562676 17773 consensus_queue.cc:1048] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:23.573081 17810 consensus_queue.cc:1048] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:23.642500  7716 ts_manager.cc:295] Set tserver state for 0a2df87e2090478582b7790e0512801c to MAINTENANCE_MODE
I20260709 12:17:23.643611  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
W20260709 12:17:23.674118 17689 consensus_peers.cc:597] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.675658  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:23.676661  7716 tablet_replica.cc:333] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.677465  7716 raft_consensus.cc:2243] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.677985  7716 raft_consensus.cc:2272] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.679886  7716 tablet_replica.cc:333] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.680446  7716 raft_consensus.cc:2243] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.680805  7716 raft_consensus.cc:2272] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.683310  7716 tablet_replica.cc:333] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.683815  7716 raft_consensus.cc:2243] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.684162  7716 raft_consensus.cc:2272] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.686204  7716 tablet_replica.cc:333] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.686710  7716 raft_consensus.cc:2243] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.687054  7716 raft_consensus.cc:2272] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.689564  7716 tablet_replica.cc:333] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.690088  7716 raft_consensus.cc:2243] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.690452  7716 raft_consensus.cc:2272] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.692814  7716 tablet_replica.cc:333] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.693387  7716 raft_consensus.cc:2243] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.694123  7716 raft_consensus.cc:2272] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.696597  7716 tablet_replica.cc:333] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.697110  7716 raft_consensus.cc:2243] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.697479  7716 raft_consensus.cc:2272] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.699819  7716 tablet_replica.cc:333] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.700304  7716 raft_consensus.cc:2243] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.700644  7716 raft_consensus.cc:2272] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.702978  7716 tablet_replica.cc:333] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.703533  7716 raft_consensus.cc:2243] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.703963  7716 raft_consensus.cc:2272] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.706529  7716 tablet_replica.cc:333] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: stopping tablet replica
I20260709 12:17:23.707038  7716 raft_consensus.cc:2243] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.707497  7716 raft_consensus.cc:2272] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.732008  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:17:23.788164 17689 consensus_peers.cc:597] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:23.836220 17615 consensus_peers.cc:597] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:23.839294 17689 consensus_peers.cc:597] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:23.950861 17615 consensus_peers.cc:597] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:23.959919 17689 consensus_peers.cc:597] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:24.009451 17615 consensus_peers.cc:597] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:24.015806 17615 consensus_peers.cc:597] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:24.070283 17689 consensus_peers.cc:597] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:24.087522 17771 consensus_queue.cc:1048] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:24.443835 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:24.630609 17615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111) [suppressed 118 similar messages]
I20260709 12:17:24.833880 17773 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a2df87e2090478582b7790e0512801c)
I20260709 12:17:24.834421 17773 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:24.836421 17773 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:24.837919 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8457735a4d7f4beb9609ce77cd81666f" is_pre_election: true
W20260709 12:17:24.840006 17689 leader_election.cc:336] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111)
I20260709 12:17:24.840404 17689 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:24.841010 17773 raft_consensus.cc:2749] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:24.849225 17810 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a2df87e2090478582b7790e0512801c)
I20260709 12:17:24.849870 17810 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:24.851702 17810 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:24.852806 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0" is_pre_election: true
I20260709 12:17:24.853485 17726 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 1.
I20260709 12:17:24.854611 17618 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 
W20260709 12:17:24.855083 17615 leader_election.cc:336] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111)
I20260709 12:17:24.855315 17810 raft_consensus.cc:2804] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.855752 17810 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a2df87e2090478582b7790e0512801c)
I20260709 12:17:24.856035 17810 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.861284 17810 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:24.862890 17810 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:24.863986 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:24.864552 17726 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:24.867105 17615 leader_election.cc:336] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111)
I20260709 12:17:24.870939 17726 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:24.872036 17618 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8457735a4d7f4beb9609ce77cd81666f, b74acd19890a458f98454c07f4aa2cc0; no voters: 0a2df87e2090478582b7790e0512801c
I20260709 12:17:24.872671 17810 raft_consensus.cc:2804] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.873082 17810 raft_consensus.cc:697] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:24.873703 17810 consensus_queue.cc:237] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:24.880352 17472 catalog_manager.cc:5697] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 1 to 2, leader changed from 0a2df87e2090478582b7790e0512801c (127.7.137.1) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 2 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:25.318662 17615 consensus_peers.cc:597] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:25.443279 17726 raft_consensus.cc:1275] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:25.444800 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:25.444617 17771 consensus_queue.cc:1048] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:26.104028 17689 consensus_peers.cc:597] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.287952 17615 consensus_peers.cc:597] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.308642 17689 consensus_peers.cc:597] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.445853 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:26.449486 17689 consensus_peers.cc:597] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.472925 17615 consensus_peers.cc:597] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.482882 17615 consensus_peers.cc:597] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.548391 17689 consensus_peers.cc:597] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.561745 17689 consensus_peers.cc:597] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.723227 17615 consensus_peers.cc:597] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:27.447046 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:27.858161 17615 consensus_peers.cc:597] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.448208 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:17:28.482450 17689 consensus_peers.cc:597] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:28.750998 17615 consensus_peers.cc:597] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:28.754905  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:28.759930 17689 consensus_peers.cc:597] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:28.762749 17870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:28.762902 17871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:28.763888 17873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:28.767333  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:28.769333  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:28.769591  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:28.769785  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599448769773 us; error 0 us; skew 500 ppm
I20260709 12:17:28.770339  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:28.773252  7716 webserver.cc:533] Webserver started at http://127.7.137.1:34165/ using document root <none> and password file <none>
I20260709 12:17:28.773792  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:28.774005  7716 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:17:28.777889  7716 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:17:28.781878 17878 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:28.782665  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:17:28.782996  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "0a2df87e2090478582b7790e0512801c"
format_stamp: "Formatted at 2026-07-09 12:17:21 on dist-test-slave-9kw9"
I20260709 12:17:28.783464  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:28.796029  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:28.797358  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:28.798874  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:28.802430 17885 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:17:28.858258  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:17:28.858604  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.001s	sys 0.002s
I20260709 12:17:28.858922  7716 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:17:28.863862 17885 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:28.878259 17885 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:28.879217 17885 tablet_bootstrap.cc:492] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:28.879941 17885 ts_tablet_manager.cc:1403] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
W20260709 12:17:28.881027 17615 consensus_peers.cc:597] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:28.882443 17885 raft_consensus.cc:359] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.883085 17885 raft_consensus.cc:740] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:28.883742 17885 consensus_queue.cc:260] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.886226 17885 ts_tablet_manager.cc:1434] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:28.886919 17885 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
W20260709 12:17:28.892903 17615 consensus_peers.cc:597] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:28.901254 17689 consensus_peers.cc:597] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:28.905547  7716 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:17:28.905887 17885 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:28.905898  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.047s	user 0.043s	sys 0.000s
I20260709 12:17:28.906797 17885 tablet_bootstrap.cc:492] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:28.907618 17885 ts_tablet_manager.cc:1403] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:17:28.910651 17885 raft_consensus.cc:359] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.911567 17885 raft_consensus.cc:740] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:28.912513 17885 consensus_queue.cc:260] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.914965 17885 ts_tablet_manager.cc:1434] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:28.916164 17885 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:28.939463 17885 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:28.940572 17885 tablet_bootstrap.cc:492] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:28.941260 17885 ts_tablet_manager.cc:1403] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:17:28.944021 17885 raft_consensus.cc:359] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.944731 17885 raft_consensus.cc:740] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:28.945449 17885 consensus_queue.cc:260] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.947172 17885 ts_tablet_manager.cc:1434] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:17:28.948014 17885 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:28.959735 17885 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:28.962138 17885 tablet_bootstrap.cc:492] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:28.963090 17885 ts_tablet_manager.cc:1403] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:17:28.966250 17885 raft_consensus.cc:359] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.967090 17885 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:28.967933 17885 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.970148 17885 ts_tablet_manager.cc:1434] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:17:28.971103 17885 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:28.972514  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:38335
I20260709 12:17:28.972602 17947 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:38335 every 8 connection(s)
I20260709 12:17:28.978612  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:28.991827 17885 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:28.993047 17885 tablet_bootstrap.cc:492] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:28.993721 17885 ts_tablet_manager.cc:1403] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 12:17:28.996452 17885 raft_consensus.cc:359] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.997136 17885 raft_consensus.cc:740] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:28.997920 17885 consensus_queue.cc:260] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:28.999647 17948 heartbeater.cc:344] Connected to a master server at 127.7.137.62:36405
I20260709 12:17:29.000077 17885 ts_tablet_manager.cc:1434] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:29.000134 17948 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:29.001694 17885 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:29.001713 17948 heartbeater.cc:507] Master 127.7.137.62:36405 requested a full tablet report, sending...
I20260709 12:17:29.006289 17726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
mode: GRACEFUL
new_leader_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39714
I20260709 12:17:29.007052 17726 raft_consensus.cc:606] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Received request to transfer leadership to TS 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:29.007831 17472 ts_manager.cc:194] Re-registered known tserver with Master: 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335)
I20260709 12:17:29.017529 17885 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:29.018596 17885 tablet_bootstrap.cc:492] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:29.019379 17885 ts_tablet_manager.cc:1403] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:17:29.020740 17472 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34280
I20260709 12:17:29.022300 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
mode: GRACEFUL
new_leader_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:17:29.022220 17885 raft_consensus.cc:359] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.023155 17885 raft_consensus.cc:740] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:29.023205 17652 raft_consensus.cc:606] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Received request to transfer leadership to TS b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:29.023948 17885 consensus_queue.cc:260] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.024897 17948 heartbeater.cc:499] Master 127.7.137.62:36405 was elected leader, sending a full tablet report...
I20260709 12:17:29.024904  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:29.025785  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:29.026116 17885 ts_tablet_manager.cc:1434] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:29.026803  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.027050 17885 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:29.041538 17885 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:29.042582 17885 tablet_bootstrap.cc:492] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:29.043372 17885 ts_tablet_manager.cc:1403] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:17:29.045976 17885 raft_consensus.cc:359] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.046667 17885 raft_consensus.cc:740] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:29.047363 17885 consensus_queue.cc:260] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.049160 17885 ts_tablet_manager.cc:1434] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:29.049944 17885 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:29.066993 17885 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:29.068051 17885 tablet_bootstrap.cc:492] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:29.068766 17885 ts_tablet_manager.cc:1403] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:17:29.071195 17885 raft_consensus.cc:359] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.071883 17885 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:29.072501 17885 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.073899 17885 ts_tablet_manager.cc:1434] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:17:29.074743 17885 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:29.088644 17885 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:29.089455 17885 tablet_bootstrap.cc:492] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:29.090014 17885 ts_tablet_manager.cc:1403] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:17:29.091907 17885 raft_consensus.cc:359] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.092418 17885 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:29.093043 17885 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.094523 17885 ts_tablet_manager.cc:1434] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:29.095454 17885 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Bootstrap starting.
I20260709 12:17:29.109452 17885 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:29.110155 17885 tablet_bootstrap.cc:492] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Bootstrap complete.
I20260709 12:17:29.110680 17885 ts_tablet_manager.cc:1403] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:17:29.112608 17885 raft_consensus.cc:359] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.113065 17885 raft_consensus.cc:740] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2df87e2090478582b7790e0512801c, State: Initialized, Role: FOLLOWER
I20260709 12:17:29.113552 17885 consensus_queue.cc:260] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.114889 17885 ts_tablet_manager.cc:1434] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:17:29.222240 17810 raft_consensus.cc:993] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: : Instructing follower b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:29.222719 17886 raft_consensus.cc:1081] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Signalling peer b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:29.224088 17726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:17:29.224607 17726 raft_consensus.cc:493] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:29.224977 17726 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.230798 17726 raft_consensus.cc:515] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.232893 17726 leader_election.cc:290] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:29.233553 17922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:29.234067 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:29.234357 17922 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.234691 17652 raft_consensus.cc:3055] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.235023 17652 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:29.235939 17652 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.237250 17652 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.242347 17922 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:29.243783 17689 leader_election.cc:304] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:29.244520 17869 raft_consensus.cc:2804] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:29.244750 17652 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:29.246033 17869 raft_consensus.cc:697] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:29.246970 17869 consensus_queue.cc:237] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.254491 17472 catalog_manager.cc:5697] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 1 to 2, leader changed from 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2) to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.292507 17962 raft_consensus.cc:993] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: : Instructing follower 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:29.292934 17869 raft_consensus.cc:1081] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Signalling peer 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:29.294319 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39832
I20260709 12:17:29.294831 17652 raft_consensus.cc:493] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:29.295383 17652 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.300634 17652 raft_consensus.cc:515] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.302309 17652 leader_election.cc:290] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:29.303215 17922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:29.303367 17726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:29.303895 17922 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.303968 17726 raft_consensus.cc:3055] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.304399 17726 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:29.305087 17726 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.306070 17726 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.309226 17922 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:29.310411 17615 leader_election.cc:304] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:29.311204 17886 raft_consensus.cc:2804] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:29.311573 17726 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:29.311679 17886 raft_consensus.cc:697] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:29.312830 17886 consensus_queue.cc:237] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:29.320916 17472 catalog_manager.cc:5697] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 1 to 2, leader changed from b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 2 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:29.449414 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:29.503855 17921 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.667699 17652 raft_consensus.cc:1275] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:29.668888 17969 consensus_queue.cc:1048] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:29.678529 17921 raft_consensus.cc:1275] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:29.680413 17962 consensus_queue.cc:1048] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:29.830112 17921 raft_consensus.cc:1275] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:29.831509 17810 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:29.831573 17726 raft_consensus.cc:1275] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:29.832960 17810 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.037787  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:30.045338 17725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
mode: GRACEFUL
new_leader_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39714
I20260709 12:17:30.046087 17725 raft_consensus.cc:606] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Received request to transfer leadership to TS 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:30.049003 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
mode: GRACEFUL
new_leader_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:17:30.049630 17652 raft_consensus.cc:606] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Received request to transfer leadership to TS b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:30.050737  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:30.051198  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:30.051748  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:30.064566 17976 raft_consensus.cc:993] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: : Instructing follower b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:30.065136 17810 raft_consensus.cc:1081] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Signalling peer b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:30.066668 17725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:17:30.067130 17725 raft_consensus.cc:493] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.067472 17725 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.073561 17725 raft_consensus.cc:515] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.075379 17725 leader_election.cc:290] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:30.076124 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:30.076419 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:30.076823 17921 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.077018 17652 raft_consensus.cc:3055] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.077386 17652 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:30.078238 17652 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.079567 17652 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.084430 17921 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:30.085744 17689 leader_election.cc:304] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:30.086516 17869 raft_consensus.cc:2804] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.086570 17652 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:30.087078 17869 raft_consensus.cc:697] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:30.087934 17869 consensus_queue.cc:237] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.094645 17472 catalog_manager.cc:5697] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 1 to 2, leader changed from 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2) to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.340811 17869 raft_consensus.cc:993] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: : Instructing follower 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:30.341296 17962 raft_consensus.cc:1081] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Signalling peer 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:30.342828 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39832
I20260709 12:17:30.343351 17652 raft_consensus.cc:493] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.343713 17652 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.348508 17652 raft_consensus.cc:515] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.350113 17652 leader_election.cc:290] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:30.350791 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:30.351593 17921 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.351841 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43bd05efaab4998be91fd08b4d1e246" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:30.352568 17725 raft_consensus.cc:3055] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.352946 17725 raft_consensus.cc:740] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:30.353698 17725 consensus_queue.cc:260] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.354761 17725 raft_consensus.cc:3060] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.357424 17921 raft_consensus.cc:2468] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:30.358742 17615 leader_election.cc:304] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:30.359537 17810 raft_consensus.cc:2804] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.359944 17810 raft_consensus.cc:697] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:30.360764 17810 consensus_queue.cc:237] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:30.361503 17725 raft_consensus.cc:2468] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:30.368345 17472 catalog_manager.cc:5697] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 1 to 2, leader changed from b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 2 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:30.450649 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:30.480978 17652 raft_consensus.cc:1275] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.482273 17962 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.494326 17921 raft_consensus.cc:1275] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.495782 17962 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.820365 17921 raft_consensus.cc:1275] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.821617 17810 consensus_queue.cc:1048] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.831099 17725 raft_consensus.cc:1275] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.833282 17991 consensus_queue.cc:1048] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.059147  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:31.068271 17725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14260072640b4597880312929f41eebd"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
mode: GRACEFUL
new_leader_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39714
I20260709 12:17:31.068866 17725 raft_consensus.cc:606] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Received request to transfer leadership to TS 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:31.071395 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
mode: GRACEFUL
new_leader_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:17:31.071856 17652 raft_consensus.cc:606] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Received request to transfer leadership to TS b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:31.073102  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:31.073575  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.074157  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:31.289839 17962 raft_consensus.cc:993] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: : Instructing follower 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:31.290398 17993 raft_consensus.cc:1081] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Signalling peer 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:31.291826 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14260072640b4597880312929f41eebd"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39832
I20260709 12:17:31.292265 17652 raft_consensus.cc:493] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.292511 17652 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.297372 17652 raft_consensus.cc:515] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.298944 17652 leader_election.cc:290] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:31.299858 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:31.300068 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14260072640b4597880312929f41eebd" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:31.300473 17921 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.300751 17725 raft_consensus.cc:3055] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.301148 17725 raft_consensus.cc:740] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:31.301862 17725 consensus_queue.cc:260] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.302909 17725 raft_consensus.cc:3060] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.306218 17921 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:31.307397 17615 leader_election.cc:304] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:31.308135 17991 raft_consensus.cc:2804] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.308576 17991 raft_consensus.cc:697] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:31.309468 17991 consensus_queue.cc:237] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.309967 17725 raft_consensus.cc:2468] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 2.
I20260709 12:17:31.316710 17474 catalog_manager.cc:5697] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 1 to 2, leader changed from b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 2 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:31.451706 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:31.469604 17999 raft_consensus.cc:993] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: : Instructing follower b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:31.470242 17991 raft_consensus.cc:1081] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Signalling peer b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:31.471839 17725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:17:31.472365 17725 raft_consensus.cc:493] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.472651 17725 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.477885 17725 raft_consensus.cc:515] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.479552 17725 leader_election.cc:290] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Requested vote from peers 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319), 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335)
I20260709 12:17:31.480531 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:31.480980 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fe7c5b5180448eb8cd082bfb4fc54f" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:31.481138 17652 raft_consensus.cc:3055] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.481577 17921 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.481647 17652 raft_consensus.cc:740] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:31.482471 17652 consensus_queue.cc:260] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.483426 17652 raft_consensus.cc:3060] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.487839 17921 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:31.488021 17652 raft_consensus.cc:2468] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 2.
I20260709 12:17:31.489154 17689 leader_election.cc:304] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:31.489828 17993 raft_consensus.cc:2804] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.490257 17993 raft_consensus.cc:697] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:31.491123 17993 consensus_queue.cc:237] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:31.498440 17474 catalog_manager.cc:5697] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 1 to 2, leader changed from 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2) to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.762607 17725 raft_consensus.cc:1275] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.764477 17991 consensus_queue.cc:1048] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.775728 17921 raft_consensus.cc:1275] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.777531 17810 consensus_queue.cc:1048] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.906245 17652 raft_consensus.cc:1275] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.907565 17962 consensus_queue.cc:1048] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.917840 17921 raft_consensus.cc:1275] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.919682 18008 consensus_queue.cc:1048] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:32.080385  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.087817 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
mode: GRACEFUL
new_leader_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:17:32.088373 17652 raft_consensus.cc:606] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Received request to transfer leadership to TS b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:32.090979 17725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
mode: GRACEFUL
new_leader_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39714
I20260709 12:17:32.091508 17725 raft_consensus.cc:606] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Received request to transfer leadership to TS 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:32.092665  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:32.093171  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:32.093775  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.382055 17993 raft_consensus.cc:993] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: : Instructing follower 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:32.382551 18008 raft_consensus.cc:1081] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Signalling peer 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:32.384061 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39832
I20260709 12:17:32.384553 17652 raft_consensus.cc:493] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.384953 17652 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.390983 17652 raft_consensus.cc:515] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.392397 17652 leader_election.cc:290] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 3 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:32.393313 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:32.393500 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8b4dff1b0645efbfefc6316a97f6e2" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:32.394016 17921 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.394081 17725 raft_consensus.cc:3055] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.394524 17725 raft_consensus.cc:740] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:32.395197 17725 consensus_queue.cc:260] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.396248 17725 raft_consensus.cc:3060] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.400655 17921 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 3.
I20260709 12:17:32.401767 17615 leader_election.cc:304] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:32.402441 17991 raft_consensus.cc:2804] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.402792 17725 raft_consensus.cc:2468] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 3.
I20260709 12:17:32.402953 17991 raft_consensus.cc:697] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 3 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:32.403887 17991 consensus_queue.cc:237] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.410652 17474 catalog_manager.cc:5697] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 2 to 3, leader changed from b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 3 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:32.452806 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:32.453295 17991 raft_consensus.cc:993] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: : Instructing follower b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:32.453819 17999 raft_consensus.cc:1081] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Signalling peer b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:32.455190 17725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:17:32.455746 17725 raft_consensus.cc:493] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.456012 17725 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.461282 17725 raft_consensus.cc:515] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.463088 17725 leader_election.cc:290] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 3 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:32.463980 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:32.464213 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4e619a86f3497aa72be716a848816c" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:32.464779 17652 raft_consensus.cc:3055] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.464659 17921 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.465212 17652 raft_consensus.cc:740] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:32.465910 17652 consensus_queue.cc:260] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.466782 17652 raft_consensus.cc:3060] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.470597 17921 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 3.
I20260709 12:17:32.470974 17652 raft_consensus.cc:2468] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 3.
I20260709 12:17:32.471771 17689 leader_election.cc:304] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:32.472502 18008 raft_consensus.cc:2804] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.472942 18008 raft_consensus.cc:697] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 3 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:32.473587 18008 consensus_queue.cc:237] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:32.481469 17474 catalog_manager.cc:5697] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 2 to 3, leader changed from 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2) to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.872366 17725 raft_consensus.cc:1275] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.874567 17999 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.891458 17921 raft_consensus.cc:1275] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.893494 17999 consensus_queue.cc:1048] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.912151 17921 raft_consensus.cc:1275] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.912775 17652 raft_consensus.cc:1275] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:32.914263 18008 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.915539 17962 consensus_queue.cc:1048] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:33.100900  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.112329 17725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
mode: GRACEFUL
new_leader_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39714
I20260709 12:17:33.113224 17725 raft_consensus.cc:606] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Received request to transfer leadership to TS 8457735a4d7f4beb9609ce77cd81666f
I20260709 12:17:33.116719 17652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
mode: GRACEFUL
new_leader_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:17:33.117182 17652 raft_consensus.cc:606] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Received request to transfer leadership to TS b74acd19890a458f98454c07f4aa2cc0
I20260709 12:17:33.118644  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:33.119342  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:33.120123  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.339895 18008 raft_consensus.cc:993] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: : Instructing follower 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:33.340647 18026 raft_consensus.cc:1081] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Signalling peer 8457735a4d7f4beb9609ce77cd81666f to start an election
I20260709 12:17:33.342378 17652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d"
dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
 from {username='slave'} at 127.0.0.1:39832
I20260709 12:17:33.343004 17652 raft_consensus.cc:493] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:33.343374 17652 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.351325 17652 raft_consensus.cc:515] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.352901 17652 leader_election.cc:290] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 3 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3:44769)
I20260709 12:17:33.354213 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:33.354241 17725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e07c4507dba42e89154f09ae353078d" candidate_uuid: "8457735a4d7f4beb9609ce77cd81666f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
I20260709 12:17:33.355173 17921 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.355265 17725 raft_consensus.cc:3055] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:33.355698 17725 raft_consensus.cc:740] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:33.356876 17725 consensus_queue.cc:260] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.358464 17725 raft_consensus.cc:3060] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.364769 17921 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 3.
I20260709 12:17:33.366302 17615 leader_election.cc:304] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, 8457735a4d7f4beb9609ce77cd81666f; no voters: 
I20260709 12:17:33.367080 17999 raft_consensus.cc:2804] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:33.367415 17725 raft_consensus.cc:2468] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8457735a4d7f4beb9609ce77cd81666f in term 3.
I20260709 12:17:33.367640 17999 raft_consensus.cc:697] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 3 LEADER]: Becoming Leader. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:33.368860 17999 consensus_queue.cc:237] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.376226 17472 catalog_manager.cc:5697] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f reported cstate change: term changed from 2 to 3, leader changed from b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3) to 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2). New cstate: current_term: 3 leader_uuid: "8457735a4d7f4beb9609ce77cd81666f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.414880 17991 raft_consensus.cc:993] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: : Instructing follower b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:33.415390 17999 raft_consensus.cc:1081] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Signalling peer b74acd19890a458f98454c07f4aa2cc0 to start an election
I20260709 12:17:33.416983 17725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb"
dest_uuid: "b74acd19890a458f98454c07f4aa2cc0"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:17:33.417390 17725 raft_consensus.cc:493] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:33.417608 17725 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.423025 17725 raft_consensus.cc:515] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.424583 17725 leader_election.cc:290] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 3 election: Requested vote from peers 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335), 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319)
I20260709 12:17:33.425544 17921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a2df87e2090478582b7790e0512801c"
I20260709 12:17:33.426255 17652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34f383ee15044faac4933b73f3451cb" candidate_uuid: "b74acd19890a458f98454c07f4aa2cc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8457735a4d7f4beb9609ce77cd81666f"
I20260709 12:17:33.426864 17652 raft_consensus.cc:3055] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:33.427165 17652 raft_consensus.cc:740] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8457735a4d7f4beb9609ce77cd81666f, State: Running, Role: LEADER
I20260709 12:17:33.426256 17921 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.428244 17652 consensus_queue.cc:260] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.429730 17652 raft_consensus.cc:3060] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.434218 17921 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 3.
I20260709 12:17:33.435598 17689 leader_election.cc:304] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2df87e2090478582b7790e0512801c, b74acd19890a458f98454c07f4aa2cc0; no voters: 
I20260709 12:17:33.435640 17652 raft_consensus.cc:2468] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b74acd19890a458f98454c07f4aa2cc0 in term 3.
I20260709 12:17:33.436525 18026 raft_consensus.cc:2804] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:33.436997 18026 raft_consensus.cc:697] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 3 LEADER]: Becoming Leader. State: Replica: b74acd19890a458f98454c07f4aa2cc0, State: Running, Role: LEADER
I20260709 12:17:33.437958 18026 consensus_queue.cc:237] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } }
I20260709 12:17:33.446756 17472 catalog_manager.cc:5697] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 reported cstate change: term changed from 2 to 3, leader changed from 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2) to b74acd19890a458f98454c07f4aa2cc0 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "b74acd19890a458f98454c07f4aa2cc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:33.454124 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:33.874035 17921 raft_consensus.cc:1275] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:33.875681 18008 consensus_queue.cc:1048] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.885969 17652 raft_consensus.cc:1275] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Refusing update from remote peer b74acd19890a458f98454c07f4aa2cc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:33.888425 18026 consensus_queue.cc:1048] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8457735a4d7f4beb9609ce77cd81666f" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.929275 17725 raft_consensus.cc:1275] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:33.930539 17999 consensus_queue.cc:1048] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b74acd19890a458f98454c07f4aa2cc0" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.942167 17921 raft_consensus.cc:1275] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Refusing update from remote peer 8457735a4d7f4beb9609ce77cd81666f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:33.943877 17999 consensus_queue.cc:1048] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2df87e2090478582b7790e0512801c" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:34.126433  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:34.158557  7716 tablet_server.cc:179] TabletServer@127.7.137.1:38335 shutting down...
I20260709 12:17:34.181015  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:34.181744  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.182475  7716 raft_consensus.cc:2243] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.182971  7716 raft_consensus.cc:2272] T 2f4e619a86f3497aa72be716a848816c P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.185475  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.186156  7716 raft_consensus.cc:2243] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.186637  7716 raft_consensus.cc:2272] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.189025  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.189622  7716 raft_consensus.cc:2243] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.190111  7716 raft_consensus.cc:2272] T 2a4cb57977d340a3bd4069c11359d70f P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.192392  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.192922  7716 raft_consensus.cc:2243] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.193405  7716 raft_consensus.cc:2272] T 14260072640b4597880312929f41eebd P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.195817  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.196379  7716 raft_consensus.cc:2243] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.196843  7716 raft_consensus.cc:2272] T d43bd05efaab4998be91fd08b4d1e246 P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.199435  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.200085  7716 raft_consensus.cc:2243] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.200510  7716 raft_consensus.cc:2272] T fc8b4dff1b0645efbfefc6316a97f6e2 P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.202900  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.203544  7716 raft_consensus.cc:2243] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.204119  7716 raft_consensus.cc:2272] T 52fe7c5b5180448eb8cd082bfb4fc54f P 0a2df87e2090478582b7790e0512801c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.206440  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.207000  7716 raft_consensus.cc:2243] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.207499  7716 raft_consensus.cc:2272] T 7e07c4507dba42e89154f09ae353078d P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.210331  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.210893  7716 raft_consensus.cc:2243] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.211397  7716 raft_consensus.cc:2272] T 860cf0a6e471414f8e74347bf5bfa527 P 0a2df87e2090478582b7790e0512801c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.214620  7716 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:34.215183  7716 raft_consensus.cc:2243] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.215634  7716 raft_consensus.cc:2272] T c34f383ee15044faac4933b73f3451cb P 0a2df87e2090478582b7790e0512801c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.249935  7716 tablet_server.cc:196] TabletServer@127.7.137.1:38335 shutdown complete.
I20260709 12:17:34.280229  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:17:34.295692 17689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111) [suppressed 89 similar messages]
W20260709 12:17:34.300209 17689 consensus_peers.cc:597] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:34.300782 17689 consensus_peers.cc:597] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.310664  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:34.311609  7716 tablet_replica.cc:333] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.312382  7716 raft_consensus.cc:2243] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.313230  7716 raft_consensus.cc:2272] T 7e07c4507dba42e89154f09ae353078d P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.316147  7716 tablet_replica.cc:333] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.316761  7716 raft_consensus.cc:2243] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.317221  7716 raft_consensus.cc:2272] T 2f4e619a86f3497aa72be716a848816c P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.319407  7716 tablet_replica.cc:333] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.320438  7716 raft_consensus.cc:2243] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.321324  7716 raft_consensus.cc:2272] T d43bd05efaab4998be91fd08b4d1e246 P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.323661  7716 tablet_replica.cc:333] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.324183  7716 raft_consensus.cc:2243] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.324698  7716 raft_consensus.cc:2272] T 52fe7c5b5180448eb8cd082bfb4fc54f P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.327147  7716 tablet_replica.cc:333] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.327965  7716 raft_consensus.cc:2243] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.329206  7716 raft_consensus.cc:2272] T fc8b4dff1b0645efbfefc6316a97f6e2 P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.332134  7716 tablet_replica.cc:333] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.333026  7716 raft_consensus.cc:2243] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:34.333151 17615 consensus_peers.cc:597] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.333576  7716 raft_consensus.cc:2272] T c34f383ee15044faac4933b73f3451cb P 8457735a4d7f4beb9609ce77cd81666f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:34.336133 17689 consensus_peers.cc:597] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 -> Peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Couldn't send request to peer 8457735a4d7f4beb9609ce77cd81666f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.337909  7716 tablet_replica.cc:333] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.338877  7716 raft_consensus.cc:2243] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.340178  7716 raft_consensus.cc:2272] T 860cf0a6e471414f8e74347bf5bfa527 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.342732  7716 tablet_replica.cc:333] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.343318  7716 raft_consensus.cc:2243] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.344172  7716 raft_consensus.cc:2272] T 14260072640b4597880312929f41eebd P 8457735a4d7f4beb9609ce77cd81666f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.346324  7716 tablet_replica.cc:333] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.346864  7716 raft_consensus.cc:2243] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.347390  7716 raft_consensus.cc:2272] T 2a4cb57977d340a3bd4069c11359d70f P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.349749  7716 tablet_replica.cc:333] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f: stopping tablet replica
I20260709 12:17:34.350329  7716 raft_consensus.cc:2243] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.350808  7716 raft_consensus.cc:2272] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P 8457735a4d7f4beb9609ce77cd81666f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.384326  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
I20260709 12:17:34.411618  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
I20260709 12:17:34.442871  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:34.443771  7716 tablet_replica.cc:333] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.444545  7716 raft_consensus.cc:2243] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.445071  7716 raft_consensus.cc:2272] T 860cf0a6e471414f8e74347bf5bfa527 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.447888  7716 tablet_replica.cc:333] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.448487  7716 raft_consensus.cc:2243] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.449322  7716 raft_consensus.cc:2272] T c34f383ee15044faac4933b73f3451cb P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.452327  7716 tablet_replica.cc:333] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.452917  7716 raft_consensus.cc:2243] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.453723  7716 raft_consensus.cc:2272] T 2f4e619a86f3497aa72be716a848816c P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:34.455533 17523 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:17:34.456110  7716 tablet_replica.cc:333] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.456744  7716 raft_consensus.cc:2243] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.457186  7716 raft_consensus.cc:2272] T 7e07c4507dba42e89154f09ae353078d P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.460548  7716 tablet_replica.cc:333] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.461599  7716 raft_consensus.cc:2243] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.462989  7716 raft_consensus.cc:2272] T 2a4cb57977d340a3bd4069c11359d70f P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:34.464389 17689 consensus_peers.cc:597] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 -> Peer 0a2df87e2090478582b7790e0512801c (127.7.137.1:38335): Couldn't send request to peer 0a2df87e2090478582b7790e0512801c. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:38335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:34.465101 17689 consensus_peers.cc:597] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 -> Peer 8457735a4d7f4beb9609ce77cd81666f (127.7.137.2:45319): Couldn't send request to peer 8457735a4d7f4beb9609ce77cd81666f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:45319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.466010  7716 tablet_replica.cc:333] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.466673  7716 raft_consensus.cc:2243] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.467136  7716 raft_consensus.cc:2272] T 14260072640b4597880312929f41eebd P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.469264  7716 tablet_replica.cc:333] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.469753  7716 raft_consensus.cc:2243] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.470603  7716 raft_consensus.cc:2272] T a779fcf10a2f47d2bcdcbb8ee78d5a24 P b74acd19890a458f98454c07f4aa2cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.472728  7716 tablet_replica.cc:333] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.473199  7716 raft_consensus.cc:2243] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.473574  7716 raft_consensus.cc:2272] T fc8b4dff1b0645efbfefc6316a97f6e2 P b74acd19890a458f98454c07f4aa2cc0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.475472  7716 tablet_replica.cc:333] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.475953  7716 raft_consensus.cc:2243] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.476773  7716 raft_consensus.cc:2272] T 52fe7c5b5180448eb8cd082bfb4fc54f P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.478941  7716 tablet_replica.cc:333] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0: stopping tablet replica
I20260709 12:17:34.479472  7716 raft_consensus.cc:2243] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.479863  7716 raft_consensus.cc:2272] T d43bd05efaab4998be91fd08b4d1e246 P b74acd19890a458f98454c07f4aa2cc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.510831  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:17:34.538424  7716 master.cc:562] Master@127.7.137.62:36405 shutting down...
I20260709 12:17:34.559798  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:34.560304  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.560606  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P 327435828e4249b39af691623fa17164: stopping tablet replica
I20260709 12:17:34.582712  7716 master.cc:584] Master@127.7.137.62:36405 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13327 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:17:34.628290  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:41931
I20260709 12:17:34.629405  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:34.635614 18050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.635700 18051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.637028 18053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:34.637229  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:34.638187  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:34.638372  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:34.638484  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599454638473 us; error 0 us; skew 500 ppm
I20260709 12:17:34.639006  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:34.641474  7716 webserver.cc:533] Webserver started at http://127.7.137.62:39435/ using document root <none> and password file <none>
I20260709 12:17:34.641924  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:34.642079  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:34.642309  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:34.643498  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "be16048bec8648f38e9821bf313a4349"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.647864  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:34.651501 18058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:34.652302  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:17:34.652593  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "be16048bec8648f38e9821bf313a4349"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.652889  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:34.672817  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:34.674089  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:34.712550  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:41931
I20260709 12:17:34.712771 18109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:41931 every 8 connection(s)
I20260709 12:17:34.716719 18110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:34.729456 18110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349: Bootstrap starting.
I20260709 12:17:34.735045 18110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:34.740059 18110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349: No bootstrap required, opened a new log
I20260709 12:17:34.742573 18110 raft_consensus.cc:359] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER }
I20260709 12:17:34.743023 18110 raft_consensus.cc:385] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:34.743221 18110 raft_consensus.cc:740] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be16048bec8648f38e9821bf313a4349, State: Initialized, Role: FOLLOWER
I20260709 12:17:34.743872 18110 consensus_queue.cc:260] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER }
I20260709 12:17:34.744323 18110 raft_consensus.cc:399] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:34.744526 18110 raft_consensus.cc:493] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:34.744771 18110 raft_consensus.cc:3060] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:34.750316 18110 raft_consensus.cc:515] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER }
I20260709 12:17:34.751005 18110 leader_election.cc:304] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be16048bec8648f38e9821bf313a4349; no voters: 
I20260709 12:17:34.752154 18110 leader_election.cc:290] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:34.752503 18113 raft_consensus.cc:2804] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:34.754020 18113 raft_consensus.cc:697] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 1 LEADER]: Becoming Leader. State: Replica: be16048bec8648f38e9821bf313a4349, State: Running, Role: LEADER
I20260709 12:17:34.754689 18113 consensus_queue.cc:237] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER }
I20260709 12:17:34.755607 18110 sys_catalog.cc:565] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:34.759717 18114 sys_catalog.cc:455] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be16048bec8648f38e9821bf313a4349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER } }
I20260709 12:17:34.760686 18114 sys_catalog.cc:458] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:34.762630 18119 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:34.762420 18115 sys_catalog.cc:455] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be16048bec8648f38e9821bf313a4349. Latest consensus state: current_term: 1 leader_uuid: "be16048bec8648f38e9821bf313a4349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be16048bec8648f38e9821bf313a4349" member_type: VOTER } }
I20260709 12:17:34.763427 18115 sys_catalog.cc:458] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:34.767876 18119 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:34.775429  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:34.777287 18119 catalog_manager.cc:1383] Generated new cluster ID: ced19484d73940aa90c0e4a9a4a8f9cb
I20260709 12:17:34.777599 18119 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:34.800148 18119 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:34.801487 18119 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:34.815915 18119 catalog_manager.cc:6070] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349: Generated new TSK 0
I20260709 12:17:34.816550 18119 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:34.842267  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:34.848383 18131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.849706 18132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.853801 18134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:34.854338  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:34.856344  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:34.856534  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:34.856667  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599454856656 us; error 0 us; skew 500 ppm
I20260709 12:17:34.857254  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:34.859795  7716 webserver.cc:533] Webserver started at http://127.7.137.1:44379/ using document root <none> and password file <none>
I20260709 12:17:34.860283  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:34.860484  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:34.860757  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:34.861907  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "c37d5505def04bdea61785a54a7af652"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.866662  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:34.870424 18139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:34.871230  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:34.871657  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "c37d5505def04bdea61785a54a7af652"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.871973  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:34.903636  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:34.904924  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:34.906415  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:34.909073  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:34.909379  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:34.909719  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:34.909976  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:34.953061  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:43463
I20260709 12:17:34.953168 18201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:43463 every 8 connection(s)
I20260709 12:17:34.958235  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:34.965538 18206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.965844 18207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:34.968560 18209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:34.968901  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:34.970233  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:34.970515  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:34.970715  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599454970695 us; error 0 us; skew 500 ppm
I20260709 12:17:34.971488  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:34.972433 18202 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41931
I20260709 12:17:34.972975 18202 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:34.973811 18202 heartbeater.cc:507] Master 127.7.137.62:41931 requested a full tablet report, sending...
I20260709 12:17:34.974395  7716 webserver.cc:533] Webserver started at http://127.7.137.2:34453/ using document root <none> and password file <none>
I20260709 12:17:34.974946  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:34.975158  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:34.975517  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:34.976197 18075 ts_manager.cc:194] Registered new tserver with Master: c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463)
I20260709 12:17:34.977176  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.978803 18075 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52170
I20260709 12:17:34.982486  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:17:34.985863 18214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:34.986639  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:34.986941  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
format_stamp: "Formatted at 2026-07-09 12:17:34 on dist-test-slave-9kw9"
I20260709 12:17:34.987210  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:35.000509  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:35.001852  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:35.003463  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:35.006886  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:35.007217  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:35.007526  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:35.007705  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:35.048846  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:42705
I20260709 12:17:35.048956 18276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:42705 every 8 connection(s)
I20260709 12:17:35.053943  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:35.062688 18280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:35.064453 18281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:35.066130 18283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:35.066507 18277 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41931
I20260709 12:17:35.067076 18277 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:35.067840  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:35.068073 18277 heartbeater.cc:507] Master 127.7.137.62:41931 requested a full tablet report, sending...
I20260709 12:17:35.068962  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:35.069319  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:35.069507  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599455069492 us; error 0 us; skew 500 ppm
I20260709 12:17:35.070222  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:35.070516 18075 ts_manager.cc:194] Registered new tserver with Master: 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705)
I20260709 12:17:35.072263 18075 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52178
I20260709 12:17:35.072773  7716 webserver.cc:533] Webserver started at http://127.7.137.3:37809/ using document root <none> and password file <none>
I20260709 12:17:35.073427  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:35.073707  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:35.073997  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:35.075197  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "24a31529315c4a279b04fdcc3919b6d4"
format_stamp: "Formatted at 2026-07-09 12:17:35 on dist-test-slave-9kw9"
I20260709 12:17:35.079684  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:35.083125 18288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:35.084123  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:17:35.084435  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "24a31529315c4a279b04fdcc3919b6d4"
format_stamp: "Formatted at 2026-07-09 12:17:35 on dist-test-slave-9kw9"
I20260709 12:17:35.084764  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:35.093966  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:35.095103  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:35.096577  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:35.098740  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:35.098963  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:35.099207  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:35.099447  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:17:35.138654  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:38511
I20260709 12:17:35.138782 18350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:38511 every 8 connection(s)
I20260709 12:17:35.153359 18351 heartbeater.cc:344] Connected to a master server at 127.7.137.62:41931
I20260709 12:17:35.153963 18351 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:35.154805 18351 heartbeater.cc:507] Master 127.7.137.62:41931 requested a full tablet report, sending...
I20260709 12:17:35.156885 18075 ts_manager.cc:194] Registered new tserver with Master: 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.157030  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015138745s
I20260709 12:17:35.158444 18075 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52186
I20260709 12:17:35.183728 18075 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52198:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:35.185863 18075 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:35.233798 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 669e9d94f7944b3ba1266860a71bb529 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.235327 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e9d94f7944b3ba1266860a71bb529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.237020 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 77bbea7c99e845908e4a865a2409cca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.238474 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bbea7c99e845908e4a865a2409cca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.247714 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 77bbea7c99e845908e4a865a2409cca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.249179 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bbea7c99e845908e4a865a2409cca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.247714 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 669e9d94f7944b3ba1266860a71bb529 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.252017 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e9d94f7944b3ba1266860a71bb529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.286531 18366 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Bootstrap starting.
I20260709 12:17:35.290210 18316 tablet_service.cc:1511] Processing CreateTablet for tablet 669e9d94f7944b3ba1266860a71bb529 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.292721 18316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 669e9d94f7944b3ba1266860a71bb529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.292481 18315 tablet_service.cc:1511] Processing CreateTablet for tablet 77bbea7c99e845908e4a865a2409cca3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e0220471190348c9ac246bae2b8d5c5a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.288614 18367 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: Bootstrap starting.
I20260709 12:17:35.293835 18315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bbea7c99e845908e4a865a2409cca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.294942 18366 tablet_bootstrap.cc:654] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.308701 18367 tablet_bootstrap.cc:654] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.312985 18369 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: Bootstrap starting.
I20260709 12:17:35.315310 18366 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: No bootstrap required, opened a new log
I20260709 12:17:35.315553 18367 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: No bootstrap required, opened a new log
I20260709 12:17:35.315867 18366 ts_tablet_manager.cc:1403] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 12:17:35.316057 18367 ts_tablet_manager.cc:1403] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.005s
I20260709 12:17:35.318521 18367 raft_consensus.cc:359] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.319340 18367 raft_consensus.cc:385] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.319775 18367 raft_consensus.cc:740] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37d5505def04bdea61785a54a7af652, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.319082 18366 raft_consensus.cc:359] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.320441 18366 raft_consensus.cc:385] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.320806 18366 raft_consensus.cc:740] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.321038 18369 tablet_bootstrap.cc:654] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.320611 18367 consensus_queue.cc:260] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.321798 18366 consensus_queue.cc:260] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.323588 18202 heartbeater.cc:499] Master 127.7.137.62:41931 was elected leader, sending a full tablet report...
I20260709 12:17:35.324455 18277 heartbeater.cc:499] Master 127.7.137.62:41931 was elected leader, sending a full tablet report...
I20260709 12:17:35.325505 18366 ts_tablet_manager.cc:1434] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:17:35.327734 18366 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Bootstrap starting.
I20260709 12:17:35.326475 18367 ts_tablet_manager.cc:1434] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:35.331655 18367 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: Bootstrap starting.
I20260709 12:17:35.333235 18369 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: No bootstrap required, opened a new log
I20260709 12:17:35.333778 18369 ts_tablet_manager.cc:1403] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.010s
I20260709 12:17:35.334512 18366 tablet_bootstrap.cc:654] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.336933 18369 raft_consensus.cc:359] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.337884 18369 raft_consensus.cc:385] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.338227 18369 raft_consensus.cc:740] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a31529315c4a279b04fdcc3919b6d4, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.339227 18369 consensus_queue.cc:260] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.340761 18367 tablet_bootstrap.cc:654] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.348961 18369 ts_tablet_manager.cc:1434] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:17:35.349865 18351 heartbeater.cc:499] Master 127.7.137.62:41931 was elected leader, sending a full tablet report...
I20260709 12:17:35.353672 18369 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: Bootstrap starting.
I20260709 12:17:35.355726 18366 tablet_bootstrap.cc:492] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: No bootstrap required, opened a new log
I20260709 12:17:35.356177 18367 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: No bootstrap required, opened a new log
I20260709 12:17:35.356366 18366 ts_tablet_manager.cc:1403] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 12:17:35.356797 18367 ts_tablet_manager.cc:1403] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 12:17:35.359870 18366 raft_consensus.cc:359] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.360219 18367 raft_consensus.cc:359] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.360890 18366 raft_consensus.cc:385] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.361081 18367 raft_consensus.cc:385] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.361369 18366 raft_consensus.cc:740] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.361512 18367 raft_consensus.cc:740] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37d5505def04bdea61785a54a7af652, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.362332 18366 consensus_queue.cc:260] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.362450 18367 consensus_queue.cc:260] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.364629 18366 ts_tablet_manager.cc:1434] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:35.364778 18367 ts_tablet_manager.cc:1434] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:35.365619 18369 tablet_bootstrap.cc:654] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.370769 18369 tablet_bootstrap.cc:492] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: No bootstrap required, opened a new log
I20260709 12:17:35.371219 18369 ts_tablet_manager.cc:1403] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 12:17:35.374053 18369 raft_consensus.cc:359] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.374629 18369 raft_consensus.cc:385] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.374927 18369 raft_consensus.cc:740] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a31529315c4a279b04fdcc3919b6d4, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.375679 18369 consensus_queue.cc:260] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.377575 18369 ts_tablet_manager.cc:1434] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:35.440089 18372 raft_consensus.cc:493] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.440802 18372 raft_consensus.cc:515] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.443176 18372 leader_election.cc:290] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.451944 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652" is_pre_election: true
I20260709 12:17:35.452750 18177 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.453807 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4" is_pre_election: true
I20260709 12:17:35.453961 18215 leader_election.cc:304] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.454720 18326 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.454945 18372 raft_consensus.cc:2804] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:35.455528 18372 raft_consensus.cc:493] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.455941 18372 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.459481 18379 raft_consensus.cc:493] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.459973 18379 raft_consensus.cc:515] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.462091 18379 leader_election.cc:290] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.462617 18372 raft_consensus.cc:515] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.462896 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652" is_pre_election: true
I20260709 12:17:35.463130 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4" is_pre_election: true
I20260709 12:17:35.463717 18177 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.463898 18326 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.464871 18372 leader_election.cc:290] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Requested vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.465610 18215 leader_election.cc:304] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, 9cc76dd8ce1b4ad8bb69b9c82f5590c5; no voters: 
I20260709 12:17:35.465696 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652"
I20260709 12:17:35.466013 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:35.466405 18177 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.466502 18372 raft_consensus.cc:2804] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:35.466665 18326 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.467146 18372 raft_consensus.cc:493] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.467597 18372 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.474684 18372 raft_consensus.cc:515] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.475414 18326 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.475345 18177 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.476989 18215 leader_election.cc:304] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.477108 18372 leader_election.cc:290] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Requested vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.477845 18379 raft_consensus.cc:2804] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:35.478318 18379 raft_consensus.cc:697] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Leader. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:35.479184 18379 consensus_queue.cc:237] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.479491 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652"
I20260709 12:17:35.479677 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:35.480118 18177 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.480226 18326 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.487787 18326 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.488296 18177 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.488968 18215 leader_election.cc:304] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, 9cc76dd8ce1b4ad8bb69b9c82f5590c5; no voters: 
I20260709 12:17:35.489849 18379 raft_consensus.cc:2804] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:35.489228 18073 catalog_manager.cc:5697] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:35.490326 18379 raft_consensus.cc:697] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Leader. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:35.491171 18379 consensus_queue.cc:237] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.501724 18073 catalog_manager.cc:5697] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:35.587901 18073 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52204:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:35.590004 18073 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:35.614241 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.615671 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.615525 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.616816 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.617515 18316 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:17:35.618850 18316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8aa7dab0a4d1cb94bd21090b5f8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.619767 18166 tablet_service.cc:1511] Processing CreateTablet for tablet b88113153015485eb5fddf7a72e6844c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.621040 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88113153015485eb5fddf7a72e6844c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.625845 18242 tablet_service.cc:1511] Processing CreateTablet for tablet b88113153015485eb5fddf7a72e6844c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.627295 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88113153015485eb5fddf7a72e6844c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.632395 18315 tablet_service.cc:1511] Processing CreateTablet for tablet b88113153015485eb5fddf7a72e6844c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=458b403bde734369bfaa7e7e9c4ae3d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:17:35.634007 18315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88113153015485eb5fddf7a72e6844c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:35.636862 18369 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: Bootstrap starting.
I20260709 12:17:35.638550 18367 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: Bootstrap starting.
I20260709 12:17:35.642774 18366 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Bootstrap starting.
I20260709 12:17:35.645035 18369 tablet_bootstrap.cc:654] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.646672 18367 tablet_bootstrap.cc:654] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.651190 18366 tablet_bootstrap.cc:654] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.660631 18369 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: No bootstrap required, opened a new log
I20260709 12:17:35.661289 18369 ts_tablet_manager.cc:1403] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 12:17:35.661834 18367 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: No bootstrap required, opened a new log
I20260709 12:17:35.662560 18367 ts_tablet_manager.cc:1403] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:17:35.665947 18367 raft_consensus.cc:359] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.666893 18367 raft_consensus.cc:385] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.667320 18367 raft_consensus.cc:740] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37d5505def04bdea61785a54a7af652, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.668408 18366 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: No bootstrap required, opened a new log
I20260709 12:17:35.668401 18367 consensus_queue.cc:260] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.669324 18366 ts_tablet_manager.cc:1403] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 12:17:35.665527 18369 raft_consensus.cc:359] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.670128 18369 raft_consensus.cc:385] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.670462 18369 raft_consensus.cc:740] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a31529315c4a279b04fdcc3919b6d4, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.671362 18367 ts_tablet_manager.cc:1434] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:17:35.671295 18369 consensus_queue.cc:260] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.673739 18369 ts_tablet_manager.cc:1434] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:17:35.674973 18367 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: Bootstrap starting.
I20260709 12:17:35.676180 18369 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: Bootstrap starting.
I20260709 12:17:35.681160 18366 raft_consensus.cc:359] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.682046 18366 raft_consensus.cc:385] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.682403 18366 raft_consensus.cc:740] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.683492 18367 tablet_bootstrap.cc:654] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.683696 18369 tablet_bootstrap.cc:654] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.683339 18366 consensus_queue.cc:260] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.688889 18366 ts_tablet_manager.cc:1434] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:17:35.690626 18366 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Bootstrap starting.
I20260709 12:17:35.696427 18367 tablet_bootstrap.cc:492] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: No bootstrap required, opened a new log
I20260709 12:17:35.697134 18367 ts_tablet_manager.cc:1403] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.011s
I20260709 12:17:35.699993 18366 tablet_bootstrap.cc:654] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:35.700685 18367 raft_consensus.cc:359] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.701743 18367 raft_consensus.cc:385] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.702167 18367 raft_consensus.cc:740] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37d5505def04bdea61785a54a7af652, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.703217 18367 consensus_queue.cc:260] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.706250 18367 ts_tablet_manager.cc:1434] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 12:17:35.718679 18366 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: No bootstrap required, opened a new log
I20260709 12:17:35.719528 18366 ts_tablet_manager.cc:1403] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 12:17:35.721756 18369 tablet_bootstrap.cc:492] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: No bootstrap required, opened a new log
I20260709 12:17:35.722414 18369 ts_tablet_manager.cc:1403] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.026s
I20260709 12:17:35.721966 18366 raft_consensus.cc:359] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.722939 18366 raft_consensus.cc:385] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.723363 18366 raft_consensus.cc:740] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.724260 18366 consensus_queue.cc:260] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.725986 18369 raft_consensus.cc:359] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.726866 18369 raft_consensus.cc:385] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:35.727027 18366 ts_tablet_manager.cc:1434] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 12:17:35.727228 18369 raft_consensus.cc:740] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a31529315c4a279b04fdcc3919b6d4, State: Initialized, Role: FOLLOWER
I20260709 12:17:35.728127 18369 consensus_queue.cc:260] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.730319 18369 ts_tablet_manager.cc:1434] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.001s
I20260709 12:17:35.745496 18379 raft_consensus.cc:493] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.746181 18379 raft_consensus.cc:515] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.748080 18379 leader_election.cc:290] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.749025 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652" is_pre_election: true
I20260709 12:17:35.749214 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4" is_pre_election: true
I20260709 12:17:35.749691 18177 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.749874 18326 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 0.
I20260709 12:17:35.750703 18215 leader_election.cc:304] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.751535 18379 raft_consensus.cc:2804] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:35.752032 18379 raft_consensus.cc:493] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.752413 18379 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.758148 18379 raft_consensus.cc:515] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.759790 18379 leader_election.cc:290] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Requested vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.760581 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37d5505def04bdea61785a54a7af652"
I20260709 12:17:35.760792 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:35.761144 18177 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.761384 18326 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.766687 18177 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.766683 18326 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 1.
I20260709 12:17:35.767926 18215 leader_election.cc:304] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.768695 18379 raft_consensus.cc:2804] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:35.769238 18379 raft_consensus.cc:697] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Leader. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
W20260709 12:17:35.769549 18123 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:35.770099 18379 consensus_queue.cc:237] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.777071 18073 catalog_manager.cc:5697] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:35.787539 18371 raft_consensus.cc:493] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.788136 18371 raft_consensus.cc:515] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.790501 18371 leader_election.cc:290] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.802851 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8aa7dab0a4d1cb94bd21090b5f8ca" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4" is_pre_election: true
I20260709 12:17:35.803079 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8aa7dab0a4d1cb94bd21090b5f8ca" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" is_pre_election: true
I20260709 12:17:35.803683 18326 raft_consensus.cc:2468] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 0.
I20260709 12:17:35.803812 18252 raft_consensus.cc:2468] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 0.
I20260709 12:17:35.804840 18140 leader_election.cc:304] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.805751 18371 raft_consensus.cc:2804] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:35.806118 18371 raft_consensus.cc:493] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.806402 18371 raft_consensus.cc:3060] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.812258 18371 raft_consensus.cc:515] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.813966 18371 leader_election.cc:290] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 1 election: Requested vote from peers 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.814788 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8aa7dab0a4d1cb94bd21090b5f8ca" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
I20260709 12:17:35.815109 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8aa7dab0a4d1cb94bd21090b5f8ca" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:35.815551 18252 raft_consensus.cc:3060] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.815749 18326 raft_consensus.cc:3060] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:35.823211 18326 raft_consensus.cc:2468] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 1.
I20260709 12:17:35.823211 18252 raft_consensus.cc:2468] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 1.
I20260709 12:17:35.824719 18141 leader_election.cc:304] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.825500 18371 raft_consensus.cc:2804] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:35.826494 18371 raft_consensus.cc:697] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 1 LEADER]: Becoming Leader. State: Replica: c37d5505def04bdea61785a54a7af652, State: Running, Role: LEADER
I20260709 12:17:35.827208 18371 consensus_queue.cc:237] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.834913 18073 catalog_manager.cc:5697] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 reported cstate change: term changed from 0 to 1, leader changed from <none> to c37d5505def04bdea61785a54a7af652 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "c37d5505def04bdea61785a54a7af652" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:35.862459 18252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529"
dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
mode: GRACEFUL
new_leader_uuid: "c37d5505def04bdea61785a54a7af652"
 from {username='slave'} at 127.0.0.1:37006
I20260709 12:17:35.862986 18252 raft_consensus.cc:606] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Received request to transfer leadership to TS c37d5505def04bdea61785a54a7af652
I20260709 12:17:35.868791 18252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3"
dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
mode: GRACEFUL
new_leader_uuid: "24a31529315c4a279b04fdcc3919b6d4"
 from {username='slave'} at 127.0.0.1:37006
I20260709 12:17:35.869283 18252 raft_consensus.cc:606] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Received request to transfer leadership to TS 24a31529315c4a279b04fdcc3919b6d4
I20260709 12:17:35.872977 18379 consensus_queue.cc:1048] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:35.878839 18252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c"
dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
mode: GRACEFUL
new_leader_uuid: "c37d5505def04bdea61785a54a7af652"
 from {username='slave'} at 127.0.0.1:37006
I20260709 12:17:35.879438 18252 raft_consensus.cc:606] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Received request to transfer leadership to TS c37d5505def04bdea61785a54a7af652
I20260709 12:17:35.881578 18372 raft_consensus.cc:993] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: : Instructing follower c37d5505def04bdea61785a54a7af652 to start an election
I20260709 12:17:35.882400 18379 raft_consensus.cc:1081] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Signalling peer c37d5505def04bdea61785a54a7af652 to start an election
I20260709 12:17:35.884809 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529"
dest_uuid: "c37d5505def04bdea61785a54a7af652"
 from {username='slave'} at 127.0.0.1:44552
I20260709 12:17:35.891114 18176 raft_consensus.cc:493] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:35.891594 18176 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.898530 18401 consensus_queue.cc:1048] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:35.899976 18176 raft_consensus.cc:515] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.912576 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
I20260709 12:17:35.913208 18252 raft_consensus.cc:3055] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:35.913497 18252 raft_consensus.cc:740] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:35.914244 18252 consensus_queue.cc:260] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.915512 18252 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.916412 18401 consensus_queue.cc:1048] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:35.919641 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "669e9d94f7944b3ba1266860a71bb529" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:35.920302 18326 raft_consensus.cc:3060] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.933816 18252 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 2.
I20260709 12:17:35.933979 18372 consensus_queue.cc:1048] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:35.937021 18141 leader_election.cc:304] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.935396 18326 raft_consensus.cc:2468] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 2.
I20260709 12:17:35.937887 18371 raft_consensus.cc:2804] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:35.935842 18176 leader_election.cc:290] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 2 election: Requested vote from peers 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:35.938378 18371 raft_consensus.cc:697] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Becoming Leader. State: Replica: c37d5505def04bdea61785a54a7af652, State: Running, Role: LEADER
I20260709 12:17:35.939278 18371 consensus_queue.cc:237] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.952656 18075 catalog_manager.cc:5697] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 reported cstate change: term changed from 1 to 2, leader changed from 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2) to c37d5505def04bdea61785a54a7af652 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "c37d5505def04bdea61785a54a7af652" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:35.955451 18372 raft_consensus.cc:993] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: : Instructing follower 24a31529315c4a279b04fdcc3919b6d4 to start an election
I20260709 12:17:35.956043 18379 raft_consensus.cc:1081] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Signalling peer 24a31529315c4a279b04fdcc3919b6d4 to start an election
I20260709 12:17:35.957674 18325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3"
dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
 from {username='slave'} at 127.0.0.1:58812
I20260709 12:17:35.958283 18325 raft_consensus.cc:493] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:35.958737 18325 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.966156 18325 raft_consensus.cc:515] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.975826 18325 leader_election.cc:290] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [CANDIDATE]: Term 2 election: Requested vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705)
I20260709 12:17:35.990577 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "24a31529315c4a279b04fdcc3919b6d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37d5505def04bdea61785a54a7af652"
I20260709 12:17:35.991305 18176 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.991569 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bbea7c99e845908e4a865a2409cca3" candidate_uuid: "24a31529315c4a279b04fdcc3919b6d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
I20260709 12:17:35.992081 18252 raft_consensus.cc:3055] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:35.992296 18252 raft_consensus.cc:740] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:35.992964 18252 consensus_queue.cc:260] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:35.994231 18252 raft_consensus.cc:3060] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.997722 18176 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a31529315c4a279b04fdcc3919b6d4 in term 2.
I20260709 12:17:35.998842 18289 leader_election.cc:304] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:35.999768 18375 raft_consensus.cc:2804] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:36.001219 18252 raft_consensus.cc:2468] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a31529315c4a279b04fdcc3919b6d4 in term 2.
I20260709 12:17:36.001269 18375 raft_consensus.cc:697] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 LEADER]: Becoming Leader. State: Replica: 24a31529315c4a279b04fdcc3919b6d4, State: Running, Role: LEADER
I20260709 12:17:36.002245 18375 consensus_queue.cc:237] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.009125 18071 catalog_manager.cc:5697] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 reported cstate change: term changed from 1 to 2, leader changed from 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2) to 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "24a31529315c4a279b04fdcc3919b6d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.169175 18379 consensus_queue.cc:1048] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:36.180402 18372 consensus_queue.cc:1048] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:36.189677 18372 raft_consensus.cc:993] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: : Instructing follower c37d5505def04bdea61785a54a7af652 to start an election
I20260709 12:17:36.190191 18401 raft_consensus.cc:1081] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Signalling peer c37d5505def04bdea61785a54a7af652 to start an election
I20260709 12:17:36.192034 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c"
dest_uuid: "c37d5505def04bdea61785a54a7af652"
 from {username='slave'} at 127.0.0.1:44552
I20260709 12:17:36.192696 18176 raft_consensus.cc:493] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.193167 18176 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.199817 18176 raft_consensus.cc:515] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.203477 18176 leader_election.cc:290] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 2 election: Requested vote from peers 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2:42705), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:36.203179 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
I20260709 12:17:36.204599 18325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "c37d5505def04bdea61785a54a7af652" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:36.205168 18252 raft_consensus.cc:3055] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:36.205304 18325 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.205576 18252 raft_consensus.cc:740] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:36.206743 18252 consensus_queue.cc:260] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.208176 18252 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.212518 18325 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 2.
I20260709 12:17:36.213605 18140 leader_election.cc:304] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, c37d5505def04bdea61785a54a7af652; no voters: 
I20260709 12:17:36.214375 18371 raft_consensus.cc:2804] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:36.214442 18252 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37d5505def04bdea61785a54a7af652 in term 2.
I20260709 12:17:36.214953 18371 raft_consensus.cc:697] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Becoming Leader. State: Replica: c37d5505def04bdea61785a54a7af652, State: Running, Role: LEADER
I20260709 12:17:36.215873 18371 consensus_queue.cc:237] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.222628 18071 catalog_manager.cc:5697] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 reported cstate change: term changed from 1 to 2, leader changed from 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2) to c37d5505def04bdea61785a54a7af652 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "c37d5505def04bdea61785a54a7af652" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.259166 18371 consensus_queue.cc:1048] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:36.270849 18415 consensus_queue.cc:1048] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:36.357358 18252 raft_consensus.cc:1275] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Refusing update from remote peer c37d5505def04bdea61785a54a7af652: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.358871 18415 consensus_queue.cc:1048] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.361235  7716 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:17:36.364765  7716 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:17:36.365393  7716 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:17:36.369864 18325 raft_consensus.cc:1275] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Refusing update from remote peer c37d5505def04bdea61785a54a7af652: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.371564 18371 consensus_queue.cc:1048] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.386112 18176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c"
dest_uuid: "c37d5505def04bdea61785a54a7af652"
mode: GRACEFUL
new_leader_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
 from {username='slave'} at 127.0.0.1:44566
I20260709 12:17:36.386710 18176 raft_consensus.cc:606] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Received request to transfer leadership to TS 9cc76dd8ce1b4ad8bb69b9c82f5590c5
I20260709 12:17:36.387935  7716 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:17:36.417217 18252 raft_consensus.cc:1275] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Refusing update from remote peer 24a31529315c4a279b04fdcc3919b6d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.418708 18375 consensus_queue.cc:1048] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.419070 18176 raft_consensus.cc:1275] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Refusing update from remote peer 24a31529315c4a279b04fdcc3919b6d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.420567 18375 consensus_queue.cc:1048] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.726742 18252 raft_consensus.cc:1275] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Refusing update from remote peer c37d5505def04bdea61785a54a7af652: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.728194 18371 consensus_queue.cc:1048] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.733790 18415 raft_consensus.cc:993] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: : Instructing follower 9cc76dd8ce1b4ad8bb69b9c82f5590c5 to start an election
I20260709 12:17:36.734386 18397 raft_consensus.cc:1081] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Signalling peer 9cc76dd8ce1b4ad8bb69b9c82f5590c5 to start an election
I20260709 12:17:36.736460 18251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c"
dest_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5"
 from {username='slave'} at 127.0.0.1:36998
I20260709 12:17:36.737107 18251 raft_consensus.cc:493] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.737493 18251 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.739562 18325 raft_consensus.cc:1275] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Refusing update from remote peer c37d5505def04bdea61785a54a7af652: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.741549 18415 consensus_queue.cc:1048] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.746680 18251 raft_consensus.cc:515] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.750113 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c37d5505def04bdea61785a54a7af652"
I20260709 12:17:36.750454 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88113153015485eb5fddf7a72e6844c" candidate_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24a31529315c4a279b04fdcc3919b6d4"
I20260709 12:17:36.750833 18176 raft_consensus.cc:3055] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:36.751144 18326 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.751335 18176 raft_consensus.cc:740] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c37d5505def04bdea61785a54a7af652, State: Running, Role: LEADER
I20260709 12:17:36.752470 18176 consensus_queue.cc:260] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.753427 18176 raft_consensus.cc:3060] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.755909 18251 leader_election.cc:290] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 3 election: Requested vote from peers c37d5505def04bdea61785a54a7af652 (127.7.137.1:43463), 24a31529315c4a279b04fdcc3919b6d4 (127.7.137.3:38511)
I20260709 12:17:36.760285 18326 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 3.
I20260709 12:17:36.761617 18215 leader_election.cc:304] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a31529315c4a279b04fdcc3919b6d4, 9cc76dd8ce1b4ad8bb69b9c82f5590c5; no voters: 
I20260709 12:17:36.762003 18176 raft_consensus.cc:2468] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cc76dd8ce1b4ad8bb69b9c82f5590c5 in term 3.
I20260709 12:17:36.762496 18401 raft_consensus.cc:2804] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:36.765014 18401 raft_consensus.cc:697] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 LEADER]: Becoming Leader. State: Replica: 9cc76dd8ce1b4ad8bb69b9c82f5590c5, State: Running, Role: LEADER
I20260709 12:17:36.765992 18401 consensus_queue.cc:237] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } }
I20260709 12:17:36.773978 18073 catalog_manager.cc:5697] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 reported cstate change: term changed from 2 to 3, leader changed from c37d5505def04bdea61785a54a7af652 (127.7.137.1) to 9cc76dd8ce1b4ad8bb69b9c82f5590c5 (127.7.137.2). New cstate: current_term: 3 leader_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37d5505def04bdea61785a54a7af652" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cc76dd8ce1b4ad8bb69b9c82f5590c5" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 42705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a31529315c4a279b04fdcc3919b6d4" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 38511 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:37.034273  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
I20260709 12:17:37.058100  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:37.058888  7716 tablet_replica.cc:333] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652: stopping tablet replica
I20260709 12:17:37.059674  7716 raft_consensus.cc:2243] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:37.060540  7716 raft_consensus.cc:2272] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P c37d5505def04bdea61785a54a7af652 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.063056  7716 tablet_replica.cc:333] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652: stopping tablet replica
I20260709 12:17:37.063885  7716 raft_consensus.cc:2243] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.064478  7716 raft_consensus.cc:2272] T b88113153015485eb5fddf7a72e6844c P c37d5505def04bdea61785a54a7af652 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.067180  7716 tablet_replica.cc:333] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652: stopping tablet replica
I20260709 12:17:37.067842  7716 raft_consensus.cc:2243] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:37.068840  7716 raft_consensus.cc:2272] T 669e9d94f7944b3ba1266860a71bb529 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.071528  7716 tablet_replica.cc:333] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652: stopping tablet replica
I20260709 12:17:37.072023  7716 raft_consensus.cc:2243] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.072422  7716 raft_consensus.cc:2272] T 77bbea7c99e845908e4a865a2409cca3 P c37d5505def04bdea61785a54a7af652 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.096781  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
I20260709 12:17:37.109803  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
I20260709 12:17:37.128674  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:37.129266  7716 tablet_replica.cc:333] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: stopping tablet replica
I20260709 12:17:37.129832  7716 raft_consensus.cc:2243] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:37.130457  7716 pending_rounds.cc:70] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Trying to abort 1 pending ops.
I20260709 12:17:37.130631  7716 pending_rounds.cc:77] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305623374922420224 op_type: NO_OP noop_request { }
I20260709 12:17:37.130882  7716 raft_consensus.cc:2889] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:17:37.131108  7716 raft_consensus.cc:2272] T b88113153015485eb5fddf7a72e6844c P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.133421  7716 tablet_replica.cc:333] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: stopping tablet replica
I20260709 12:17:37.133917  7716 raft_consensus.cc:2243] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.134275  7716 raft_consensus.cc:2272] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.136432  7716 tablet_replica.cc:333] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: stopping tablet replica
I20260709 12:17:37.136889  7716 raft_consensus.cc:2243] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.137246  7716 raft_consensus.cc:2272] T 77bbea7c99e845908e4a865a2409cca3 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.139307  7716 tablet_replica.cc:333] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5: stopping tablet replica
I20260709 12:17:37.139750  7716 raft_consensus.cc:2243] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.140117  7716 raft_consensus.cc:2272] T 669e9d94f7944b3ba1266860a71bb529 P 9cc76dd8ce1b4ad8bb69b9c82f5590c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.163154  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
I20260709 12:17:37.175706  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
I20260709 12:17:37.192946  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:37.193626  7716 tablet_replica.cc:333] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4: stopping tablet replica
I20260709 12:17:37.194180  7716 raft_consensus.cc:2243] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.194581  7716 raft_consensus.cc:2272] T b88113153015485eb5fddf7a72e6844c P 24a31529315c4a279b04fdcc3919b6d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.196803  7716 tablet_replica.cc:333] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4: stopping tablet replica
I20260709 12:17:37.197266  7716 raft_consensus.cc:2243] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.197613  7716 raft_consensus.cc:2272] T 2ba8aa7dab0a4d1cb94bd21090b5f8ca P 24a31529315c4a279b04fdcc3919b6d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.200153  7716 tablet_replica.cc:333] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4: stopping tablet replica
I20260709 12:17:37.200598  7716 raft_consensus.cc:2243] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:37.200956  7716 raft_consensus.cc:2272] T 669e9d94f7944b3ba1266860a71bb529 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.203217  7716 tablet_replica.cc:333] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4: stopping tablet replica
I20260709 12:17:37.203715  7716 raft_consensus.cc:2243] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:37.204430  7716 raft_consensus.cc:2272] T 77bbea7c99e845908e4a865a2409cca3 P 24a31529315c4a279b04fdcc3919b6d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.226503  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:17:37.238970  7716 master.cc:562] Master@127.7.137.62:41931 shutting down...
I20260709 12:17:37.254025  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:37.254706  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:37.255079  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P be16048bec8648f38e9821bf313a4349: stopping tablet replica
I20260709 12:17:37.275139  7716 master.cc:584] Master@127.7.137.62:41931 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2675 ms)
[----------] 6 tests from LeaderRebalancerTest (354233 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:17:37.303431  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:33869
I20260709 12:17:37.304611  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:37.309463 18424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:37.311311 18427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.311476  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:37.311342 18425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.312749  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:37.312930  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:37.313053  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599457313036 us; error 0 us; skew 500 ppm
I20260709 12:17:37.313526  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:37.315933  7716 webserver.cc:533] Webserver started at http://127.7.137.62:35379/ using document root <none> and password file <none>
I20260709 12:17:37.316360  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:37.316512  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:37.316713  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:37.317724  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "7ce3f9121b074db4a58b084d8b33a6b9"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.322022  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:37.325330 18432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.326126  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:37.326382  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "7ce3f9121b074db4a58b084d8b33a6b9"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.326627  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:37.349402  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:37.350397  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:37.385725  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:33869
I20260709 12:17:37.385818 18483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:33869 every 8 connection(s)
I20260709 12:17:37.390131 18484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.400877 18484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: Bootstrap starting.
I20260709 12:17:37.405247 18484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:37.409212 18484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: No bootstrap required, opened a new log
I20260709 12:17:37.411322 18484 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER }
I20260709 12:17:37.411739 18484 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:37.411948 18484 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce3f9121b074db4a58b084d8b33a6b9, State: Initialized, Role: FOLLOWER
I20260709 12:17:37.412644 18484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER }
I20260709 12:17:37.413097 18484 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:37.413323 18484 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:37.413599 18484 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:37.418445 18484 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER }
I20260709 12:17:37.419009 18484 leader_election.cc:304] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ce3f9121b074db4a58b084d8b33a6b9; no voters: 
I20260709 12:17:37.420186 18484 leader_election.cc:290] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:37.420550 18487 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:37.422071 18487 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 1 LEADER]: Becoming Leader. State: Replica: 7ce3f9121b074db4a58b084d8b33a6b9, State: Running, Role: LEADER
I20260709 12:17:37.422756 18487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER }
I20260709 12:17:37.422991 18484 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:37.426218 18488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER } }
I20260709 12:17:37.426273 18489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ce3f9121b074db4a58b084d8b33a6b9. Latest consensus state: current_term: 1 leader_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce3f9121b074db4a58b084d8b33a6b9" member_type: VOTER } }
I20260709 12:17:37.427052 18488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:37.427134 18489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:37.431394 18492 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:37.437441 18492 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:37.440177  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:37.447099 18492 catalog_manager.cc:1383] Generated new cluster ID: 49f0ed1fc44f43a68d0406dbcfb4f99b
I20260709 12:17:37.447497 18492 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:37.472018 18492 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:37.473412 18492 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:37.487637 18492 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: Generated new TSK 0
I20260709 12:17:37.488319 18492 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:37.506664  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:37.512822 18505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:37.513836 18506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.515856  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:37.516227 18508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.517241  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:37.517474  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:37.517722  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599457517685 us; error 0 us; skew 500 ppm
I20260709 12:17:37.518308  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:37.520875  7716 webserver.cc:533] Webserver started at http://127.7.137.1:36519/ using document root <none> and password file <none>
I20260709 12:17:37.521365  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:37.521572  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:37.521857  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:37.522990  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.527879  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:17:37.531564 18513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.532315  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:17:37.532645  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.532939  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:37.549074  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:37.550359  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:37.551899  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:37.554181  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:37.554430  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.554673  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:37.554847  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.593632  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:45251
I20260709 12:17:37.593734 18575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:45251 every 8 connection(s)
I20260709 12:17:37.598766  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:37.606419 18580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:37.608533 18581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:37.609565 18583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.610611  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:37.612435  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:17:37.612668 18576 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33869
W20260709 12:17:37.612675  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:37.613211  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599457613189 us; error 0 us; skew 500 ppm
I20260709 12:17:37.613269 18576 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:37.614034  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:37.614229 18576 heartbeater.cc:507] Master 127.7.137.62:33869 requested a full tablet report, sending...
I20260709 12:17:37.616575  7716 webserver.cc:533] Webserver started at http://127.7.137.2:41749/ using document root <none> and password file <none>
I20260709 12:17:37.616817 18449 ts_manager.cc:194] Registered new tserver with Master: 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251)
I20260709 12:17:37.617271  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:37.617570  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:37.617892  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:37.619174 18449 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56242
I20260709 12:17:37.619357  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "63befd92a6b34a1a9c04a83b76053861"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.624630  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:17:37.628317 18588 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.629201  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:37.629534  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "63befd92a6b34a1a9c04a83b76053861"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.629799  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:37.652346  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:37.653414  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:37.654850  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:37.657094  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:37.657327  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.657567  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:37.657757  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.696127  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:37497
I20260709 12:17:37.696240 18650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:37497 every 8 connection(s)
I20260709 12:17:37.701543  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:37.709240 18654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:37.711086 18655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.712805  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:37.713898 18657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:37.715101  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:37.715468  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:37.715674  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599457715654 us; error 0 us; skew 500 ppm
I20260709 12:17:37.715701 18651 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33869
I20260709 12:17:37.716138 18651 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:37.716406  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:37.716972 18651 heartbeater.cc:507] Master 127.7.137.62:33869 requested a full tablet report, sending...
I20260709 12:17:37.719364  7716 webserver.cc:533] Webserver started at http://127.7.137.3:39145/ using document root <none> and password file <none>
I20260709 12:17:37.719576 18449 ts_manager.cc:194] Registered new tserver with Master: 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:37.720064  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:37.720342  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:37.720661  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:37.721480 18449 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56256
I20260709 12:17:37.722189  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "56f665fb4e784830b100a70362f53b63"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.727131  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:17:37.731137 18662 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.732270  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:17:37.732645  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "56f665fb4e784830b100a70362f53b63"
format_stamp: "Formatted at 2026-07-09 12:17:37 on dist-test-slave-9kw9"
I20260709 12:17:37.732957  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:37.752699  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:37.753837  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:37.755393  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:37.757756  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:37.757993  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.758286  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:37.758423  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:37.796975  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:33227
I20260709 12:17:37.797102 18724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:33227 every 8 connection(s)
I20260709 12:17:37.810694 18725 heartbeater.cc:344] Connected to a master server at 127.7.137.62:33869
I20260709 12:17:37.811115 18725 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:37.811870 18725 heartbeater.cc:507] Master 127.7.137.62:33869 requested a full tablet report, sending...
I20260709 12:17:37.813927 18449 ts_manager.cc:194] Registered new tserver with Master: 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:37.814056  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013795126s
I20260709 12:17:37.815784 18449 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56266
I20260709 12:17:37.839367 18449 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56276:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:37.841850 18449 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:37.917613 18541 tablet_service.cc:1511] Processing CreateTablet for tablet 68b356067f994c4f9077a2fa09aab6c1 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:37.919023 18541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b356067f994c4f9077a2fa09aab6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.924099 18540 tablet_service.cc:1511] Processing CreateTablet for tablet a495051fe3c2400aa217989860c2f831 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:37.925797 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a495051fe3c2400aa217989860c2f831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.925495 18690 tablet_service.cc:1511] Processing CreateTablet for tablet 68b356067f994c4f9077a2fa09aab6c1 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:37.926891 18690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b356067f994c4f9077a2fa09aab6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.926590 18539 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e2820859d44a7909cd1ac19298120 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:37.928051 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e2820859d44a7909cd1ac19298120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.928344 18689 tablet_service.cc:1511] Processing CreateTablet for tablet a495051fe3c2400aa217989860c2f831 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:37.930316 18616 tablet_service.cc:1511] Processing CreateTablet for tablet 68b356067f994c4f9077a2fa09aab6c1 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:37.930528 18688 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e2820859d44a7909cd1ac19298120 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:37.931185 18538 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7a03ea4f604cbebe477e574447f541 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:37.932614 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7a03ea4f604cbebe477e574447f541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.932323 18687 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7a03ea4f604cbebe477e574447f541 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:37.932888 18537 tablet_service.cc:1511] Processing CreateTablet for tablet ebae6ed077cf4be691d08c38e1d06b5e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:37.934285 18686 tablet_service.cc:1511] Processing CreateTablet for tablet ebae6ed077cf4be691d08c38e1d06b5e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:37.935503 18613 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7a03ea4f604cbebe477e574447f541 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:37.936887 18536 tablet_service.cc:1511] Processing CreateTablet for tablet 95a63e7ccc47484fb20951934d85eb66 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:37.937875 18612 tablet_service.cc:1511] Processing CreateTablet for tablet ebae6ed077cf4be691d08c38e1d06b5e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:37.932952 18615 tablet_service.cc:1511] Processing CreateTablet for tablet a495051fe3c2400aa217989860c2f831 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:37.931704 18616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b356067f994c4f9077a2fa09aab6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.934217 18537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae6ed077cf4be691d08c38e1d06b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.943578 18615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a495051fe3c2400aa217989860c2f831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.934139 18614 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e2820859d44a7909cd1ac19298120 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:37.945865 18689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a495051fe3c2400aa217989860c2f831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.946235 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e2820859d44a7909cd1ac19298120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.947754 18688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e2820859d44a7909cd1ac19298120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.949697 18686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae6ed077cf4be691d08c38e1d06b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.953343 18611 tablet_service.cc:1511] Processing CreateTablet for tablet 95a63e7ccc47484fb20951934d85eb66 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:37.951555 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a63e7ccc47484fb20951934d85eb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.952051 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae6ed077cf4be691d08c38e1d06b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.956643 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a63e7ccc47484fb20951934d85eb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.958051 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7a03ea4f604cbebe477e574447f541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.958897 18687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7a03ea4f604cbebe477e574447f541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.992775 18685 tablet_service.cc:1511] Processing CreateTablet for tablet 95a63e7ccc47484fb20951934d85eb66 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:37.994272 18685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a63e7ccc47484fb20951934d85eb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.996032 18535 tablet_service.cc:1511] Processing CreateTablet for tablet db0e78cb133047d6b3d6de045b14e02e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:37.997941 18535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0e78cb133047d6b3d6de045b14e02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.012154 18610 tablet_service.cc:1511] Processing CreateTablet for tablet db0e78cb133047d6b3d6de045b14e02e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:38.014221 18610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0e78cb133047d6b3d6de045b14e02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.027985 18684 tablet_service.cc:1511] Processing CreateTablet for tablet db0e78cb133047d6b3d6de045b14e02e (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:38.029661 18684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0e78cb133047d6b3d6de045b14e02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.043970 18539 tablet_service.cc:1511] Processing CreateTablet for tablet dc81aedbe58746db9fb893ddda812212 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:38.046070 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81aedbe58746db9fb893ddda812212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.053870 18609 tablet_service.cc:1511] Processing CreateTablet for tablet dc81aedbe58746db9fb893ddda812212 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:38.055512 18609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81aedbe58746db9fb893ddda812212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.072397 18683 tablet_service.cc:1511] Processing CreateTablet for tablet dc81aedbe58746db9fb893ddda812212 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:38.074493 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc81aedbe58746db9fb893ddda812212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.086400 18538 tablet_service.cc:1511] Processing CreateTablet for tablet 8c86d675469a45ebaa87db83ef6a8703 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:38.086952 18608 tablet_service.cc:1511] Processing CreateTablet for tablet 8c86d675469a45ebaa87db83ef6a8703 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:38.088335 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c86d675469a45ebaa87db83ef6a8703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.088354 18608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c86d675469a45ebaa87db83ef6a8703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.094709 18682 tablet_service.cc:1511] Processing CreateTablet for tablet 8c86d675469a45ebaa87db83ef6a8703 (DEFAULT_TABLE table=test-workload [id=98345a3aebb34892bb634e2f7df07b07]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:38.096729 18682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c86d675469a45ebaa87db83ef6a8703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.116669 18740 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.135090 18740 tablet_bootstrap.cc:654] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.143002 18741 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.172602 18741 tablet_bootstrap.cc:654] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.173867 18742 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.179998 18740 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.180630 18740 ts_tablet_manager.cc:1403] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.007s
I20260709 12:17:38.183493 18742 tablet_bootstrap.cc:654] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.184767 18740 raft_consensus.cc:359] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.185585 18740 raft_consensus.cc:385] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.185957 18740 raft_consensus.cc:740] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.186842 18740 consensus_queue.cc:260] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.188570 18741 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.188889 18742 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.189178 18741 ts_tablet_manager.cc:1403] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.010s
I20260709 12:17:38.189357 18576 heartbeater.cc:499] Master 127.7.137.62:33869 was elected leader, sending a full tablet report...
I20260709 12:17:38.189894 18740 ts_tablet_manager.cc:1434] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:38.190754 18740 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.189389 18742 ts_tablet_manager.cc:1403] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:17:38.192171 18741 raft_consensus.cc:359] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.192950 18741 raft_consensus.cc:385] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.193230 18741 raft_consensus.cc:740] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.194103 18741 consensus_queue.cc:260] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.194454 18742 raft_consensus.cc:359] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.195382 18742 raft_consensus.cc:385] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.195771 18742 raft_consensus.cc:740] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.196897 18740 tablet_bootstrap.cc:654] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.196743 18742 consensus_queue.cc:260] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.204599 18742 ts_tablet_manager.cc:1434] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:17:38.205740 18725 heartbeater.cc:499] Master 127.7.137.62:33869 was elected leader, sending a full tablet report...
I20260709 12:17:38.223474 18742 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.231752 18740 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.232522 18740 ts_tablet_manager.cc:1403] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.015s
I20260709 12:17:38.232460 18651 heartbeater.cc:499] Master 127.7.137.62:33869 was elected leader, sending a full tablet report...
I20260709 12:17:38.233096 18741 ts_tablet_manager.cc:1434] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.044s	user 0.017s	sys 0.026s
I20260709 12:17:38.234297 18741 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.236366 18740 raft_consensus.cc:359] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.237378 18740 raft_consensus.cc:385] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.237545 18747 raft_consensus.cc:493] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.237743 18740 raft_consensus.cc:740] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.238253 18747 raft_consensus.cc:515] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.238746 18740 consensus_queue.cc:260] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.240614 18741 tablet_bootstrap.cc:654] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.241662 18740 ts_tablet_manager.cc:1434] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:17:38.242779 18740 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.247699 18742 tablet_bootstrap.cc:654] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.249157 18740 tablet_bootstrap.cc:654] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.252435 18741 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.253098 18741 ts_tablet_manager.cc:1403] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 12:17:38.256026 18741 raft_consensus.cc:359] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.256922 18741 raft_consensus.cc:385] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.257282 18741 raft_consensus.cc:740] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.258044 18741 consensus_queue.cc:260] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.268435 18741 ts_tablet_manager.cc:1434] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.011s
I20260709 12:17:38.269935 18741 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.277946 18741 tablet_bootstrap.cc:654] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.269860 18747 leader_election.cc:290] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.281684 18742 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.282524 18742 ts_tablet_manager.cc:1403] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 12:17:38.286553 18742 raft_consensus.cc:359] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.292083 18742 raft_consensus.cc:385] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.292492 18742 raft_consensus.cc:740] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.296043 18742 consensus_queue.cc:260] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.298650 18742 ts_tablet_manager.cc:1434] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:38.299692 18742 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.307325 18742 tablet_bootstrap.cc:654] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.314958 18741 tablet_bootstrap.cc:492] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.315125 18742 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.315651 18741 ts_tablet_manager.cc:1403] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.020s
I20260709 12:17:38.314962 18740 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.316473 18740 ts_tablet_manager.cc:1403] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.074s	user 0.040s	sys 0.020s
I20260709 12:17:38.318262 18551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.316890 18742 ts_tablet_manager.cc:1403] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:17:38.319023 18741 raft_consensus.cc:359] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.319841 18741 raft_consensus.cc:385] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:38.319998 18589 leader_election.cc:343] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.320199 18741 raft_consensus.cc:740] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.321195 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:38.321064 18741 consensus_queue.cc:260] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.322029 18742 raft_consensus.cc:359] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.322269 18740 raft_consensus.cc:359] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.322829 18742 raft_consensus.cc:385] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.323377 18742 raft_consensus.cc:740] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.323704 18741 ts_tablet_manager.cc:1434] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:17:38.322991 18740 raft_consensus.cc:385] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:38.323797 18590 leader_election.cc:343] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.324488 18740 raft_consensus.cc:740] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.324615 18590 leader_election.cc:304] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63
I20260709 12:17:38.324970 18741 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.325876 18747 raft_consensus.cc:2749] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:38.326709 18740 consensus_queue.cc:260] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.325510 18742 consensus_queue.cc:260] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.329784 18740 ts_tablet_manager.cc:1434] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:38.330837 18740 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.332100 18748 raft_consensus.cc:493] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.332631 18748 raft_consensus.cc:515] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.333468 18741 tablet_bootstrap.cc:654] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.333546 18742 ts_tablet_manager.cc:1434] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:17:38.334967 18742 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.339929 18746 raft_consensus.cc:493] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.340509 18746 raft_consensus.cc:515] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.341441 18742 tablet_bootstrap.cc:654] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.342370 18740 tablet_bootstrap.cc:654] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.359611 18747 raft_consensus.cc:493] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.360430 18747 raft_consensus.cc:515] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.364183 18551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
W20260709 12:17:38.365612 18589 leader_election.cc:343] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.374639 18746 leader_election.cc:290] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.376045 18747 leader_election.cc:290] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.377641 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:38.378392 18748 leader_election.cc:290] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
W20260709 12:17:38.379590 18590 leader_election.cc:343] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.380283 18590 leader_election.cc:304] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63
I20260709 12:17:38.381029 18748 raft_consensus.cc:493] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.381917 18747 raft_consensus.cc:2749] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:38.381690 18748 raft_consensus.cc:515] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.387965 18748 leader_election.cc:290] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.418407 18748 raft_consensus.cc:493] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.418560 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:38.419030 18748 raft_consensus.cc:515] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:38.420615 18515 leader_election.cc:343] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.423890 18748 leader_election.cc:290] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.426620 18551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.427866 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.428759 18550 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.428818 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.429078 18740 tablet_bootstrap.cc:492] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.430019 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.430060 18740 ts_tablet_manager.cc:1403] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.058s
I20260709 12:17:38.432247 18742 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.432988 18742 ts_tablet_manager.cc:1403] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.018s
I20260709 12:17:38.433794 18740 raft_consensus.cc:359] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.434520 18740 raft_consensus.cc:385] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.434921 18740 raft_consensus.cc:740] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
W20260709 12:17:38.435384 18497 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:38.435855 18740 consensus_queue.cc:260] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:38.436796 18663 leader_election.cc:343] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:38.437546 18514 leader_election.cc:343] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.437673 18663 leader_election.cc:304] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.438714 18740 ts_tablet_manager.cc:1434] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
W20260709 12:17:38.438848 18663 leader_election.cc:343] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.439927 18740 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.438246 18514 leader_election.cc:304] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f; no voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:38.441018 18746 raft_consensus.cc:2749] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:38.445156 18742 raft_consensus.cc:359] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.446301 18742 raft_consensus.cc:385] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.446681 18742 raft_consensus.cc:740] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.447943 18748 raft_consensus.cc:2804] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.448361 18740 tablet_bootstrap.cc:654] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.448556 18748 raft_consensus.cc:493] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.450351 18741 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.450073 18742 consensus_queue.cc:260] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.450862 18741 ts_tablet_manager.cc:1403] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.080s
I20260709 12:17:38.451574 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.452548 18625 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.452783 18742 ts_tablet_manager.cc:1434] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:17:38.453963 18742 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.454054 18741 raft_consensus.cc:359] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.454810 18741 raft_consensus.cc:385] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.455103 18741 raft_consensus.cc:740] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.455878 18741 consensus_queue.cc:260] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.459656 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.461431 18742 tablet_bootstrap.cc:654] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.466470 18741 ts_tablet_manager.cc:1434] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:17:38.466965 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.468011 18626 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.471949 18741 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
W20260709 12:17:38.472657 18663 leader_election.cc:343] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.479204 18663 leader_election.cc:304] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56f665fb4e784830b100a70362f53b63; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:38.480775 18758 raft_consensus.cc:2749] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:38.449245 18748 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.482690 18663 leader_election.cc:304] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:38.484453 18758 raft_consensus.cc:2804] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.484956 18758 raft_consensus.cc:493] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.485421 18758 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.482654 18741 tablet_bootstrap.cc:654] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.495219 18748 raft_consensus.cc:515] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.498173 18740 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.499923 18742 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.500415 18740 ts_tablet_manager.cc:1403] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.061s	user 0.038s	sys 0.020s
I20260709 12:17:38.500573 18742 ts_tablet_manager.cc:1403] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.020s
I20260709 12:17:38.500926 18741 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.501869 18741 ts_tablet_manager.cc:1403] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.009s
I20260709 12:17:38.502305 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.502964 18549 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.503671 18740 raft_consensus.cc:359] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.504027 18742 raft_consensus.cc:359] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.504503 18740 raft_consensus.cc:385] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.499215 18758 raft_consensus.cc:515] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.504936 18742 raft_consensus.cc:385] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.504988 18740 raft_consensus.cc:740] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.504980 18741 raft_consensus.cc:359] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.505836 18742 raft_consensus.cc:740] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.506088 18741 raft_consensus.cc:385] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.506618 18741 raft_consensus.cc:740] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.506374 18740 consensus_queue.cc:260] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.506780 18742 consensus_queue.cc:260] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.507591 18741 consensus_queue.cc:260] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.513499 18740 ts_tablet_manager.cc:1434] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:17:38.514994 18740 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.515170 18741 ts_tablet_manager.cc:1434] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:17:38.516330 18741 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.517768 18758 leader_election.cc:290] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.518390 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.520478 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.521106 18626 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.519071 18550 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.525532 18748 leader_election.cc:290] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.511278 18549 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.526710 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.526958 18740 tablet_bootstrap.cc:654] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.527391 18624 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.531903 18663 leader_election.cc:304] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.536113 18758 raft_consensus.cc:2804] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.536681 18758 raft_consensus.cc:697] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.537536 18758 consensus_queue.cc:237] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.540577 18740 tablet_bootstrap.cc:492] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.541385 18740 ts_tablet_manager.cc:1403] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.014s
I20260709 12:17:38.545681 18740 raft_consensus.cc:359] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.546681 18740 raft_consensus.cc:385] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.547070 18740 raft_consensus.cc:740] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.548421 18740 consensus_queue.cc:260] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.557770 18626 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.559885 18550 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.561251 18746 raft_consensus.cc:493] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.563401 18663 leader_election.cc:304] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:38.563818 18746 raft_consensus.cc:515] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.564739 18740 ts_tablet_manager.cc:1434] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:17:38.569986 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e2820859d44a7909cd1ac19298120" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
W20260709 12:17:38.573160 18515 leader_election.cc:343] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.573956 18746 leader_election.cc:290] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.574765 18748 raft_consensus.cc:2804] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.575760 18748 raft_consensus.cc:697] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.576973 18748 consensus_queue.cc:237] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.578289 18740 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.579810 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e2820859d44a7909cd1ac19298120" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.561865 18624 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.587520 18626 raft_consensus.cc:2468] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:38.588230 18740 tablet_bootstrap.cc:654] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.589259 18514 leader_election.cc:304] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 56f665fb4e784830b100a70362f53b63
I20260709 12:17:38.590898 18746 raft_consensus.cc:2804] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.591413 18746 raft_consensus.cc:493] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.591845 18746 raft_consensus.cc:3060] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.601986 18740 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.602892 18740 ts_tablet_manager.cc:1403] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.006s
I20260709 12:17:38.605732 18741 tablet_bootstrap.cc:654] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.607474 18742 ts_tablet_manager.cc:1434] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.106s	user 0.041s	sys 0.053s
I20260709 12:17:38.608608 18742 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.608865 18746 raft_consensus.cc:515] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.612524 18740 raft_consensus.cc:359] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.613368 18740 raft_consensus.cc:385] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.613682 18740 raft_consensus.cc:740] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.614929 18746 leader_election.cc:290] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.614590 18740 consensus_queue.cc:260] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.616233 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e2820859d44a7909cd1ac19298120" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.616868 18626 raft_consensus.cc:3060] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.617239 18740 ts_tablet_manager.cc:1434] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:17:38.617719 18448 catalog_manager.cc:5697] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.619292 18742 tablet_bootstrap.cc:654] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.620875 18746 raft_consensus.cc:493] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.621239 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e2820859d44a7909cd1ac19298120" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:38.621376 18746 raft_consensus.cc:515] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:38.623744 18515 leader_election.cc:343] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.626670 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.626909 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:38.627377 18624 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:38.627513 18700 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:38.627611 18626 raft_consensus.cc:2468] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:38.628734 18515 leader_election.cc:304] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.629670 18746 leader_election.cc:290] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.629803 18514 leader_election.cc:304] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 56f665fb4e784830b100a70362f53b63
I20260709 12:17:38.630451 18746 raft_consensus.cc:2804] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.630831 18746 raft_consensus.cc:493] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.631422 18746 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.621428 18740 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.643769 18758 raft_consensus.cc:493] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.644387 18758 raft_consensus.cc:515] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.644187 18775 raft_consensus.cc:2804] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.647212 18746 raft_consensus.cc:515] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.649801 18758 leader_election.cc:290] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.651276 18740 tablet_bootstrap.cc:654] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.651430 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.651430 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.652263 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.652859 18624 raft_consensus.cc:2468] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.652877 18626 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.653373 18746 leader_election.cc:290] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.655541 18663 leader_election.cc:304] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
W20260709 12:17:38.657828 18663 leader_election.cc:343] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.657526 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:38.656456 18741 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.658787 18700 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.659126 18741 ts_tablet_manager.cc:1403] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.010s
I20260709 12:17:38.659899 18775 raft_consensus.cc:697] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:38.659436 18758 raft_consensus.cc:2804] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.664536 18741 raft_consensus.cc:359] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.667774 18758 raft_consensus.cc:493] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.667902 18741 raft_consensus.cc:385] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.668274 18758 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.668334 18741 raft_consensus.cc:740] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.669730 18700 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:38.670460 18775 consensus_queue.cc:237] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.671267 18515 leader_election.cc:304] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.672339 18779 raft_consensus.cc:2804] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.672842 18779 raft_consensus.cc:697] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:38.673697 18779 consensus_queue.cc:237] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.676074 18758 raft_consensus.cc:515] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.669319 18741 consensus_queue.cc:260] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.679076 18742 tablet_bootstrap.cc:492] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.679653 18742 ts_tablet_manager.cc:1403] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.003s
I20260709 12:17:38.680152 18741 ts_tablet_manager.cc:1434] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:17:38.680979 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.681247 18741 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.681113 18448 catalog_manager.cc:5697] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.682694 18742 raft_consensus.cc:359] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:38.683435 18663 leader_election.cc:343] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:38.683462 18742 raft_consensus.cc:385] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.684115 18742 raft_consensus.cc:740] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.685060 18742 consensus_queue.cc:260] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.685983 18626 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:38.687834 18758 leader_election.cc:290] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.688396 18742 ts_tablet_manager.cc:1434] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:17:38.688745 18741 tablet_bootstrap.cc:654] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.689632 18742 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.696512 18741 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.697005 18741 ts_tablet_manager.cc:1403] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:17:38.698817 18740 tablet_bootstrap.cc:492] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.699326 18740 ts_tablet_manager.cc:1403] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.004s
I20260709 12:17:38.699401 18741 raft_consensus.cc:359] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.700218 18741 raft_consensus.cc:385] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.700521 18741 raft_consensus.cc:740] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.701339 18741 consensus_queue.cc:260] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.703328 18741 ts_tablet_manager.cc:1434] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:17:38.704320 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.704725 18740 raft_consensus.cc:359] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.705011 18626 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.707576 18742 tablet_bootstrap.cc:654] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.705507 18740 raft_consensus.cc:385] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.712013 18740 raft_consensus.cc:740] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.712855 18740 consensus_queue.cc:260] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.715103 18740 ts_tablet_manager.cc:1434] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:17:38.716147 18740 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:38.717687 18742 tablet_bootstrap.cc:492] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.709332 18741 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.718235 18742 ts_tablet_manager.cc:1403] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:17:38.720104 18626 raft_consensus.cc:2468] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.721681 18663 leader_election.cc:304] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:38.723016 18758 raft_consensus.cc:2804] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.723532 18758 raft_consensus.cc:697] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.724608 18741 tablet_bootstrap.cc:654] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.724359 18758 consensus_queue.cc:237] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.725955 18740 tablet_bootstrap.cc:654] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.731688 18446 catalog_manager.cc:5697] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 1 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.738406 18742 raft_consensus.cc:359] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.739212 18742 raft_consensus.cc:385] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.739533 18742 raft_consensus.cc:740] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.740552 18741 tablet_bootstrap.cc:492] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.741264 18741 ts_tablet_manager.cc:1403] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 12:17:38.741643 18448 catalog_manager.cc:5697] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.745316 18741 raft_consensus.cc:359] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.746001 18740 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:38.746078 18741 raft_consensus.cc:385] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.746568 18740 ts_tablet_manager.cc:1403] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 12:17:38.746603 18741 raft_consensus.cc:740] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.747614 18741 consensus_queue.cc:260] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.746341 18748 raft_consensus.cc:493] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.748696 18748 raft_consensus.cc:515] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.749884 18741 ts_tablet_manager.cc:1434] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:38.749531 18740 raft_consensus.cc:359] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.750329 18740 raft_consensus.cc:385] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.750591 18740 raft_consensus.cc:740] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.750962 18741 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:38.751291 18740 consensus_queue.cc:260] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.751955 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.752657 18550 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.753377 18740 ts_tablet_manager.cc:1434] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:17:38.753988 18663 leader_election.cc:304] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.755505 18758 raft_consensus.cc:2804] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.755605 18748 leader_election.cc:290] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.755983 18758 raft_consensus.cc:493] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.756479 18758 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.757404 18741 tablet_bootstrap.cc:654] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.757800 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.758502 18626 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.766552 18758 raft_consensus.cc:515] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.768105 18741 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:38.768561 18741 ts_tablet_manager.cc:1403] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:17:38.766485 18742 consensus_queue.cc:260] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.769011 18758 leader_election.cc:290] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.770977 18742 ts_tablet_manager.cc:1434] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 12:17:38.771342 18741 raft_consensus.cc:359] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.771983 18742 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.772073 18741 raft_consensus.cc:385] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.772301 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.772524 18741 raft_consensus.cc:740] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.772891 18550 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.773263 18741 consensus_queue.cc:260] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.775662 18741 ts_tablet_manager.cc:1434] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:17:38.777626 18775 raft_consensus.cc:493] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.778285 18775 raft_consensus.cc:515] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.780565 18775 leader_election.cc:290] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:38.781805 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:38.783864 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.784514 18626 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.784821 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.785210 18758 raft_consensus.cc:493] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.785641 18624 raft_consensus.cc:2393] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bf0d63a141c4061b4cdbdbe814be85f in current term 1: Already voted for candidate 56f665fb4e784830b100a70362f53b63 in this term.
I20260709 12:17:38.785735 18758 raft_consensus.cc:515] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.784035 18742 tablet_bootstrap.cc:654] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.791275 18550 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.791585 18514 leader_election.cc:304] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f; no voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:38.792384 18626 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.792943 18775 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.793318 18663 leader_election.cc:304] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.794246 18748 raft_consensus.cc:2804] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.794735 18748 raft_consensus.cc:697] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.794907 18742 tablet_bootstrap.cc:492] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.795614 18742 ts_tablet_manager.cc:1403] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 12:17:38.794829 18447 catalog_manager.cc:5697] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 1 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.795879 18748 consensus_queue.cc:237] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.798364 18742 raft_consensus.cc:359] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.798874 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.799124 18742 raft_consensus.cc:385] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.799585 18742 raft_consensus.cc:740] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.799659 18549 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.800580 18742 consensus_queue.cc:260] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.801019 18663 leader_election.cc:304] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.801220 18775 raft_consensus.cc:2749] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:38.801862 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.802386 18770 raft_consensus.cc:2804] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.802589 18626 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.802907 18742 ts_tablet_manager.cc:1434] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:38.802862 18770 raft_consensus.cc:493] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.803463 18770 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.804100 18742 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:38.791626 18758 leader_election.cc:290] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.813599 18742 tablet_bootstrap.cc:654] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:38.820854 18770 raft_consensus.cc:515] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.821874 18447 catalog_manager.cc:5697] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.822741 18770 leader_election.cc:290] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.823611 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.824270 18549 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.825177 18742 tablet_bootstrap.cc:492] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:38.825660 18742 ts_tablet_manager.cc:1403] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 12:17:38.827752 18742 raft_consensus.cc:359] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.828405 18742 raft_consensus.cc:385] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:38.828670 18742 raft_consensus.cc:740] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:38.829378 18742 consensus_queue.cc:260] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.831350 18742 ts_tablet_manager.cc:1434] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:17:38.831657 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.832217 18626 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.831018 18549 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.836483 18663 leader_election.cc:304] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.837314 18770 raft_consensus.cc:2804] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.837792 18770 raft_consensus.cc:697] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.838631 18770 consensus_queue.cc:237] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.838907 18626 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.845908 18447 catalog_manager.cc:5697] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.885886 18770 raft_consensus.cc:493] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.886410 18770 raft_consensus.cc:515] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.888253 18770 leader_election.cc:290] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.889147 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c86d675469a45ebaa87db83ef6a8703" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:38.889475 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c86d675469a45ebaa87db83ef6a8703" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:38.889784 18549 raft_consensus.cc:2468] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.890177 18626 raft_consensus.cc:2468] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:38.890813 18663 leader_election.cc:304] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.891724 18770 raft_consensus.cc:2804] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:38.892023 18770 raft_consensus.cc:493] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.892256 18770 raft_consensus.cc:3060] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.897653 18770 raft_consensus.cc:515] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.899587 18770 leader_election.cc:290] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:38.900343 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c86d675469a45ebaa87db83ef6a8703" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:38.900522 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c86d675469a45ebaa87db83ef6a8703" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:38.900959 18549 raft_consensus.cc:3060] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.901114 18626 raft_consensus.cc:3060] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:38.906235 18549 raft_consensus.cc:2468] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.906507 18626 raft_consensus.cc:2468] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:38.907428 18663 leader_election.cc:304] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:38.908283 18770 raft_consensus.cc:2804] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:38.908864 18770 raft_consensus.cc:697] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:38.909924 18770 consensus_queue.cc:237] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:38.919854 18447 catalog_manager.cc:5697] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:39.028580 18770 raft_consensus.cc:493] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.029222 18770 raft_consensus.cc:515] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.031216 18770 leader_election.cc:290] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:39.031864 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:39.032536 18549 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:39.032598 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:39.033299 18626 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:39.033588 18663 leader_election.cc:304] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:39.034484 18770 raft_consensus.cc:2804] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:39.034874 18770 raft_consensus.cc:493] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.035264 18770 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:39.040521 18770 raft_consensus.cc:515] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.042301 18770 leader_election.cc:290] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:39.043116 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:39.043437 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:39.043866 18549 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:39.043990 18626 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:39.051311 18626 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:39.051311 18549 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:39.052738 18663 leader_election.cc:304] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.053476 18770 raft_consensus.cc:2804] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:39.053995 18770 raft_consensus.cc:697] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.054870 18770 consensus_queue.cc:237] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.062634 18447 catalog_manager.cc:5697] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:39.090032 18775 consensus_queue.cc:1048] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.090130 18770 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.107769 18775 consensus_queue.cc:1048] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.108317 18793 consensus_queue.cc:1048] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:39.118233 18793 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.139165 18748 consensus_queue.cc:1048] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.157662 18748 consensus_queue.cc:1048] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.171226 18748 consensus_queue.cc:1048] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:39.197822 18775 consensus_queue.cc:1048] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.207623 18700 raft_consensus.cc:3060] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:39.216661 18746 consensus_queue.cc:1048] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.280483 18748 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.291828 18748 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.316185 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.316742 18700 raft_consensus.cc:606] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:39.322422 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a495051fe3c2400aa217989860c2f831"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.323110 18700 raft_consensus.cc:606] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:39.326205 18748 consensus_queue.cc:1048] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.332579 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.333184 18700 raft_consensus.cc:606] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:39.339228 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.339882 18700 raft_consensus.cc:606] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:39.339761 18758 consensus_queue.cc:1048] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:39.357838 18550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:41664
I20260709 12:17:39.358395 18550 raft_consensus.cc:606] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:39.364125 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.364701 18700 raft_consensus.cc:606] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:39.369671 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:39.370199 18700 raft_consensus.cc:606] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:39.427392 18758 consensus_queue.cc:1048] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.441402 18748 consensus_queue.cc:1048] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:39.450187 18748 consensus_queue.cc:1048] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.465898 18820 consensus_queue.cc:1048] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:39.475003 18770 raft_consensus.cc:993] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: : Instructing follower 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.475520 18748 raft_consensus.cc:1081] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.477002 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:17:39.477501 18550 raft_consensus.cc:493] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.477823 18550 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.483139 18550 raft_consensus.cc:515] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.485039 18550 leader_election.cc:290] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.485916 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:39.486171 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7a03ea4f604cbebe477e574447f541" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.487210 18625 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.487296 18700 raft_consensus.cc:3055] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.487847 18700 raft_consensus.cc:740] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.488587 18700 consensus_queue.cc:260] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.489630 18700 raft_consensus.cc:3060] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.494328 18625 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.494899 18700 raft_consensus.cc:2468] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.495972 18514 leader_election.cc:304] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.496724 18746 raft_consensus.cc:2804] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.497243 18746 raft_consensus.cc:697] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:39.498090 18746 consensus_queue.cc:237] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.504272 18447 catalog_manager.cc:5697] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 2 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.594291 18770 raft_consensus.cc:993] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: : Instructing follower 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.594730 18748 raft_consensus.cc:1081] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.596207 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:17:39.596707 18550 raft_consensus.cc:493] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.597016 18550 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.601913 18550 raft_consensus.cc:515] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.603664 18550 leader_election.cc:290] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.604486 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:39.604888 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b356067f994c4f9077a2fa09aab6c1" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.605183 18625 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.605499 18700 raft_consensus.cc:3055] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.605837 18700 raft_consensus.cc:740] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.606675 18700 consensus_queue.cc:260] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.607985 18700 raft_consensus.cc:3060] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.612498 18625 raft_consensus.cc:2468] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.614171 18514 leader_election.cc:304] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.614979 18746 raft_consensus.cc:2804] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.615489 18746 raft_consensus.cc:697] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:39.616346 18746 consensus_queue.cc:237] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.617300 18700 raft_consensus.cc:2468] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.614357 18748 raft_consensus.cc:993] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.618638 18748 raft_consensus.cc:1081] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.620791 18625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:17:39.621394 18625 raft_consensus.cc:493] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.621766 18625 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.625712 18447 catalog_manager.cc:5697] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 2 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.627516 18625 raft_consensus.cc:515] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.630216 18625 leader_election.cc:290] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.630662 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:39.630847 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae6ed077cf4be691d08c38e1d06b5e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.631412 18550 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.631477 18700 raft_consensus.cc:3055] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.631945 18700 raft_consensus.cc:740] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.633009 18700 consensus_queue.cc:260] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.634645 18700 raft_consensus.cc:3060] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.639904 18550 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.641263 18589 leader_election.cc:304] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.642066 18747 raft_consensus.cc:2804] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.642854 18700 raft_consensus.cc:2468] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.643203 18747 raft_consensus.cc:697] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:39.644258 18747 consensus_queue.cc:237] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.651147 18447 catalog_manager.cc:5697] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.686856 18775 raft_consensus.cc:993] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.687348 18746 raft_consensus.cc:1081] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.689138 18625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:17:39.689661 18625 raft_consensus.cc:493] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.689975 18625 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.695148 18625 raft_consensus.cc:515] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.697518 18625 leader_election.cc:290] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.697854 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:39.698553 18550 raft_consensus.cc:3055] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.698099 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a63e7ccc47484fb20951934d85eb66" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.698860 18550 raft_consensus.cc:740] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:39.699133 18700 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.700202 18820 raft_consensus.cc:993] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: : Instructing follower 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.699882 18550 consensus_queue.cc:260] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.700701 18820 raft_consensus.cc:1081] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:39.701174 18550 raft_consensus.cc:3060] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.702214 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a495051fe3c2400aa217989860c2f831"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:17:39.702739 18549 raft_consensus.cc:493] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.703058 18549 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.706540 18700 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.707701 18590 leader_election.cc:304] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.708559 18747 raft_consensus.cc:2804] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.708523 18550 raft_consensus.cc:2468] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.709281 18747 raft_consensus.cc:697] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:39.710260 18748 raft_consensus.cc:993] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.709424 18549 raft_consensus.cc:515] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.710199 18747 consensus_queue.cc:237] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.710829 18748 raft_consensus.cc:1081] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.712610 18549 leader_election.cc:290] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.713163 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:39.712580 18625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:17:39.713757 18624 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.713980 18625 raft_consensus.cc:493] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.714445 18625 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.714718 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.715356 18700 raft_consensus.cc:3055] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.715768 18700 raft_consensus.cc:740] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.716619 18700 consensus_queue.cc:260] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.717743 18700 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.720641 18625 raft_consensus.cc:515] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.722863 18625 leader_election.cc:290] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.724143 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.724249 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:39.724838 18699 raft_consensus.cc:3055] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.725008 18549 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.725278 18624 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.725255 18699 raft_consensus.cc:740] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.726701 18514 leader_election.cc:304] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.726517 18699 consensus_queue.cc:260] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.726926 18447 catalog_manager.cc:5697] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.727939 18699 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.730376 18775 raft_consensus.cc:2804] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.730950 18775 raft_consensus.cc:697] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:39.731822 18775 consensus_queue.cc:237] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.734095 18700 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:39.735801 18549 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.736996 18589 leader_election.cc:304] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.737884 18747 raft_consensus.cc:2804] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.738122 18699 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.738339 18747 raft_consensus.cc:697] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:39.739317 18747 consensus_queue.cc:237] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.741250 18449 catalog_manager.cc:5697] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 2 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.747000 18447 catalog_manager.cc:5697] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.927963 18770 raft_consensus.cc:993] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.928472 18748 raft_consensus.cc:1081] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:39.930213 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:17:39.930796 18624 raft_consensus.cc:493] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.931120 18624 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.932626 18625 raft_consensus.cc:1275] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:39.934115 18775 consensus_queue.cc:1048] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:39.938380 18624 raft_consensus.cc:515] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.940665 18624 leader_election.cc:290] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:39.941630 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:39.942292 18549 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.942509 18699 raft_consensus.cc:1275] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:39.943652 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0e78cb133047d6b3d6de045b14e02e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:39.944275 18700 raft_consensus.cc:3055] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.944595 18700 raft_consensus.cc:740] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:39.945397 18700 consensus_queue.cc:260] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.946516 18700 raft_consensus.cc:3060] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.947954 18825 consensus_queue.cc:1048] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:39.949987 18549 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.951345 18589 leader_election.cc:304] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:39.953328 18747 raft_consensus.cc:2804] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.956463 18747 raft_consensus.cc:697] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:39.957329 18747 consensus_queue.cc:237] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:39.960688 18700 raft_consensus.cc:2468] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:39.965018 18449 catalog_manager.cc:5697] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.052685 18700 raft_consensus.cc:1275] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.053952 18747 consensus_queue.cc:1048] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.057993 18624 raft_consensus.cc:1275] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.059525 18746 consensus_queue.cc:1048] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.063457 18549 raft_consensus.cc:1275] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.064934 18826 consensus_queue.cc:1048] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.070333 18700 raft_consensus.cc:1275] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.071703 18746 consensus_queue.cc:1048] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.125233 18700 raft_consensus.cc:1275] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.126749 18826 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.134591 18549 raft_consensus.cc:1275] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.136222 18747 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.189993 18700 raft_consensus.cc:1275] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.191370 18747 consensus_queue.cc:1048] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.200713 18549 raft_consensus.cc:1275] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.202332 18826 consensus_queue.cc:1048] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.227808 18624 raft_consensus.cc:1275] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.229321 18825 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.230491 18700 raft_consensus.cc:1275] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.231948 18825 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.509173 18549 raft_consensus.cc:1275] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.510475 18747 consensus_queue.cc:1048] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.520445 18700 raft_consensus.cc:1275] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.521937 18747 consensus_queue.cc:1048] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:42.399333 18447 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51208:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:42.402172 18447 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:42.450711 18538 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70dcf9894845c8a848351e884735f5 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:42.452066 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70dcf9894845c8a848351e884735f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.451828 18608 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70dcf9894845c8a848351e884735f5 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:42.453275 18608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70dcf9894845c8a848351e884735f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.452947 18682 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70dcf9894845c8a848351e884735f5 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:42.454545 18682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70dcf9894845c8a848351e884735f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.457890 18541 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:42.458297 18609 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:42.459408 18541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0ff2bf3e74fbca462f08bbb491da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.459529 18609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0ff2bf3e74fbca462f08bbb491da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.470647 18688 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:42.472114 18688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0ff2bf3e74fbca462f08bbb491da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.474665 18539 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22ed563824b158f8935dbab92c124 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:42.476112 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22ed563824b158f8935dbab92c124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.476338 18615 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22ed563824b158f8935dbab92c124 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:42.477680 18615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22ed563824b158f8935dbab92c124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.480401 18687 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22ed563824b158f8935dbab92c124 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:42.481797 18687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22ed563824b158f8935dbab92c124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.484433 18536 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0a163da29b439395a7c7b8940dc7a7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:42.485764 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0a163da29b439395a7c7b8940dc7a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:42.492365 18497 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:42.502256 18610 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0a163da29b439395a7c7b8940dc7a7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:42.503988 18610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0a163da29b439395a7c7b8940dc7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.504424 18685 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0a163da29b439395a7c7b8940dc7a7 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:42.505779 18685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0a163da29b439395a7c7b8940dc7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.512272 18846 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:42.518572 18541 tablet_service.cc:1511] Processing CreateTablet for tablet b8e94d88031a47dbb8f1ec318c9892ed (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:42.519773 18611 tablet_service.cc:1511] Processing CreateTablet for tablet b8e94d88031a47dbb8f1ec318c9892ed (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:42.520390 18541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e94d88031a47dbb8f1ec318c9892ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.521106 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e94d88031a47dbb8f1ec318c9892ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.529877 18688 tablet_service.cc:1511] Processing CreateTablet for tablet b8e94d88031a47dbb8f1ec318c9892ed (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:42.531441 18688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e94d88031a47dbb8f1ec318c9892ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.533066 18539 tablet_service.cc:1511] Processing CreateTablet for tablet f6c32c1c03b440e093fd766d746a0d15 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:42.540444 18613 tablet_service.cc:1511] Processing CreateTablet for tablet f6c32c1c03b440e093fd766d746a0d15 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:42.556691 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c32c1c03b440e093fd766d746a0d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.556591 18612 tablet_service.cc:1511] Processing CreateTablet for tablet 6928d3d0cd434bfe9613ef7dd995120e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:42.542308 18684 tablet_service.cc:1511] Processing CreateTablet for tablet f6c32c1c03b440e093fd766d746a0d15 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:42.557890 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6928d3d0cd434bfe9613ef7dd995120e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.558573 18684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c32c1c03b440e093fd766d746a0d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.569986 18687 tablet_service.cc:1511] Processing CreateTablet for tablet d72240bde3b44156a08c8b10d933e415 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:42.570756 18616 tablet_service.cc:1511] Processing CreateTablet for tablet d72240bde3b44156a08c8b10d933e415 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:42.571475 18687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72240bde3b44156a08c8b10d933e415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.545073 18538 tablet_service.cc:1511] Processing CreateTablet for tablet 992dae9b8a97413593e859259cd5819e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:42.546506 18846 tablet_bootstrap.cc:654] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.546795 18683 tablet_service.cc:1511] Processing CreateTablet for tablet 992dae9b8a97413593e859259cd5819e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:42.572032 18616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72240bde3b44156a08c8b10d933e415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.572731 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992dae9b8a97413593e859259cd5819e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.573457 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992dae9b8a97413593e859259cd5819e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.552083 18690 tablet_service.cc:1511] Processing CreateTablet for tablet 6928d3d0cd434bfe9613ef7dd995120e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:42.555147 18536 tablet_service.cc:1511] Processing CreateTablet for tablet 6928d3d0cd434bfe9613ef7dd995120e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:42.588235 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6928d3d0cd434bfe9613ef7dd995120e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.549086 18614 tablet_service.cc:1511] Processing CreateTablet for tablet 992dae9b8a97413593e859259cd5819e (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:42.590220 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992dae9b8a97413593e859259cd5819e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.592430 18690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6928d3d0cd434bfe9613ef7dd995120e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.580726 18845 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:42.635015 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c32c1c03b440e093fd766d746a0d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.656695 18847 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:42.656615 18541 tablet_service.cc:1511] Processing CreateTablet for tablet d72240bde3b44156a08c8b10d933e415 (DEFAULT_TABLE table=soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:42.658058 18541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72240bde3b44156a08c8b10d933e415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:42.661827 18846 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:42.662395 18846 ts_tablet_manager.cc:1403] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.150s	user 0.037s	sys 0.027s
I20260709 12:17:42.664363 18847 tablet_bootstrap.cc:654] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.643107 18845 tablet_bootstrap.cc:654] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.676821 18846 raft_consensus.cc:359] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.677951 18846 raft_consensus.cc:385] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.678334 18846 raft_consensus.cc:740] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.707121 18847 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:42.707773 18847 ts_tablet_manager.cc:1403] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.021s
I20260709 12:17:42.684199 18846 consensus_queue.cc:260] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.710798 18847 raft_consensus.cc:359] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.711565 18847 raft_consensus.cc:385] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.711867 18847 raft_consensus.cc:740] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.712581 18847 consensus_queue.cc:260] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.726064 18845 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:42.726647 18845 ts_tablet_manager.cc:1403] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.014s
I20260709 12:17:42.728706 18846 ts_tablet_manager.cc:1434] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.066s	user 0.012s	sys 0.000s
I20260709 12:17:42.729856 18846 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:42.737037 18845 raft_consensus.cc:359] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.737787 18845 raft_consensus.cc:385] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.738080 18845 raft_consensus.cc:740] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.738795 18847 ts_tablet_manager.cc:1434] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.005s
I20260709 12:17:42.738768 18845 consensus_queue.cc:260] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.740667 18847 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:42.741215 18845 ts_tablet_manager.cc:1434] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:42.742101 18846 tablet_bootstrap.cc:654] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.742211 18845 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:42.761821 18845 tablet_bootstrap.cc:654] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.764489 18847 tablet_bootstrap.cc:654] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.766701 18846 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:42.767344 18846 ts_tablet_manager.cc:1403] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.038s	user 0.003s	sys 0.010s
I20260709 12:17:42.771459 18846 raft_consensus.cc:359] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.773015 18846 raft_consensus.cc:385] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.773375 18846 raft_consensus.cc:740] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.774187 18846 consensus_queue.cc:260] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.775704 18847 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:42.775753 18845 tablet_bootstrap.cc:492] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:42.776506 18847 ts_tablet_manager.cc:1403] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 12:17:42.776646 18845 ts_tablet_manager.cc:1403] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.003s
I20260709 12:17:42.777630 18846 ts_tablet_manager.cc:1434] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:17:42.778930 18846 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:42.815047 18845 raft_consensus.cc:359] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.817065 18845 raft_consensus.cc:385] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.817459 18845 raft_consensus.cc:740] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.820125 18846 tablet_bootstrap.cc:654] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.818730 18845 consensus_queue.cc:260] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.832623 18845 ts_tablet_manager.cc:1434] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.006s
I20260709 12:17:42.835075 18845 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:42.854974 18748 raft_consensus.cc:493] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.859354 18748 raft_consensus.cc:515] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.852483 18847 raft_consensus.cc:359] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.860833 18847 raft_consensus.cc:385] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.861208 18847 raft_consensus.cc:740] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.862244 18847 consensus_queue.cc:260] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.862813 18748 leader_election.cc:290] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:42.864602 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:42.865839 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
W20260709 12:17:42.868637 18663 leader_election.cc:343] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:42.865993 18549 raft_consensus.cc:2468] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:42.870198 18846 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:42.870913 18663 leader_election.cc:304] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:42.871619 18846 ts_tablet_manager.cc:1403] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.021s
I20260709 12:17:42.872771 18847 ts_tablet_manager.cc:1434] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.001s
I20260709 12:17:42.874210 18845 tablet_bootstrap.cc:654] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.875514 18847 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:42.877007 18846 raft_consensus.cc:359] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.878046 18846 raft_consensus.cc:385] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.878466 18846 raft_consensus.cc:740] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.878106 18748 raft_consensus.cc:2804] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:42.879426 18748 raft_consensus.cc:493] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.880652 18748 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.879495 18846 consensus_queue.cc:260] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.885087 18847 tablet_bootstrap.cc:654] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.888849 18846 ts_tablet_manager.cc:1434] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 12:17:42.903198 18846 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:42.907740 18858 raft_consensus.cc:493] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.931617 18846 tablet_bootstrap.cc:654] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.907157 18748 raft_consensus.cc:515] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.932024 18845 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:42.931777 18858 raft_consensus.cc:515] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.932641 18845 ts_tablet_manager.cc:1403] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.016s
I20260709 12:17:42.933521 18748 leader_election.cc:290] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:42.936045 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:42.936936 18549 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.939769 18858 leader_election.cc:290] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:42.939581 18845 raft_consensus.cc:359] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.940491 18845 raft_consensus.cc:385] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.940816 18845 raft_consensus.cc:740] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.941888 18845 consensus_queue.cc:260] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.937565 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:42.944136 18625 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:42.937944 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:42.945396 18845 ts_tablet_manager.cc:1434] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:17:42.946509 18514 leader_election.cc:304] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:42.946986 18845 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:42.937970 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:42.951714 18775 raft_consensus.cc:2804] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:42.952252 18775 raft_consensus.cc:493] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.952586 18775 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.955688 18845 tablet_bootstrap.cc:654] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:42.960016 18847 tablet_bootstrap.cc:492] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:42.960572 18847 ts_tablet_manager.cc:1403] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.015s
I20260709 12:17:42.963392 18775 raft_consensus.cc:515] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:42.964694 18663 leader_election.cc:343] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:42.966385 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:42.967046 18624 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.968169 18549 raft_consensus.cc:2468] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:42.969246 18847 raft_consensus.cc:359] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.970060 18847 raft_consensus.cc:385] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.970011 18663 leader_election.cc:304] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:42.970708 18847 raft_consensus.cc:740] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.971415 18748 raft_consensus.cc:2804] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:42.974852 18845 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:42.930642 18860 raft_consensus.cc:493] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.975487 18845 ts_tablet_manager.cc:1403] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.001s
I20260709 12:17:42.975660 18860 raft_consensus.cc:515] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.977217 18700 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:42.978428 18846 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:42.979108 18846 ts_tablet_manager.cc:1403] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.029s
I20260709 12:17:42.979347 18845 raft_consensus.cc:359] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.977898 18847 consensus_queue.cc:260] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.982277 18847 ts_tablet_manager.cc:1434] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:17:42.982609 18846 raft_consensus.cc:359] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.983462 18846 raft_consensus.cc:385] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.983768 18846 raft_consensus.cc:740] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.984531 18846 consensus_queue.cc:260] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:42.986001 18775 leader_election.cc:290] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:42.986399 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:42.987389 18549 raft_consensus.cc:2393] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56f665fb4e784830b100a70362f53b63 in current term 1: Already voted for candidate 3bf0d63a141c4061b4cdbdbe814be85f in this term.
I20260709 12:17:42.987118 18847 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:42.988768 18846 ts_tablet_manager.cc:1434] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:17:42.990099 18846 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:42.990391 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:42.991044 18700 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:42.980135 18845 raft_consensus.cc:385] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:42.994890 18845 raft_consensus.cc:740] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:42.996100 18845 consensus_queue.cc:260] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.000694 18700 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:43.000898 18855 raft_consensus.cc:493] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.001689 18855 raft_consensus.cc:515] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.002202 18515 leader_election.cc:304] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:43.003225 18775 raft_consensus.cc:2804] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.003748 18775 raft_consensus.cc:697] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:43.004943 18775 consensus_queue.cc:237] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.008395 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.009011 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.009305 18845 ts_tablet_manager.cc:1434] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 12:17:43.010803 18748 raft_consensus.cc:697] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.010916 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.011862 18855 leader_election.cc:290] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.009328 18549 raft_consensus.cc:2393] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63befd92a6b34a1a9c04a83b76053861 in current term 1: Already voted for candidate 56f665fb4e784830b100a70362f53b63 in this term.
I20260709 12:17:42.997547 18846 tablet_bootstrap.cc:654] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.012234 18748 consensus_queue.cc:237] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.013257 18663 leader_election.cc:304] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56f665fb4e784830b100a70362f53b63; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.008410 18860 leader_election.cc:290] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.015827 18845 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:43.009045 18624 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:43.018180 18865 raft_consensus.cc:2749] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.033071 18847 tablet_bootstrap.cc:654] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.035432 18845 tablet_bootstrap.cc:654] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.038332 18449 catalog_manager.cc:5697] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 1 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.052095 18775 raft_consensus.cc:493] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.052987 18775 raft_consensus.cc:515] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.059619 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22ed563824b158f8935dbab92c124" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
W20260709 12:17:43.062239 18514 leader_election.cc:343] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.063429 18775 leader_election.cc:290] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.065442 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22ed563824b158f8935dbab92c124" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.066013 18847 tablet_bootstrap.cc:492] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.066486 18700 raft_consensus.cc:2468] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:43.066807 18847 ts_tablet_manager.cc:1403] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.014s
I20260709 12:17:43.069674 18515 leader_election.cc:304] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.070717 18775 raft_consensus.cc:2804] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.071118 18775 raft_consensus.cc:493] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.071502 18775 raft_consensus.cc:3060] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.072470 18590 leader_election.cc:304] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63
I20260709 12:17:43.073962 18855 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.077564 18846 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:43.077627 18845 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:43.078276 18846 ts_tablet_manager.cc:1403] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.024s
I20260709 12:17:43.078649 18845 ts_tablet_manager.cc:1403] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.012s
I20260709 12:17:43.080476 18775 raft_consensus.cc:515] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.082259 18846 raft_consensus.cc:359] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.083127 18846 raft_consensus.cc:385] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.083508 18846 raft_consensus.cc:740] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.084491 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22ed563824b158f8935dbab92c124" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:43.084386 18846 consensus_queue.cc:260] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.086534 18775 leader_election.cc:290] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.085372 18845 raft_consensus.cc:359] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.088058 18845 raft_consensus.cc:385] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.088349 18845 raft_consensus.cc:740] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.088675 18846 ts_tablet_manager.cc:1434] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:17:43.089129 18845 consensus_queue.cc:260] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.089789 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22ed563824b158f8935dbab92c124" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.090109 18846 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:43.090469 18699 raft_consensus.cc:3060] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.091317 18845 ts_tablet_manager.cc:1434] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:43.092623 18845 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:43.084012 18847 raft_consensus.cc:359] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.095907 18847 raft_consensus.cc:385] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.096294 18847 raft_consensus.cc:740] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.087803 18447 catalog_manager.cc:5697] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.097365 18847 consensus_queue.cc:260] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.098308 18846 tablet_bootstrap.cc:654] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.098366 18624 raft_consensus.cc:3060] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.102613 18845 tablet_bootstrap.cc:654] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.110889 18856 raft_consensus.cc:493] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.111924 18856 raft_consensus.cc:515] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.118587 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.120194 18549 raft_consensus.cc:2468] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 0.
I20260709 12:17:43.121759 18856 leader_election.cc:290] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.122088 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.123260 18589 leader_election.cc:304] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.124178 18624 raft_consensus.cc:2468] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
W20260709 12:17:43.125169 18590 leader_election.cc:343] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.125279 18826 raft_consensus.cc:2804] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.125802 18826 raft_consensus.cc:493] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.126184 18826 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.127344 18845 tablet_bootstrap.cc:492] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:43.127969 18845 ts_tablet_manager.cc:1403] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.008s
I20260709 12:17:43.135701 18845 raft_consensus.cc:359] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.136494 18845 raft_consensus.cc:385] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.136842 18845 raft_consensus.cc:740] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.137738 18845 consensus_queue.cc:260] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.136230 18826 raft_consensus.cc:515] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.140668 18845 ts_tablet_manager.cc:1434] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:43.142107 18845 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:43.141914 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.142596 18550 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.147890 18514 leader_election.cc:304] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.148948 18775 raft_consensus.cc:2804] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.149453 18775 raft_consensus.cc:697] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:43.150380 18775 consensus_queue.cc:237] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.153287 18845 tablet_bootstrap.cc:654] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.156646 18855 raft_consensus.cc:2749] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.160245 18699 raft_consensus.cc:2468] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:43.163044 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.163874 18700 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.170161 18846 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:43.170667 18846 ts_tablet_manager.cc:1403] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.081s	user 0.036s	sys 0.039s
I20260709 12:17:43.171411 18826 leader_election.cc:290] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.173534 18550 raft_consensus.cc:2468] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 1.
I20260709 12:17:43.174252 18847 ts_tablet_manager.cc:1434] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.002s
I20260709 12:17:43.176800 18846 raft_consensus.cc:359] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.185133 18700 raft_consensus.cc:2468] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 1.
I20260709 12:17:43.185563 18846 raft_consensus.cc:385] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.185916 18846 raft_consensus.cc:740] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.186264 18447 catalog_manager.cc:5697] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 1 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.186722 18846 consensus_queue.cc:260] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.177925 18589 leader_election.cc:304] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.188687 18826 raft_consensus.cc:2804] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.189128 18826 raft_consensus.cc:697] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:43.189191 18846 ts_tablet_manager.cc:1434] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:17:43.190255 18847 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:43.190809 18846 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:43.190269 18826 consensus_queue.cc:237] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.195552 18775 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.196096 18775 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.198253 18775 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.198933 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.199445 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
W20260709 12:17:43.200326 18514 leader_election.cc:343] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:43.200970 18515 leader_election.cc:343] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.201409 18515 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f; no voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.202487 18775 raft_consensus.cc:2749] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.204288 18847 tablet_bootstrap.cc:654] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.182224 18845 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:43.207387 18845 ts_tablet_manager.cc:1403] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.019s
I20260709 12:17:43.210314 18845 raft_consensus.cc:359] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.211010 18845 raft_consensus.cc:385] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.211290 18845 raft_consensus.cc:740] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.212055 18845 consensus_queue.cc:260] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.213496 18846 tablet_bootstrap.cc:654] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.213114 18447 catalog_manager.cc:5697] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.220886 18847 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.221385 18847 ts_tablet_manager.cc:1403] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 12:17:43.224519 18847 raft_consensus.cc:359] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.225227 18847 raft_consensus.cc:385] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.225440 18845 ts_tablet_manager.cc:1434] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:17:43.225524 18847 raft_consensus.cc:740] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.226720 18847 consensus_queue.cc:260] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.227658 18845 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:43.231604 18864 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.232121 18847 ts_tablet_manager.cc:1434] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:17:43.232159 18864 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.233596 18847 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:43.235742 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.236086 18846 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:43.236733 18846 ts_tablet_manager.cc:1403] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.007s
I20260709 12:17:43.237010 18845 tablet_bootstrap.cc:654] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.238050 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
W20260709 12:17:43.239601 18663 leader_election.cc:343] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.239929 18846 raft_consensus.cc:359] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.240933 18846 raft_consensus.cc:385] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.241139 18847 tablet_bootstrap.cc:654] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.241369 18846 raft_consensus.cc:740] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.241809 18550 raft_consensus.cc:2468] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:43.242606 18846 consensus_queue.cc:260] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.243449 18663 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.246320 18846 ts_tablet_manager.cc:1434] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:43.240942 18864 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.247548 18748 raft_consensus.cc:2804] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.248682 18845 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:43.250140 18748 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.250559 18845 ts_tablet_manager.cc:1403] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:17:43.250725 18748 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.247579 18846 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:43.253539 18845 raft_consensus.cc:359] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.254261 18845 raft_consensus.cc:385] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.254532 18845 raft_consensus.cc:740] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.255362 18845 consensus_queue.cc:260] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.257803 18845 ts_tablet_manager.cc:1434] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:43.258774 18846 tablet_bootstrap.cc:654] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.258965 18845 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: Bootstrap starting.
I20260709 12:17:43.259634 18864 raft_consensus.cc:493] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.260311 18864 raft_consensus.cc:515] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.262514 18864 leader_election.cc:290] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.264398 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.265142 18624 raft_consensus.cc:2468] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:43.266521 18663 leader_election.cc:304] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.266976 18845 tablet_bootstrap.cc:654] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.267668 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.269024 18847 tablet_bootstrap.cc:492] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.269562 18847 ts_tablet_manager.cc:1403] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.005s
I20260709 12:17:43.270536 18864 raft_consensus.cc:2804] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.270972 18864 raft_consensus.cc:493] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.280730 18864 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:43.281754 18663 leader_election.cc:343] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.273298 18847 raft_consensus.cc:359] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.290118 18847 raft_consensus.cc:385] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.290500 18847 raft_consensus.cc:740] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.291610 18847 consensus_queue.cc:260] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.296644 18847 ts_tablet_manager.cc:1434] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:17:43.297915 18847 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:43.306131 18864 raft_consensus.cc:515] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.308100 18748 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.312888 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.313503 18550 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.313978 18748 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.315032 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.315577 18864 leader_election.cc:290] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.316434 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
W20260709 12:17:43.317111 18663 leader_election.cc:343] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.317687 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:43.318387 18625 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.321087 18847 tablet_bootstrap.cc:654] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.323670 18845 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: No bootstrap required, opened a new log
I20260709 12:17:43.324186 18845 ts_tablet_manager.cc:1403] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.029s
I20260709 12:17:43.324216 18846 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:43.324770 18846 ts_tablet_manager.cc:1403] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.046s
W20260709 12:17:43.326197 18663 leader_election.cc:343] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:43.327535 18845 raft_consensus.cc:359] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.328263 18845 raft_consensus.cc:385] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.328528 18845 raft_consensus.cc:740] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.329283 18845 consensus_queue.cc:260] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.331497 18845 ts_tablet_manager.cc:1434] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:43.332624 18846 raft_consensus.cc:359] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.333670 18846 raft_consensus.cc:385] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.334200 18846 raft_consensus.cc:740] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.335670 18846 consensus_queue.cc:260] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.336658 18625 raft_consensus.cc:2468] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:43.337899 18663 leader_election.cc:304] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:43.339263 18748 raft_consensus.cc:2804] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.339866 18748 raft_consensus.cc:697] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.340729 18748 consensus_queue.cc:237] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.338274 18550 raft_consensus.cc:2468] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:43.343072 18663 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.343401 18846 ts_tablet_manager.cc:1434] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:17:43.343946 18847 tablet_bootstrap.cc:492] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.344234 18864 raft_consensus.cc:2804] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.344527 18846 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: Bootstrap starting.
I20260709 12:17:43.344628 18847 ts_tablet_manager.cc:1403] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.006s
I20260709 12:17:43.344753 18864 raft_consensus.cc:697] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.345862 18864 consensus_queue.cc:237] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.348325 18847 raft_consensus.cc:359] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.349148 18847 raft_consensus.cc:385] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.349515 18847 raft_consensus.cc:740] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.350451 18847 consensus_queue.cc:260] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.351267 18846 tablet_bootstrap.cc:654] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.361989 18847 ts_tablet_manager.cc:1434] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:17:43.363695 18847 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:43.366632 18446 catalog_manager.cc:5697] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.369827 18846 tablet_bootstrap.cc:492] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: No bootstrap required, opened a new log
I20260709 12:17:43.370383 18846 ts_tablet_manager.cc:1403] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 12:17:43.370445 18847 tablet_bootstrap.cc:654] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.373169 18846 raft_consensus.cc:359] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.373867 18846 raft_consensus.cc:385] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.374166 18846 raft_consensus.cc:740] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.374989 18846 consensus_queue.cc:260] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.375725 18847 tablet_bootstrap.cc:492] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.376241 18847 ts_tablet_manager.cc:1403] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:17:43.379535 18846 ts_tablet_manager.cc:1434] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:43.379331 18847 raft_consensus.cc:359] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.380676 18847 raft_consensus.cc:385] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.380954 18847 raft_consensus.cc:740] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.381634 18847 consensus_queue.cc:260] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.383668 18847 ts_tablet_manager.cc:1434] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:43.384732 18847 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: Bootstrap starting.
I20260709 12:17:43.386279 18449 catalog_manager.cc:5697] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.389817 18847 tablet_bootstrap.cc:654] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:43.396303 18748 consensus_queue.cc:1048] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:43.406054 18847 tablet_bootstrap.cc:492] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: No bootstrap required, opened a new log
I20260709 12:17:43.406893 18847 ts_tablet_manager.cc:1403] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:17:43.409966 18847 raft_consensus.cc:359] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.410708 18847 raft_consensus.cc:385] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:43.411049 18847 raft_consensus.cc:740] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Initialized, Role: FOLLOWER
I20260709 12:17:43.411827 18847 consensus_queue.cc:260] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.414000 18847 ts_tablet_manager.cc:1434] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:43.419370 18855 raft_consensus.cc:493] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.419875 18855 raft_consensus.cc:515] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.423540 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e94d88031a47dbb8f1ec318c9892ed" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.424191 18549 raft_consensus.cc:2468] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 0.
I20260709 12:17:43.424391 18865 consensus_queue.cc:1048] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:43.429031 18855 leader_election.cc:290] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.429657 18589 leader_election.cc:304] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.430572 18855 raft_consensus.cc:2804] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.430944 18855 raft_consensus.cc:493] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.431294 18855 raft_consensus.cc:3060] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.431169 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e94d88031a47dbb8f1ec318c9892ed" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.433100 18700 raft_consensus.cc:2468] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 0.
I20260709 12:17:43.442637 18855 raft_consensus.cc:515] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.444912 18855 leader_election.cc:290] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.445607 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e94d88031a47dbb8f1ec318c9892ed" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.446295 18550 raft_consensus.cc:3060] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.447853 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e94d88031a47dbb8f1ec318c9892ed" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.448472 18700 raft_consensus.cc:3060] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.453831 18550 raft_consensus.cc:2468] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 1.
I20260709 12:17:43.455034 18589 leader_election.cc:304] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.455803 18700 raft_consensus.cc:2468] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 1.
I20260709 12:17:43.455879 18855 raft_consensus.cc:2804] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.456581 18855 raft_consensus.cc:697] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:43.457407 18855 consensus_queue.cc:237] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.465638 18775 consensus_queue.cc:1048] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.466207 18447 catalog_manager.cc:5697] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.476158 18858 consensus_queue.cc:1048] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:43.499958 18497 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:43.502308 18898 raft_consensus.cc:493] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.502972 18898 raft_consensus.cc:515] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.505084 18898 leader_election.cc:290] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.505916 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.506153 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.506716 18625 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:43.506747 18700 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 0.
I20260709 12:17:43.508014 18514 leader_election.cc:304] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.508709 18898 raft_consensus.cc:2804] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.509017 18898 raft_consensus.cc:493] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.509305 18898 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.516113 18898 raft_consensus.cc:515] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.517906 18898 leader_election.cc:290] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.518669 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:43.518858 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.519248 18625 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.519433 18700 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.524128 18700 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:43.524770 18625 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 1.
I20260709 12:17:43.525269 18515 leader_election.cc:304] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:43.526091 18898 raft_consensus.cc:2804] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.526492 18898 raft_consensus.cc:697] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:43.527308 18898 consensus_queue.cc:237] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.535758 18449 catalog_manager.cc:5697] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 1 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.552273 18898 consensus_queue.cc:1048] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.558944 18865 raft_consensus.cc:493] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.559618 18865 raft_consensus.cc:515] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.562631 18865 leader_election.cc:290] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.564600 18898 consensus_queue.cc:1048] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.567888 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72240bde3b44156a08c8b10d933e415" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.568596 18550 raft_consensus.cc:2468] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:43.568887 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72240bde3b44156a08c8b10d933e415" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.570029 18663 leader_election.cc:304] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:43.570463 18625 raft_consensus.cc:2468] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 0.
I20260709 12:17:43.571475 18865 raft_consensus.cc:2804] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:43.573079 18865 raft_consensus.cc:493] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.573539 18865 raft_consensus.cc:3060] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.582973 18865 raft_consensus.cc:515] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.585255 18865 leader_election.cc:290] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:43.586082 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72240bde3b44156a08c8b10d933e415" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.586401 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72240bde3b44156a08c8b10d933e415" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:43.586867 18550 raft_consensus.cc:3060] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.587042 18625 raft_consensus.cc:3060] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.595062 18625 raft_consensus.cc:2468] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:43.595067 18550 raft_consensus.cc:2468] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 1.
I20260709 12:17:43.595168 18855 consensus_queue.cc:1048] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:43.596472 18663 leader_election.cc:304] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.597322 18865 raft_consensus.cc:2804] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:43.597832 18865 raft_consensus.cc:697] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.598614 18865 consensus_queue.cc:237] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.606463 18826 consensus_queue.cc:1048] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.607930 18447 catalog_manager.cc:5697] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.651855 18826 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.652344 18826 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.654146 18826 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.654924 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" is_pre_election: true
I20260709 12:17:43.655118 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.655797 18550 raft_consensus.cc:2393] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63befd92a6b34a1a9c04a83b76053861 in current term 1: Already voted for candidate 56f665fb4e784830b100a70362f53b63 in this term.
I20260709 12:17:43.656821 18589 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63
I20260709 12:17:43.657507 18826 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.662950 18826 raft_consensus.cc:2749] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.700048 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:43.700881 18700 raft_consensus.cc:606] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:43.722455 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
mode: GRACEFUL
new_leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:49960
I20260709 12:17:43.723055 18624 raft_consensus.cc:606] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Received request to transfer leadership to TS 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:43.732122 18550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:41664
I20260709 12:17:43.732756 18550 raft_consensus.cc:606] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.735038 18865 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.737138 18898 raft_consensus.cc:493] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.737905 18898 raft_consensus.cc:515] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.739698 18700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "992dae9b8a97413593e859259cd5819e"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:43.740346 18700 raft_consensus.cc:606] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.741179 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f665fb4e784830b100a70362f53b63" is_pre_election: true
I20260709 12:17:43.741425 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63befd92a6b34a1a9c04a83b76053861" is_pre_election: true
I20260709 12:17:43.742233 18625 raft_consensus.cc:2393] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bf0d63a141c4061b4cdbdbe814be85f in current term 1: Already voted for candidate 56f665fb4e784830b100a70362f53b63 in this term.
I20260709 12:17:43.743359 18898 leader_election.cc:290] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.743510 18514 leader_election.cc:304] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f; no voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.744613 18898 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:43.747010 18699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
mode: GRACEFUL
new_leader_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:55964
I20260709 12:17:43.747700 18699 raft_consensus.cc:606] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Received request to transfer leadership to TS 63befd92a6b34a1a9c04a83b76053861
I20260709 12:17:43.749055 18864 raft_consensus.cc:993] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.749531 18864 raft_consensus.cc:1081] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.751296 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:17:43.751981 18624 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.752385 18624 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.753798 18898 raft_consensus.cc:2749] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:43.758642 18864 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.760126 18624 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.762148 18625 raft_consensus.cc:1240] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Rejecting Update request from peer 56f665fb4e784830b100a70362f53b63 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:43.762785 18624 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.764493 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.765244 18699 raft_consensus.cc:3055] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.765652 18699 raft_consensus.cc:740] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.766629 18864 consensus_queue.cc:1059] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.766919 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.770246 18699 consensus_queue.cc:260] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.771584 18699 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.778260 18699 raft_consensus.cc:2468] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
W20260709 12:17:43.779212 18864 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:17:43.780650 18590 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 3bf0d63a141c4061b4cdbdbe814be85f
I20260709 12:17:43.781744 18826 raft_consensus.cc:2804] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.782039 18864 consensus_queue.cc:1048] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.782341 18826 raft_consensus.cc:697] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:43.783396 18826 consensus_queue.cc:237] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.789063 18909 raft_consensus.cc:993] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.789579 18865 raft_consensus.cc:1081] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.792259 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "992dae9b8a97413593e859259cd5819e"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:17:43.792187 18449 catalog_manager.cc:5697] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.793879 18624 raft_consensus.cc:493] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.795568 18624 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.797559 18909 consensus_queue.cc:1048] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.804934 18624 raft_consensus.cc:515] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.809103 18624 leader_election.cc:290] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.809939 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.810364 18700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992dae9b8a97413593e859259cd5819e" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.810631 18549 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.810984 18700 raft_consensus.cc:3055] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.812439 18700 raft_consensus.cc:740] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.813222 18700 consensus_queue.cc:260] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.814486 18700 raft_consensus.cc:3060] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.819929 18549 raft_consensus.cc:2468] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:43.822849 18700 raft_consensus.cc:2468] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:43.824214 18589 leader_election.cc:304] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.825368 18826 raft_consensus.cc:2804] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.825941 18826 raft_consensus.cc:697] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:43.826957 18826 consensus_queue.cc:237] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.835446 18449 catalog_manager.cc:5697] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.847008 18826 consensus_queue.cc:1048] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.853308 18748 raft_consensus.cc:993] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: : Instructing follower 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:43.853783 18748 raft_consensus.cc:1081] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Signalling peer 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:43.856843 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:17:43.857362 18550 raft_consensus.cc:493] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.858085 18550 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.860026 18856 consensus_queue.cc:1048] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.864676 18550 raft_consensus.cc:515] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.872133 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:43.872797 18624 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.881127 18624 raft_consensus.cc:2468] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:43.882274 18550 leader_election.cc:290] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.882442 18514 leader_election.cc:304] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.883510 18898 raft_consensus.cc:2804] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.883569 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d70dcf9894845c8a848351e884735f5" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.884227 18898 raft_consensus.cc:697] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:43.884290 18699 raft_consensus.cc:3055] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.884874 18699 raft_consensus.cc:740] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:43.885730 18699 consensus_queue.cc:260] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.885495 18898 consensus_queue.cc:237] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.886998 18699 raft_consensus.cc:3060] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.895044 18699 raft_consensus.cc:2468] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:43.896670 18447 catalog_manager.cc:5697] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 1 to 2, leader changed from 56f665fb4e784830b100a70362f53b63 (127.7.137.3) to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 2 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.946511 18898 consensus_queue.cc:1048] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.959568 18858 consensus_queue.cc:1048] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:43.967890 18775 raft_consensus.cc:993] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: : Instructing follower 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.968441 18858 raft_consensus.cc:1081] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Signalling peer 63befd92a6b34a1a9c04a83b76053861 to start an election
I20260709 12:17:43.970047 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:17:43.970619 18624 raft_consensus.cc:493] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.970988 18624 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.976001 18624 raft_consensus.cc:515] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.977878 18624 leader_election.cc:290] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:43.978754 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:43.979521 18550 raft_consensus.cc:3055] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.979539 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c32c1c03b440e093fd766d746a0d15" candidate_uuid: "63befd92a6b34a1a9c04a83b76053861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:43.979971 18550 raft_consensus.cc:740] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:43.980340 18699 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.980870 18550 consensus_queue.cc:260] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.982363 18550 raft_consensus.cc:3060] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.989086 18699 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:43.989899 18550 raft_consensus.cc:2468] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63befd92a6b34a1a9c04a83b76053861 in term 2.
I20260709 12:17:43.990696 18590 leader_election.cc:304] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:43.991765 18856 raft_consensus.cc:2804] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.992329 18856 raft_consensus.cc:697] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Leader. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:43.993240 18856 consensus_queue.cc:237] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:43.999975 18449 catalog_manager.cc:5697] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 reported cstate change: term changed from 1 to 2, leader changed from 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1) to 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "63befd92a6b34a1a9c04a83b76053861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.008667 18748 consensus_queue.cc:1048] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:44.018896 18865 consensus_queue.cc:1048] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:44.094592 18826 raft_consensus.cc:993] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: : Instructing follower 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:44.095177 18856 raft_consensus.cc:1081] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Signalling peer 3bf0d63a141c4061b4cdbdbe814be85f to start an election
I20260709 12:17:44.096745 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
 from {username='slave'} at 127.0.0.1:41652
I20260709 12:17:44.097196 18550 raft_consensus.cc:493] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.097478 18550 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.102130 18550 raft_consensus.cc:515] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:44.104859 18550 leader_election.cc:290] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Requested vote from peers 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497), 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227)
I20260709 12:17:44.105509 18699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f665fb4e784830b100a70362f53b63"
I20260709 12:17:44.104919 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0a163da29b439395a7c7b8940dc7a7" candidate_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:44.106081 18699 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.106170 18624 raft_consensus.cc:3055] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.106653 18624 raft_consensus.cc:740] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:44.107371 18624 consensus_queue.cc:260] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:44.108349 18624 raft_consensus.cc:3060] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.111649 18699 raft_consensus.cc:2468] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:44.112993 18515 leader_election.cc:304] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:44.113596 18624 raft_consensus.cc:2468] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bf0d63a141c4061b4cdbdbe814be85f in term 2.
I20260709 12:17:44.113746 18858 raft_consensus.cc:2804] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.114334 18858 raft_consensus.cc:697] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Leader. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:44.115073 18858 consensus_queue.cc:237] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:44.122503 18449 catalog_manager.cc:5697] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f reported cstate change: term changed from 1 to 2, leader changed from 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2) to 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1). New cstate: current_term: 2 leader_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.226382 18699 raft_consensus.cc:1275] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.227715 18856 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.237061 18550 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.244809 18550 raft_consensus.cc:1275] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.246083 18856 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.346561 18699 raft_consensus.cc:1275] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.347821 18826 consensus_queue.cc:1048] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.355388 18550 raft_consensus.cc:1275] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.357106 18919 consensus_queue.cc:1048] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.362113 18624 raft_consensus.cc:1275] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.363621 18858 consensus_queue.cc:1048] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.373346 18699 raft_consensus.cc:1275] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.374732 18920 consensus_queue.cc:1048] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.420720 18550 raft_consensus.cc:1275] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.421989 18919 consensus_queue.cc:1048] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.430536 18699 raft_consensus.cc:1275] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 63befd92a6b34a1a9c04a83b76053861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.431945 18919 consensus_queue.cc:1048] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:44.531086 18699 raft_consensus.cc:1275] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.532435 18920 consensus_queue.cc:1048] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.540835 18624 raft_consensus.cc:1275] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 3bf0d63a141c4061b4cdbdbe814be85f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:44.542549 18898 consensus_queue.cc:1048] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:46.755214 18447 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51208:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:17:46.777477 18447 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51208:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:17:46.800951  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:46.864053 18550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
mode: GRACEFUL
new_leader_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:57172
I20260709 12:17:46.864694 18550 raft_consensus.cc:606] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Received request to transfer leadership to TS 56f665fb4e784830b100a70362f53b63
I20260709 12:17:46.899299 18622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
mode: GRACEFUL
new_leader_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:49966
I20260709 12:17:46.945919 18622 raft_consensus.cc:606] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Received request to transfer leadership to TS 56f665fb4e784830b100a70362f53b63
W20260709 12:17:46.948930 18590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:33227, user_credentials={real_user=slave}} blocked reactor thread for 49857.3us
I20260709 12:17:46.949998  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:17:46.953629  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:46.965989 18974 tablet.cc:1724] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:46.942668 18973 tablet.cc:1724] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:46.973160 18589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.1:45251, user_credentials={real_user=slave}} blocked reactor thread for 45308.1us
I20260709 12:17:46.976800 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a495051fe3c2400aa217989860c2f831"
dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
mode: GRACEFUL
new_leader_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:57172
I20260709 12:17:46.977429 18549 raft_consensus.cc:606] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Received request to transfer leadership to TS 56f665fb4e784830b100a70362f53b63
I20260709 12:17:47.006415 18978 tablet.cc:1724] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:47.023976 18577 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d72240bde3b44156a08c8b10d933e415)
I20260709 12:17:47.030905 18625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212"
dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
mode: GRACEFUL
new_leader_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:49966
I20260709 12:17:47.031631 18625 raft_consensus.cc:606] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Received request to transfer leadership to TS 56f665fb4e784830b100a70362f53b63
W20260709 12:17:47.031452 18577 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d72240bde3b44156a08c8b10d933e415)
W20260709 12:17:47.041344 18577 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d72240bde3b44156a08c8b10d933e415)
I20260709 12:17:47.045928  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:47.046819  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:47.054848 18979 tablet.cc:1724] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.055932 18971 tablet.cc:1724] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.089130 18973 tablet.cc:1724] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:47.090224 18955 log.cc:927] Time spent T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Append to log took a long time: real 0.082s	user 0.000s	sys 0.005s
I20260709 12:17:47.098489 18974 tablet.cc:1724] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.117782 18985 tablet.cc:1724] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.123219 18978 tablet.cc:1724] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.183565 18983 tablet.cc:1724] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.184711 18984 tablet.cc:1724] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:47.185860 18514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.2:37497, user_credentials={real_user=slave}} blocked reactor thread for 71029.3us
I20260709 12:17:47.186558 18970 raft_consensus.cc:993] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: : Instructing follower 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.187593 18989 tablet.cc:1724] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.187081 18970 raft_consensus.cc:1081] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Signalling peer 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.195626 18698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:17:47.196213 18698 raft_consensus.cc:493] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.197418 18698 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.198530 18971 tablet.cc:1724] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.219794 18986 tablet.cc:1724] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.226172 18974 tablet.cc:1724] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.227363 18981 tablet.cc:1724] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.243829 18984 tablet.cc:1724] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.246987 18986 tablet.cc:1724] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.269793 18971 tablet.cc:1724] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.273514 18985 tablet.cc:1724] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.241137 18979 tablet.cc:1724] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.255736 18961 raft_consensus.cc:993] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: : Instructing follower 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.285995 18961 raft_consensus.cc:1081] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Signalling peer 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.290055 18983 tablet.cc:1724] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.290060 18694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:17:47.292266 18694 raft_consensus.cc:493] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.292670 18694 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.257406 18698 raft_consensus.cc:515] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
W20260709 12:17:47.255353 18515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.137.3:33227, user_credentials={real_user=slave}} blocked reactor thread for 194049us
I20260709 12:17:47.301214 18990 raft_consensus.cc:993] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: : Instructing follower 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.301669 18990 raft_consensus.cc:1081] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Signalling peer 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.304071 18698 leader_election.cc:290] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:47.305706 18551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:47.306017 18622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc81aedbe58746db9fb893ddda812212" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:47.306425 18551 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.306609 18622 raft_consensus.cc:3055] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:47.307003 18622 raft_consensus.cc:740] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:47.307950 18622 consensus_queue.cc:260] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.308961 18622 raft_consensus.cc:3060] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.313660 18695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:55956
I20260709 12:17:47.314344 18695 raft_consensus.cc:493] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.314733 18695 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.319826 18694 raft_consensus.cc:515] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.322158 18694 leader_election.cc:290] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:47.247874 18978 tablet.cc:1724] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.323181 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:47.323660 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6928d3d0cd434bfe9613ef7dd995120e" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:47.323853 18625 raft_consensus.cc:3055] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:47.276803 18973 tablet.cc:1724] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.324261 18550 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.324277 18625 raft_consensus.cc:740] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63befd92a6b34a1a9c04a83b76053861, State: Running, Role: LEADER
I20260709 12:17:47.328800 18625 consensus_queue.cc:260] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.329990 18625 raft_consensus.cc:3060] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.330334 18695 raft_consensus.cc:515] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.334106 18697 raft_consensus.cc:1240] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Rejecting Update request from peer 3bf0d63a141c4061b4cdbdbe814be85f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:47.333611 18551 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.338347 18663 leader_election.cc:304] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf0d63a141c4061b4cdbdbe814be85f, 56f665fb4e784830b100a70362f53b63; no voters: 
I20260709 12:17:47.339426 18968 raft_consensus.cc:2804] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:47.339911 18968 raft_consensus.cc:697] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:47.340195 18984 tablet.cc:1724] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.340767 18968 consensus_queue.cc:237] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.342679 18973 tablet.cc:1724] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.348081 18550 raft_consensus.cc:2468] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.348953 18990 consensus_queue.cc:1059] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:47.349449 18548 raft_consensus.cc:1240] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Rejecting Update request from peer 63befd92a6b34a1a9c04a83b76053861 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:47.350215 18990 raft_consensus.cc:3055] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:47.350564 18990 raft_consensus.cc:740] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:47.357559 18695 leader_election.cc:290] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 2 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:47.358011 18625 raft_consensus.cc:2468] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.359027 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:47.360401 18626 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.360662 18990 consensus_queue.cc:260] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.362282 18990 raft_consensus.cc:3060] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.367760 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba0ff2bf3e74fbca462f08bbb491da7" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:47.371510 18921 raft_consensus.cc:993] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: : Instructing follower 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.372501 18663 leader_election.cc:304] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:47.373163 18921 raft_consensus.cc:1081] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Signalling peer 56f665fb4e784830b100a70362f53b63 to start an election
I20260709 12:17:47.373864 18909 raft_consensus.cc:2804] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:47.376063 18695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a495051fe3c2400aa217989860c2f831"
dest_uuid: "56f665fb4e784830b100a70362f53b63"
 from {username='slave'} at 127.0.0.1:55956
I20260709 12:17:47.376716 18695 raft_consensus.cc:493] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.377076 18695 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.383162 18909 raft_consensus.cc:697] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:47.384651 18909 consensus_queue.cc:237] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.387818 18695 raft_consensus.cc:515] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.359408 18622 raft_consensus.cc:2468] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.391048 18626 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 2.
I20260709 12:17:47.391475 18695 leader_election.cc:290] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Requested vote from peers 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251), 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497)
I20260709 12:17:47.390811 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bf0d63a141c4061b4cdbdbe814be85f"
I20260709 12:17:47.392409 18663 leader_election.cc:304] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:47.392710 18550 raft_consensus.cc:3055] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:47.392760 18622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a495051fe3c2400aa217989860c2f831" candidate_uuid: "56f665fb4e784830b100a70362f53b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63befd92a6b34a1a9c04a83b76053861"
I20260709 12:17:47.393366 18968 raft_consensus.cc:2804] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:47.393639 18622 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.394088 18968 raft_consensus.cc:697] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:47.393153 18550 raft_consensus.cc:740] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bf0d63a141c4061b4cdbdbe814be85f, State: Running, Role: LEADER
I20260709 12:17:47.395908 18550 consensus_queue.cc:260] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.397257 18550 raft_consensus.cc:3060] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.402487 18622 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.406539 18663 leader_election.cc:304] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f665fb4e784830b100a70362f53b63, 63befd92a6b34a1a9c04a83b76053861; no voters: 
I20260709 12:17:47.408036 18909 raft_consensus.cc:2804] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:47.408231 18968 consensus_queue.cc:237] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.408874 18909 raft_consensus.cc:697] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Becoming Leader. State: Replica: 56f665fb4e784830b100a70362f53b63, State: Running, Role: LEADER
I20260709 12:17:47.410298 18909 consensus_queue.cc:237] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } }
I20260709 12:17:47.413865 18548 raft_consensus.cc:2468] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 2.
I20260709 12:17:47.419171 18550 raft_consensus.cc:2468] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f665fb4e784830b100a70362f53b63 in term 3.
I20260709 12:17:47.425034 18449 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a] alter complete (version 1)
I20260709 12:17:47.435964 18446 catalog_manager.cc:5697] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 2 to 3, leader changed from 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2) to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.437083 18446 catalog_manager.cc:5697] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 1 to 2, leader changed from 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1) to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.438072 18446 catalog_manager.cc:5789] TS 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227) does not have the latest schema for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (table soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]). Expected version 1 got 0
I20260709 12:17:47.438822 18446 catalog_manager.cc:5697] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 2 to 3, leader changed from 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2) to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.440451 18446 catalog_manager.cc:5697] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 reported cstate change: term changed from 2 to 3, leader changed from 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1) to 56f665fb4e784830b100a70362f53b63 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "56f665fb4e784830b100a70362f53b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f665fb4e784830b100a70362f53b63" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.806135 18550 raft_consensus.cc:1275] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.807585 18909 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.813988 18622 raft_consensus.cc:1275] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:47.815585 18968 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.820112 18550 raft_consensus.cc:1275] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:47.821794 18909 consensus_queue.cc:1048] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.845916 18622 raft_consensus.cc:1275] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.848085 18909 consensus_queue.cc:1048] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.857510 18449 catalog_manager.cc:5789] TS 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227) does not have the latest schema for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (table soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]). Expected version 1 got 0
I20260709 12:17:47.876398 18622 raft_consensus.cc:1275] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.877900 18999 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.888686 18548 raft_consensus.cc:1275] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.890192 18909 consensus_queue.cc:1048] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.891139 18548 raft_consensus.cc:1275] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:47.892567 18909 consensus_queue.cc:1048] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf0d63a141c4061b4cdbdbe814be85f" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.905916 19010 tablet.cc:1724] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:47.911540 18622 raft_consensus.cc:1275] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Refusing update from remote peer 56f665fb4e784830b100a70362f53b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:47.919999 18909 consensus_queue.cc:1048] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63befd92a6b34a1a9c04a83b76053861" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.926987 18446 catalog_manager.cc:5789] TS 56f665fb4e784830b100a70362f53b63 (127.7.137.3:33227) does not have the latest schema for tablet 4ba0ff2bf3e74fbca462f08bbb491da7 (table soft_deleted_table [id=568a51db0bc84f10869b7a4dd119977a]). Expected version 1 got 0
I20260709 12:17:47.937708 19010 tablet.cc:1719] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:17:47.944124 19011 tablet.cc:1719] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:17:47.953770 19012 tablet.cc:1719] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:17:48.047981  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:48.053133  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:48.053782  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:48.060463  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:48.060889  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:49.061884  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:49.067137  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:49.067633  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.072265  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:49.072626  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:50.073642  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:50.079882  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:50.080314  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:50.085055  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:50.085397  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:51.086357  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:51.092995  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:51.093523  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:51.098944  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:51.099416  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:52.100498  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:52.106730  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:52.107236  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.112291  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:52.112771  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:53.114373  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:53.122268  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:53.122759  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:53.129024  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:53.129455  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:54.130479  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:54.137183  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:54.137682  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:54.142834  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:54.143306  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:55.144330  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:55.150820  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:55.151350  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:55.157588  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:55.157950  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:56.158841  7716 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:17:56.163792  7716 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:17:56.164197  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:56.168851  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:56.169201  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:57.226574  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
W20260709 12:17:57.234963 18589 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:17:57.240969 18589 consensus_peers.cc:597] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.270839  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:57.271953  7716 tablet_replica.cc:333] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.273224  7716 raft_consensus.cc:2243] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.274531  7716 raft_consensus.cc:2272] T d72240bde3b44156a08c8b10d933e415 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.279186  7716 tablet_replica.cc:333] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
W20260709 12:17:57.279996 18663 consensus_peers.cc:597] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.280120  7716 raft_consensus.cc:2243] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.280905  7716 raft_consensus.cc:2272] T b8e94d88031a47dbb8f1ec318c9892ed P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.283646  7716 tablet_replica.cc:333] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.284366  7716 raft_consensus.cc:2243] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.285272  7716 raft_consensus.cc:2272] T 5f0a163da29b439395a7c7b8940dc7a7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.287854  7716 tablet_replica.cc:333] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.288522  7716 raft_consensus.cc:2243] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.289453  7716 raft_consensus.cc:2272] T 95f22ed563824b158f8935dbab92c124 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.291939  7716 tablet_replica.cc:333] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.292604  7716 raft_consensus.cc:2243] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.293133  7716 raft_consensus.cc:2272] T ebae6ed077cf4be691d08c38e1d06b5e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.295775  7716 tablet_replica.cc:333] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.296437  7716 raft_consensus.cc:2243] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.297398  7716 raft_consensus.cc:2272] T 8d70dcf9894845c8a848351e884735f5 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.299885  7716 tablet_replica.cc:333] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.300503  7716 raft_consensus.cc:2243] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.301029  7716 raft_consensus.cc:2272] T 95a63e7ccc47484fb20951934d85eb66 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.304462  7716 tablet_replica.cc:333] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
W20260709 12:17:57.304651 18589 consensus_peers.cc:597] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.305302  7716 raft_consensus.cc:2243] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.305878  7716 raft_consensus.cc:2272] T 8c86d675469a45ebaa87db83ef6a8703 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.308379  7716 tablet_replica.cc:333] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.308923  7716 raft_consensus.cc:2243] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.309471  7716 raft_consensus.cc:2272] T f6c32c1c03b440e093fd766d746a0d15 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.311801  7716 tablet_replica.cc:333] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.312325  7716 raft_consensus.cc:2243] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.312846  7716 raft_consensus.cc:2272] T 6928d3d0cd434bfe9613ef7dd995120e P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.315439  7716 tablet_replica.cc:333] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.315974  7716 raft_consensus.cc:2243] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.316859  7716 raft_consensus.cc:2272] T 68b356067f994c4f9077a2fa09aab6c1 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.319356  7716 tablet_replica.cc:333] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.319866  7716 raft_consensus.cc:2243] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.320505  7716 raft_consensus.cc:2272] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.322781  7716 tablet_replica.cc:333] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.323308  7716 raft_consensus.cc:2243] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.323770  7716 raft_consensus.cc:2272] T dc81aedbe58746db9fb893ddda812212 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.326006  7716 tablet_replica.cc:333] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.326514  7716 raft_consensus.cc:2243] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.326941  7716 raft_consensus.cc:2272] T db0e78cb133047d6b3d6de045b14e02e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.329407  7716 tablet_replica.cc:333] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.329945  7716 raft_consensus.cc:2243] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.330371  7716 raft_consensus.cc:2272] T a495051fe3c2400aa217989860c2f831 P 3bf0d63a141c4061b4cdbdbe814be85f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.332866  7716 tablet_replica.cc:333] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.333324  7716 raft_consensus.cc:2243] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.333808  7716 raft_consensus.cc:2272] T 992dae9b8a97413593e859259cd5819e P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.337203  7716 tablet_replica.cc:333] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.337867  7716 raft_consensus.cc:2243] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.338996  7716 raft_consensus.cc:2272] T 9f7a03ea4f604cbebe477e574447f541 P 3bf0d63a141c4061b4cdbdbe814be85f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.342036  7716 tablet_replica.cc:333] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f: stopping tablet replica
I20260709 12:17:57.342499  7716 raft_consensus.cc:2243] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.343356  7716 raft_consensus.cc:2272] T bf4e2820859d44a7909cd1ac19298120 P 3bf0d63a141c4061b4cdbdbe814be85f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:57.388830 18663 consensus_peers.cc:597] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.392455  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:17:57.407040 18589 consensus_peers.cc:597] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:57.425794 18663 consensus_peers.cc:597] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.446863  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:17:57.461560 18663 consensus_peers.cc:597] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 -> Peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Couldn't send request to peer 63befd92a6b34a1a9c04a83b76053861. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:57.463429 18589 consensus_peers.cc:597] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.480674  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:57.482096  7716 tablet_replica.cc:333] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.483126  7716 raft_consensus.cc:2243] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.484377  7716 raft_consensus.cc:2272] T d72240bde3b44156a08c8b10d933e415 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.487282  7716 tablet_replica.cc:333] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.487926  7716 raft_consensus.cc:2243] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.488822  7716 raft_consensus.cc:2272] T b8e94d88031a47dbb8f1ec318c9892ed P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.491109  7716 tablet_replica.cc:333] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.491797  7716 raft_consensus.cc:2243] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.492334  7716 raft_consensus.cc:2272] T 95f22ed563824b158f8935dbab92c124 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.494679  7716 tablet_replica.cc:333] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.495328  7716 raft_consensus.cc:2243] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.495875  7716 raft_consensus.cc:2272] T 5f0a163da29b439395a7c7b8940dc7a7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.498068  7716 tablet_replica.cc:333] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.498651  7716 raft_consensus.cc:2243] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.499588  7716 raft_consensus.cc:2272] T 95a63e7ccc47484fb20951934d85eb66 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.501809  7716 tablet_replica.cc:333] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.502390  7716 raft_consensus.cc:2243] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.502851  7716 raft_consensus.cc:2272] T 8c86d675469a45ebaa87db83ef6a8703 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.505023  7716 tablet_replica.cc:333] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.505570  7716 raft_consensus.cc:2243] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.506219  7716 raft_consensus.cc:2272] T 6928d3d0cd434bfe9613ef7dd995120e P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.508723  7716 tablet_replica.cc:333] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.509294  7716 raft_consensus.cc:2243] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.510082  7716 raft_consensus.cc:2272] T f6c32c1c03b440e093fd766d746a0d15 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.512792  7716 tablet_replica.cc:333] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.513501  7716 raft_consensus.cc:2243] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.514221  7716 raft_consensus.cc:2272] T 68b356067f994c4f9077a2fa09aab6c1 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:57.515645 18663 consensus_peers.cc:597] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.517329  7716 tablet_replica.cc:333] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.517956  7716 raft_consensus.cc:2243] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.518421  7716 raft_consensus.cc:2272] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.520653  7716 tablet_replica.cc:333] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.521154  7716 raft_consensus.cc:2243] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.521546  7716 raft_consensus.cc:2272] T dc81aedbe58746db9fb893ddda812212 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.523839  7716 tablet_replica.cc:333] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.524360  7716 raft_consensus.cc:2243] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.525241  7716 raft_consensus.cc:2272] T db0e78cb133047d6b3d6de045b14e02e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.527462  7716 tablet_replica.cc:333] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.527944  7716 raft_consensus.cc:2243] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.528846  7716 raft_consensus.cc:2272] T 992dae9b8a97413593e859259cd5819e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.530906  7716 tablet_replica.cc:333] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.531499  7716 raft_consensus.cc:2243] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.531975  7716 raft_consensus.cc:2272] T 9f7a03ea4f604cbebe477e574447f541 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.534789  7716 tablet_replica.cc:333] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.535477  7716 raft_consensus.cc:2243] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.536110  7716 raft_consensus.cc:2272] T bf4e2820859d44a7909cd1ac19298120 P 63befd92a6b34a1a9c04a83b76053861 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:57.536556 18663 consensus_peers.cc:597] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 -> Peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Couldn't send request to peer 63befd92a6b34a1a9c04a83b76053861. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.538456  7716 tablet_replica.cc:333] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.539098  7716 raft_consensus.cc:2243] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.539667  7716 raft_consensus.cc:2272] T 8d70dcf9894845c8a848351e884735f5 P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.541822  7716 tablet_replica.cc:333] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.542338  7716 raft_consensus.cc:2243] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.543212  7716 raft_consensus.cc:2272] T ebae6ed077cf4be691d08c38e1d06b5e P 63befd92a6b34a1a9c04a83b76053861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.545527  7716 tablet_replica.cc:333] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861: stopping tablet replica
I20260709 12:17:57.546030  7716 raft_consensus.cc:2243] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.546533  7716 raft_consensus.cc:2272] T a495051fe3c2400aa217989860c2f831 P 63befd92a6b34a1a9c04a83b76053861 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:57.552404 18663 consensus_peers.cc:597] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 -> Peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Couldn't send request to peer 63befd92a6b34a1a9c04a83b76053861. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:57.582471 18663 consensus_peers.cc:597] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 -> Peer 3bf0d63a141c4061b4cdbdbe814be85f (127.7.137.1:45251): Couldn't send request to peer 3bf0d63a141c4061b4cdbdbe814be85f. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:57.588606 18663 consensus_peers.cc:597] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 -> Peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Couldn't send request to peer 63befd92a6b34a1a9c04a83b76053861. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:37497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.591217  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
I20260709 12:17:57.630607  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
W20260709 12:17:57.662274 18663 consensus_peers.cc:597] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 -> Peer 63befd92a6b34a1a9c04a83b76053861 (127.7.137.2:37497): Couldn't send request to peer 63befd92a6b34a1a9c04a83b76053861. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:37497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:57.663618  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:57.664443  7716 tablet_replica.cc:333] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.665510  7716 raft_consensus.cc:2243] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.666181  7716 raft_consensus.cc:2272] T 5f0a163da29b439395a7c7b8940dc7a7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.668430  7716 tablet_replica.cc:333] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.669000  7716 raft_consensus.cc:2243] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.669795  7716 raft_consensus.cc:2272] T d72240bde3b44156a08c8b10d933e415 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.671969  7716 tablet_replica.cc:333] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.672482  7716 raft_consensus.cc:2243] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.672937  7716 raft_consensus.cc:2272] T b8e94d88031a47dbb8f1ec318c9892ed P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.674932  7716 tablet_replica.cc:333] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.675565  7716 raft_consensus.cc:2243] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.675987  7716 raft_consensus.cc:2272] T 95f22ed563824b158f8935dbab92c124 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.678207  7716 tablet_replica.cc:333] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.678922  7716 raft_consensus.cc:2243] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.679631  7716 raft_consensus.cc:2272] T ebae6ed077cf4be691d08c38e1d06b5e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.682195  7716 tablet_replica.cc:333] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.682770  7716 raft_consensus.cc:2243] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.683293  7716 raft_consensus.cc:2272] T 8d70dcf9894845c8a848351e884735f5 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.685366  7716 tablet_replica.cc:333] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.685896  7716 raft_consensus.cc:2243] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.686349  7716 raft_consensus.cc:2272] T 95a63e7ccc47484fb20951934d85eb66 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.688463  7716 tablet_replica.cc:333] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.689020  7716 raft_consensus.cc:2243] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.689890  7716 raft_consensus.cc:2272] T 8c86d675469a45ebaa87db83ef6a8703 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.692037  7716 tablet_replica.cc:333] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.692589  7716 raft_consensus.cc:2243] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.693053  7716 raft_consensus.cc:2272] T bf4e2820859d44a7909cd1ac19298120 P 56f665fb4e784830b100a70362f53b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.695132  7716 tablet_replica.cc:333] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.695727  7716 raft_consensus.cc:2243] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.696218  7716 raft_consensus.cc:2272] T 992dae9b8a97413593e859259cd5819e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.698261  7716 tablet_replica.cc:333] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.698771  7716 raft_consensus.cc:2243] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.699224  7716 raft_consensus.cc:2272] T 9f7a03ea4f604cbebe477e574447f541 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.701190  7716 tablet_replica.cc:333] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.701709  7716 raft_consensus.cc:2243] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.702504  7716 raft_consensus.cc:2272] T 6928d3d0cd434bfe9613ef7dd995120e P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.704492  7716 tablet_replica.cc:333] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.705039  7716 raft_consensus.cc:2243] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.705518  7716 raft_consensus.cc:2272] T f6c32c1c03b440e093fd766d746a0d15 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.707485  7716 tablet_replica.cc:333] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.708006  7716 raft_consensus.cc:2243] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.708838  7716 raft_consensus.cc:2272] T 4ba0ff2bf3e74fbca462f08bbb491da7 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.710831  7716 tablet_replica.cc:333] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.711371  7716 raft_consensus.cc:2243] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.711870  7716 raft_consensus.cc:2272] T 68b356067f994c4f9077a2fa09aab6c1 P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.713855  7716 tablet_replica.cc:333] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.714515  7716 raft_consensus.cc:2243] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.715447  7716 raft_consensus.cc:2272] T a495051fe3c2400aa217989860c2f831 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.717561  7716 tablet_replica.cc:333] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.718137  7716 raft_consensus.cc:2243] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.719007  7716 raft_consensus.cc:2272] T dc81aedbe58746db9fb893ddda812212 P 56f665fb4e784830b100a70362f53b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.721182  7716 tablet_replica.cc:333] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63: stopping tablet replica
I20260709 12:17:57.721658  7716 raft_consensus.cc:2243] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:57.722091  7716 raft_consensus.cc:2272] T db0e78cb133047d6b3d6de045b14e02e P 56f665fb4e784830b100a70362f53b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.767529  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:17:57.805902  7716 master.cc:562] Master@127.7.137.62:33869 shutting down...
I20260709 12:17:57.828462  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:57.829155  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:57.829502  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7ce3f9121b074db4a58b084d8b33a6b9: stopping tablet replica
I20260709 12:17:57.851526  7716 master.cc:584] Master@127.7.137.62:33869 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20604 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:17:57.907851  7716 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.137.62:39607
I20260709 12:17:57.909062  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:57.914589 19035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:57.915050 19036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:57.916791  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:57.916762 19038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:57.918135  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:57.918321  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:57.918437  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599477918427 us; error 0 us; skew 500 ppm
I20260709 12:17:57.918877  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:57.921241  7716 webserver.cc:533] Webserver started at http://127.7.137.62:41131/ using document root <none> and password file <none>
I20260709 12:17:57.921676  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:57.921830  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:57.922036  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:57.923125  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/master-0-root/instance:
uuid: "f7b03419a6d74b3da9ff85d26dfcab57"
format_stamp: "Formatted at 2026-07-09 12:17:57 on dist-test-slave-9kw9"
I20260709 12:17:57.927459  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:17:57.930635 19043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:57.931456  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:57.931763  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/master-0-root
uuid: "f7b03419a6d74b3da9ff85d26dfcab57"
format_stamp: "Formatted at 2026-07-09 12:17:57 on dist-test-slave-9kw9"
I20260709 12:17:57.932054  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:57.957568  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:57.958846  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:57.996958  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.62:39607
I20260709 12:17:57.997066 19094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.62:39607 every 8 connection(s)
I20260709 12:17:58.000953 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.012430 19095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: Bootstrap starting.
I20260709 12:17:58.017472 19095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.021831 19095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: No bootstrap required, opened a new log
I20260709 12:17:58.024073 19095 raft_consensus.cc:359] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER }
I20260709 12:17:58.024501 19095 raft_consensus.cc:385] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.024680 19095 raft_consensus.cc:740] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b03419a6d74b3da9ff85d26dfcab57, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.025172 19095 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER }
I20260709 12:17:58.025599 19095 raft_consensus.cc:399] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:58.025784 19095 raft_consensus.cc:493] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:58.025993 19095 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.030635 19095 raft_consensus.cc:515] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER }
I20260709 12:17:58.031105 19095 leader_election.cc:304] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7b03419a6d74b3da9ff85d26dfcab57; no voters: 
I20260709 12:17:58.032150 19095 leader_election.cc:290] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:58.032590 19098 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.034107 19098 raft_consensus.cc:697] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 1 LEADER]: Becoming Leader. State: Replica: f7b03419a6d74b3da9ff85d26dfcab57, State: Running, Role: LEADER
I20260709 12:17:58.034849 19098 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER }
I20260709 12:17:58.035300 19095 sys_catalog.cc:565] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:58.039664 19099 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER } }
I20260709 12:17:58.039870 19100 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7b03419a6d74b3da9ff85d26dfcab57. Latest consensus state: current_term: 1 leader_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7b03419a6d74b3da9ff85d26dfcab57" member_type: VOTER } }
I20260709 12:17:58.040652 19099 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:58.040830 19100 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:58.045322 19105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:58.053586 19105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:58.054602  7716 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:58.063572 19105 catalog_manager.cc:1383] Generated new cluster ID: 0f15dac799ce44a48cbdbbdcd17b9f84
I20260709 12:17:58.063896 19105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:58.079716 19105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:58.081311 19105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:58.099987 19105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: Generated new TSK 0
I20260709 12:17:58.100593 19105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:58.121513  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:58.128002 19116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:58.128935 19117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:58.130348 19119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:58.131201  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:58.132256  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:58.132437  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:58.132629  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599478132614 us; error 0 us; skew 500 ppm
I20260709 12:17:58.133193  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:58.135987  7716 webserver.cc:533] Webserver started at http://127.7.137.1:45085/ using document root <none> and password file <none>
I20260709 12:17:58.136581  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:58.136802  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:58.137151  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:58.138379  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-0-root/instance:
uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.143464  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:17:58.147224 19124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.148342  7716 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:17:58.148731  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-0-root
uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.149052  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:58.181341  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:58.182725  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:58.184348  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:58.186766  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:58.186982  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.187320  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:58.187520  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.230595  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.1:44021
I20260709 12:17:58.230697 19186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.1:44021 every 8 connection(s)
I20260709 12:17:58.236526  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:58.244827 19192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:58.244858 19191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:58.247380 19194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:58.248095  7716 server_base.cc:1061] running on GCE node
I20260709 12:17:58.249787  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:58.250090  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:58.250273  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599478250258 us; error 0 us; skew 500 ppm
I20260709 12:17:58.251157  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:58.252681 19187 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39607
I20260709 12:17:58.253094 19187 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:58.253980  7716 webserver.cc:533] Webserver started at http://127.7.137.2:34173/ using document root <none> and password file <none>
I20260709 12:17:58.254074 19187 heartbeater.cc:507] Master 127.7.137.62:39607 requested a full tablet report, sending...
I20260709 12:17:58.254794  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:58.255065  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:58.255422  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:58.256527 19060 ts_manager.cc:194] Registered new tserver with Master: 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021)
I20260709 12:17:58.256634  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-1-root/instance:
uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.258677 19060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56626
I20260709 12:17:58.261895  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:58.265632 19199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.266499  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:58.266814  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-1-root
uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.267120  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:58.289762  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:58.290993  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:58.292479  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:58.294648  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:58.294891  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.295135  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:58.295382  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:17:58.335139  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.2:35075
I20260709 12:17:58.335331 19261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.2:35075 every 8 connection(s)
I20260709 12:17:58.340173  7716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:58.347605 19265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:58.349941 19266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:58.352927  7716 server_base.cc:1061] running on GCE node
W20260709 12:17:58.353729 19268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:58.354370 19262 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39607
I20260709 12:17:58.354856 19262 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:58.354929  7716 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:58.355333  7716 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:58.355544  7716 hybrid_clock.cc:648] HybridClock initialized: now 1783599478355525 us; error 0 us; skew 500 ppm
I20260709 12:17:58.355844 19262 heartbeater.cc:507] Master 127.7.137.62:39607 requested a full tablet report, sending...
I20260709 12:17:58.356376  7716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:58.358342 19060 ts_manager.cc:194] Registered new tserver with Master: a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:58.359119  7716 webserver.cc:533] Webserver started at http://127.7.137.3:41863/ using document root <none> and password file <none>
I20260709 12:17:58.359731  7716 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:58.359928  7716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:58.359998 19060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56642
I20260709 12:17:58.360210  7716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:58.361691  7716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-2-root/instance:
uuid: "360e0328de754069889e206341ffa397"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.366348  7716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:58.369837 19273 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.370546  7716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:58.370872  7716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-2-root
uuid: "360e0328de754069889e206341ffa397"
format_stamp: "Formatted at 2026-07-09 12:17:58 on dist-test-slave-9kw9"
I20260709 12:17:58.371191  7716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJ93xIz/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599102900489-7716-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:58.395007  7716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:58.396405  7716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:58.397912  7716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:58.400151  7716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:58.400382  7716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.400627  7716 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:58.400800  7716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:58.443297  7716 rpc_server.cc:307] RPC server started. Bound to: 127.7.137.3:41763
I20260709 12:17:58.443424 19335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.137.3:41763 every 8 connection(s)
I20260709 12:17:58.457770 19336 heartbeater.cc:344] Connected to a master server at 127.7.137.62:39607
I20260709 12:17:58.458196 19336 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:58.458877 19336 heartbeater.cc:507] Master 127.7.137.62:39607 requested a full tablet report, sending...
I20260709 12:17:58.460909 19060 ts_manager.cc:194] Registered new tserver with Master: 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:58.461344  7716 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014826081s
I20260709 12:17:58.462766 19060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56648
I20260709 12:17:58.488701 19060 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56660:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:58.491483 19060 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:58.562228 19301 tablet_service.cc:1511] Processing CreateTablet for tablet fc1ac03dfc0443949fa7d4383e93c230 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:58.564589 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc1ac03dfc0443949fa7d4383e93c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.564881 19152 tablet_service.cc:1511] Processing CreateTablet for tablet fc1ac03dfc0443949fa7d4383e93c230 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:58.566267 19152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc1ac03dfc0443949fa7d4383e93c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.569612 19151 tablet_service.cc:1511] Processing CreateTablet for tablet 6bca627ec32d4b55a144bc412a9e7907 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:58.570426 19300 tablet_service.cc:1511] Processing CreateTablet for tablet 6bca627ec32d4b55a144bc412a9e7907 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:58.571792 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bca627ec32d4b55a144bc412a9e7907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.572405 19227 tablet_service.cc:1511] Processing CreateTablet for tablet fc1ac03dfc0443949fa7d4383e93c230 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:58.573851 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc1ac03dfc0443949fa7d4383e93c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.576617 19226 tablet_service.cc:1511] Processing CreateTablet for tablet 6bca627ec32d4b55a144bc412a9e7907 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:58.576910 19299 tablet_service.cc:1511] Processing CreateTablet for tablet ca82c2d8aabd4758baa81e106b56ea44 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:58.578097 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bca627ec32d4b55a144bc412a9e7907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.578298 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca82c2d8aabd4758baa81e106b56ea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.580479 19225 tablet_service.cc:1511] Processing CreateTablet for tablet ca82c2d8aabd4758baa81e106b56ea44 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:58.581997 19225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca82c2d8aabd4758baa81e106b56ea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.584656 19224 tablet_service.cc:1511] Processing CreateTablet for tablet 697005f35bbe4c4497e4a64a8009c896 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:58.586158 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697005f35bbe4c4497e4a64a8009c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.585775 19149 tablet_service.cc:1511] Processing CreateTablet for tablet 697005f35bbe4c4497e4a64a8009c896 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:58.588562 19150 tablet_service.cc:1511] Processing CreateTablet for tablet ca82c2d8aabd4758baa81e106b56ea44 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:58.589537 19298 tablet_service.cc:1511] Processing CreateTablet for tablet 697005f35bbe4c4497e4a64a8009c896 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:58.591009 19223 tablet_service.cc:1511] Processing CreateTablet for tablet 08d915011aba44e3823c5eca6135c4c7 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:58.592499 19223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d915011aba44e3823c5eca6135c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.594213 19148 tablet_service.cc:1511] Processing CreateTablet for tablet 08d915011aba44e3823c5eca6135c4c7 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:58.596803 19222 tablet_service.cc:1511] Processing CreateTablet for tablet d0c074c33dc94b60a72e086ea646de84 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:58.597359 19297 tablet_service.cc:1511] Processing CreateTablet for tablet 08d915011aba44e3823c5eca6135c4c7 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:58.598323 19222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c074c33dc94b60a72e086ea646de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.571026 19151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bca627ec32d4b55a144bc412a9e7907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.601843 19147 tablet_service.cc:1511] Processing CreateTablet for tablet d0c074c33dc94b60a72e086ea646de84 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:58.606055 19146 tablet_service.cc:1511] Processing CreateTablet for tablet e8f938bdfaa04ccd8d32b17673028053 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:58.604046 19150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca82c2d8aabd4758baa81e106b56ea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.609467 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697005f35bbe4c4497e4a64a8009c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.610054 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697005f35bbe4c4497e4a64a8009c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.609760 19296 tablet_service.cc:1511] Processing CreateTablet for tablet d0c074c33dc94b60a72e086ea646de84 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:58.610806 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d915011aba44e3823c5eca6135c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.610235 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d915011aba44e3823c5eca6135c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.615638 19146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f938bdfaa04ccd8d32b17673028053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.616281 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c074c33dc94b60a72e086ea646de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.619640 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c074c33dc94b60a72e086ea646de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.668123 19221 tablet_service.cc:1511] Processing CreateTablet for tablet e8f938bdfaa04ccd8d32b17673028053 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:58.669617 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f938bdfaa04ccd8d32b17673028053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.673827 19295 tablet_service.cc:1511] Processing CreateTablet for tablet e8f938bdfaa04ccd8d32b17673028053 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:58.675341 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f938bdfaa04ccd8d32b17673028053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.695046 19145 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4a0478ac904d41b05c5efaff72d4ea (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:58.709679 19220 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4a0478ac904d41b05c5efaff72d4ea (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:58.711167 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4a0478ac904d41b05c5efaff72d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.711721 19145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4a0478ac904d41b05c5efaff72d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.755843 19351 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:58.760289 19294 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4a0478ac904d41b05c5efaff72d4ea (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:58.761518 19352 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:58.761880 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4a0478ac904d41b05c5efaff72d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.773717 19295 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2ad12378ed4f7d9d3c9307df89eea2 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:58.785032 19147 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2ad12378ed4f7d9d3c9307df89eea2 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:58.792157 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2ad12378ed4f7d9d3c9307df89eea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.790705 19352 tablet_bootstrap.cc:654] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.792883 19353 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:58.803598 19351 tablet_bootstrap.cc:654] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.808612 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2ad12378ed4f7d9d3c9307df89eea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.808889 19221 tablet_service.cc:1511] Processing CreateTablet for tablet 5d2ad12378ed4f7d9d3c9307df89eea2 (DEFAULT_TABLE table=test-workload [id=3a622dde110b44f7881c456750a6b8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:58.810220 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d2ad12378ed4f7d9d3c9307df89eea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:58.829320 19353 tablet_bootstrap.cc:654] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.842001 19352 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:58.842696 19352 ts_tablet_manager.cc:1403] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.008s
I20260709 12:17:58.847566 19353 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:58.848238 19353 ts_tablet_manager.cc:1403] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 12:17:58.849995 19351 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:58.850679 19351 ts_tablet_manager.cc:1403] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.032s
I20260709 12:17:58.851516 19353 raft_consensus.cc:359] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.852383 19353 raft_consensus.cc:385] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.852735 19353 raft_consensus.cc:740] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.848130 19352 raft_consensus.cc:359] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.853650 19352 raft_consensus.cc:385] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.854059 19352 raft_consensus.cc:740] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.853668 19353 consensus_queue.cc:260] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.854842 19352 consensus_queue.cc:260] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.856061 19262 heartbeater.cc:499] Master 127.7.137.62:39607 was elected leader, sending a full tablet report...
I20260709 12:17:58.856616 19353 ts_tablet_manager.cc:1434] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:17:58.857645 19353 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:58.857784 19351 raft_consensus.cc:359] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:58.858497 19351 raft_consensus.cc:385] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.858841 19351 raft_consensus.cc:740] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.860375 19351 consensus_queue.cc:260] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:58.863060 19187 heartbeater.cc:499] Master 127.7.137.62:39607 was elected leader, sending a full tablet report...
I20260709 12:17:58.865059 19351 ts_tablet_manager.cc:1434] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:17:58.866065 19353 tablet_bootstrap.cc:654] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.866945 19336 heartbeater.cc:499] Master 127.7.137.62:39607 was elected leader, sending a full tablet report...
I20260709 12:17:58.867568 19352 ts_tablet_manager.cc:1434] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.006s
I20260709 12:17:58.868726 19352 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:58.881979 19351 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:58.889003 19352 tablet_bootstrap.cc:654] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.889686 19351 tablet_bootstrap.cc:654] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.892505 19353 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:58.893121 19353 ts_tablet_manager.cc:1403] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.012s
I20260709 12:17:58.897094 19353 raft_consensus.cc:359] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.897890 19353 raft_consensus.cc:385] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.898242 19353 raft_consensus.cc:740] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.898897 19351 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:58.899564 19351 ts_tablet_manager.cc:1403] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:17:58.899183 19353 consensus_queue.cc:260] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.908454 19357 raft_consensus.cc:493] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.909111 19357 raft_consensus.cc:515] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.923466 19357 leader_election.cc:290] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:58.924296 19352 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:58.925259 19352 ts_tablet_manager.cc:1403] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.000s
I20260709 12:17:58.906354 19351 raft_consensus.cc:359] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.927700 19351 raft_consensus.cc:385] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.928078 19351 raft_consensus.cc:740] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.928995 19351 consensus_queue.cc:260] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.931326 19351 ts_tablet_manager.cc:1434] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:17:58.932430 19351 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:58.932864 19352 raft_consensus.cc:359] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.933683 19352 raft_consensus.cc:385] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.933977 19352 raft_consensus.cc:740] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.934808 19352 consensus_queue.cc:260] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.937340 19353 ts_tablet_manager.cc:1434] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:17:58.940682 19352 ts_tablet_manager.cc:1434] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:58.941078 19353 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
W20260709 12:17:58.947541 19337 tablet.cc:2406] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:58.953807 19357 raft_consensus.cc:493] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.958563 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:58.959105 19357 raft_consensus.cc:515] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.947130 19352 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: Bootstrap starting.
W20260709 12:17:58.960434 19201 leader_election.cc:343] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 360e0328de754069889e206341ffa397 (127.7.137.3:41763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.961601 19357 leader_election.cc:290] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:58.948580 19353 tablet_bootstrap.cc:654] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.964534 19358 raft_consensus.cc:493] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.965220 19358 raft_consensus.cc:515] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:58.966845 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
W20260709 12:17:58.968993 19201 leader_election.cc:343] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 360e0328de754069889e206341ffa397 (127.7.137.3:41763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.972132 19358 leader_election.cc:290] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:58.990124 19351 tablet_bootstrap.cc:654] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.996017 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:58.998286 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
W20260709 12:17:59.001042 19200 leader_election.cc:343] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.001736 19200 leader_election.cc:304] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.003479 19357 raft_consensus.cc:2749] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:59.004959 19200 leader_election.cc:343] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.005836 19200 leader_election.cc:304] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.007062 19357 raft_consensus.cc:2749] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:59.008433 19352 tablet_bootstrap.cc:654] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.014726 19353 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.015447 19353 ts_tablet_manager.cc:1403] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.076s	user 0.036s	sys 0.026s
I20260709 12:17:59.021606 19351 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.022351 19353 raft_consensus.cc:359] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.022382 19351 ts_tablet_manager.cc:1403] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.010s
I20260709 12:17:59.023367 19352 tablet_bootstrap.cc:492] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.023738 19353 raft_consensus.cc:385] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.024199 19352 ts_tablet_manager.cc:1403] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.014s
I20260709 12:17:59.024400 19353 raft_consensus.cc:740] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.025817 19353 consensus_queue.cc:260] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.026760 19351 raft_consensus.cc:359] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.027565 19352 raft_consensus.cc:359] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.030754 19351 raft_consensus.cc:385] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.030102 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.031299 19351 raft_consensus.cc:740] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.031567 19161 raft_consensus.cc:2468] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.032238 19351 consensus_queue.cc:260] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.033409 19274 leader_election.cc:304] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.030892 19352 raft_consensus.cc:385] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.034642 19358 raft_consensus.cc:2804] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.034682 19352 raft_consensus.cc:740] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.035147 19358 raft_consensus.cc:493] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.030191 19353 ts_tablet_manager.cc:1434] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:17:59.035646 19358 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.036811 19353 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.038321 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.039592 19352 consensus_queue.cc:260] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
W20260709 12:17:59.040004 19274 leader_election.cc:343] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.041837 19351 ts_tablet_manager.cc:1434] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:17:59.043094 19351 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.044678 19353 tablet_bootstrap.cc:654] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:59.049026 19108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:59.064702 19352 ts_tablet_manager.cc:1434] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 12:17:59.066771 19351 tablet_bootstrap.cc:654] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.067394 19353 tablet_bootstrap.cc:492] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.068033 19353 ts_tablet_manager.cc:1403] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 12:17:59.068324 19352 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.068463 19358 raft_consensus.cc:515] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.073038 19353 raft_consensus.cc:359] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.075315 19353 raft_consensus.cc:385] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.075821 19353 raft_consensus.cc:740] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.076274 19352 tablet_bootstrap.cc:654] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.077118 19353 consensus_queue.cc:260] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.080709 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.081377 19161 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.082406 19353 ts_tablet_manager.cc:1434] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 12:17:59.083690 19353 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.087743 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.088476 19237 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.091742 19353 tablet_bootstrap.cc:654] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.097781 19161 raft_consensus.cc:2468] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.098665 19358 leader_election.cc:290] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.100001 19274 leader_election.cc:304] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.102407 19371 raft_consensus.cc:2804] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.115375 19237 raft_consensus.cc:2468] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.117223 19371 raft_consensus.cc:697] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.119083 19371 consensus_queue.cc:237] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.136623 19352 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.137271 19352 ts_tablet_manager.cc:1403] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.031s
I20260709 12:17:59.140712 19359 raft_consensus.cc:493] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.140707 19352 raft_consensus.cc:359] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.141821 19352 raft_consensus.cc:385] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.141530 19359 raft_consensus.cc:515] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.142179 19352 raft_consensus.cc:740] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.143103 19352 consensus_queue.cc:260] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.145262 19352 ts_tablet_manager.cc:1434] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:59.146410 19352 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.145653 19060 catalog_manager.cc:5697] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.151435 19359 leader_election.cc:290] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.151908 19353 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.152556 19353 ts_tablet_manager.cc:1403] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.030s
I20260709 12:17:59.153596 19371 raft_consensus.cc:493] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.154157 19371 raft_consensus.cc:515] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.154462 19351 tablet_bootstrap.cc:492] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.155144 19351 ts_tablet_manager.cc:1403] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.019s
I20260709 12:17:59.155416 19352 tablet_bootstrap.cc:654] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.156495 19371 leader_election.cc:290] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.156409 19353 raft_consensus.cc:359] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.157382 19353 raft_consensus.cc:385] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.157721 19353 raft_consensus.cc:740] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.158459 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.158838 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.159781 19237 raft_consensus.cc:2468] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.161679 19274 leader_election.cc:304] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.161936 19351 raft_consensus.cc:359] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
W20260709 12:17:59.162950 19274 leader_election.cc:343] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.163138 19351 raft_consensus.cc:385] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.164830 19351 raft_consensus.cc:740] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.164966 19371 raft_consensus.cc:2804] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.165457 19371 raft_consensus.cc:493] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.165876 19371 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.158519 19353 consensus_queue.cc:260] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.168331 19353 ts_tablet_manager.cc:1434] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:17:59.169603 19353 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.170122 19351 consensus_queue.cc:260] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.174181 19351 ts_tablet_manager.cc:1434] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:17:59.175544 19351 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.178350 19353 tablet_bootstrap.cc:654] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.182371 19351 tablet_bootstrap.cc:654] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.183686 19376 raft_consensus.cc:493] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.184427 19376 raft_consensus.cc:515] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.186676 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.187681 19311 raft_consensus.cc:2468] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:17:59.190555 19126 leader_election.cc:304] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.191558 19359 raft_consensus.cc:2804] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.191943 19359 raft_consensus.cc:493] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.192279 19359 raft_consensus.cc:3060] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.192646 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.193462 19161 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.199862 19274 leader_election.cc:304] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.199909 19376 leader_election.cc:290] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.202129 19358 raft_consensus.cc:2804] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.202674 19358 raft_consensus.cc:493] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.203135 19358 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.209172 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.210276 19237 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.213919 19359 raft_consensus.cc:515] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.218763 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.219699 19311 raft_consensus.cc:3060] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.224570 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.225564 19236 raft_consensus.cc:3060] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.229944 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca82c2d8aabd4758baa81e106b56ea44" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.209944 19371 raft_consensus.cc:515] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.233793 19352 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.234419 19352 ts_tablet_manager.cc:1403] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.004s
I20260709 12:17:59.235520 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
W20260709 12:17:59.237381 19274 leader_election.cc:343] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.237644 19352 raft_consensus.cc:359] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.238466 19352 raft_consensus.cc:385] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.238751 19352 raft_consensus.cc:740] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.239596 19371 leader_election.cc:290] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.230525 19358 raft_consensus.cc:515] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.240670 19352 consensus_queue.cc:260] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.243142 19352 ts_tablet_manager.cc:1434] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:59.243675 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.244410 19161 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.245179 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.245266 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.245819 19237 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.246027 19235 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.252384 19351 tablet_bootstrap.cc:492] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.253095 19351 ts_tablet_manager.cc:1403] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.028s
I20260709 12:17:59.244351 19352 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.257786 19311 raft_consensus.cc:2468] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:17:59.258864 19359 leader_election.cc:290] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.259055 19357 raft_consensus.cc:493] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.266455 19352 tablet_bootstrap.cc:654] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.266129 19357 raft_consensus.cc:515] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.268563 19357 leader_election.cc:290] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.268913 19237 raft_consensus.cc:2468] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.259536 19358 leader_election.cc:290] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.259423 19126 leader_election.cc:304] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.270262 19274 leader_election.cc:304] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.271377 19371 raft_consensus.cc:2804] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.270162 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.271876 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.272327 19359 raft_consensus.cc:2804] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.273613 19352 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
W20260709 12:17:59.273660 19200 leader_election.cc:343] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.274452 19352 ts_tablet_manager.cc:1403] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.009s
W20260709 12:17:59.274515 19201 leader_election.cc:343] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 360e0328de754069889e206341ffa397 (127.7.137.3:41763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.258381 19235 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.260488 19161 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.271890 19371 raft_consensus.cc:697] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.275032 19201 leader_election.cc:304] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.276479 19357 raft_consensus.cc:2749] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:59.276201 19371 consensus_queue.cc:237] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.277967 19274 leader_election.cc:304] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.278676 19352 raft_consensus.cc:359] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.262238 19351 raft_consensus.cc:359] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.279551 19351 raft_consensus.cc:385] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.279553 19358 raft_consensus.cc:2804] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.279984 19351 raft_consensus.cc:740] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.280397 19358 raft_consensus.cc:697] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.280913 19351 consensus_queue.cc:260] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.282480 19359 raft_consensus.cc:697] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:17:59.263443 19236 raft_consensus.cc:2468] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:17:59.260980 19353 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.283669 19359 consensus_queue.cc:237] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.284497 19387 raft_consensus.cc:493] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.285228 19353 ts_tablet_manager.cc:1403] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.019s
I20260709 12:17:59.286160 19352 raft_consensus.cc:385] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.287201 19352 raft_consensus.cc:740] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.281467 19358 consensus_queue.cc:237] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.289410 19352 consensus_queue.cc:260] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.290325 19353 raft_consensus.cc:359] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.291977 19353 raft_consensus.cc:385] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.292207 19352 ts_tablet_manager.cc:1434] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:59.297322 19352 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.293272 19387 raft_consensus.cc:515] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.300647 19351 ts_tablet_manager.cc:1434] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.005s
I20260709 12:17:59.301942 19351 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.292512 19353 raft_consensus.cc:740] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.308089 19387 leader_election.cc:290] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360e0328de754069889e206341ffa397 (127.7.137.3:41763), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.309872 19352 tablet_bootstrap.cc:654] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.308926 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.311724 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.313228 19311 raft_consensus.cc:2468] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:17:59.313143 19353 consensus_queue.cc:260] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.314498 19060 catalog_manager.cc:5697] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.316372 19351 tablet_bootstrap.cc:654] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:59.311913 19125 leader_election.cc:343] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.319479 19126 leader_election.cc:304] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.320953 19390 raft_consensus.cc:2804] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.321509 19390 raft_consensus.cc:493] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.320668 19058 catalog_manager.cc:5697] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.321961 19390 raft_consensus.cc:3060] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.326704 19353 ts_tablet_manager.cc:1434] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 12:17:59.332964 19390 raft_consensus.cc:515] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.337186 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.337996 19311 raft_consensus.cc:3060] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.344731 19060 catalog_manager.cc:5697] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.348443 19353 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.351850 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
W20260709 12:17:59.353935 19125 leader_election.cc:343] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:59.355399 19390 leader_election.cc:290] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers 360e0328de754069889e206341ffa397 (127.7.137.3:41763), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.349651 19311 raft_consensus.cc:2468] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:17:59.357118 19126 leader_election.cc:304] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.357553 19352 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.358204 19352 ts_tablet_manager.cc:1403] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.016s
I20260709 12:17:59.358368 19390 raft_consensus.cc:2804] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.358999 19390 raft_consensus.cc:697] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:17:59.359977 19390 consensus_queue.cc:237] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.361362 19352 raft_consensus.cc:359] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.361838 19351 tablet_bootstrap.cc:492] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.362037 19352 raft_consensus.cc:385] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.362488 19352 raft_consensus.cc:740] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.362581 19351 ts_tablet_manager.cc:1403] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.007s
I20260709 12:17:59.363385 19352 consensus_queue.cc:260] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.364751 19353 tablet_bootstrap.cc:654] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.367293 19351 raft_consensus.cc:359] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.368664 19351 raft_consensus.cc:385] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.369163 19351 raft_consensus.cc:740] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.370577 19351 consensus_queue.cc:260] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.374564 19351 ts_tablet_manager.cc:1434] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:17:59.377930 19352 ts_tablet_manager.cc:1434] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:17:59.378948 19351 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.381834 19060 catalog_manager.cc:5697] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.386130 19353 tablet_bootstrap.cc:492] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.386729 19353 ts_tablet_manager.cc:1403] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.015s
I20260709 12:17:59.388065 19352 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.390282 19351 tablet_bootstrap.cc:654] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.389918 19353 raft_consensus.cc:359] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.391341 19353 raft_consensus.cc:385] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.391726 19353 raft_consensus.cc:740] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.392789 19353 consensus_queue.cc:260] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.395843 19352 tablet_bootstrap.cc:654] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.404667 19353 ts_tablet_manager.cc:1434] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:17:59.407784 19352 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.408329 19353 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.408438 19352 ts_tablet_manager.cc:1403] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:17:59.411724 19352 raft_consensus.cc:359] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.412461 19352 raft_consensus.cc:385] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.412781 19352 raft_consensus.cc:740] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.413443 19352 consensus_queue.cc:260] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.417234 19352 ts_tablet_manager.cc:1434] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:59.418332 19352 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:17:59.419082 19353 tablet_bootstrap.cc:654] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.422464 19351 tablet_bootstrap.cc:492] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.423225 19351 ts_tablet_manager.cc:1403] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.024s
I20260709 12:17:59.426878 19352 tablet_bootstrap.cc:654] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.428074 19351 raft_consensus.cc:359] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.429272 19351 raft_consensus.cc:385] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.429725 19351 raft_consensus.cc:740] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.430701 19351 consensus_queue.cc:260] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.431890 19353 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.432317 19352 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:17:59.432457 19353 ts_tablet_manager.cc:1403] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 12:17:59.432847 19352 ts_tablet_manager.cc:1403] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:17:59.433300 19351 ts_tablet_manager.cc:1434] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:59.434620 19351 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.435549 19352 raft_consensus.cc:359] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.436355 19352 raft_consensus.cc:385] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.435941 19353 raft_consensus.cc:359] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.436720 19352 raft_consensus.cc:740] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.436909 19353 raft_consensus.cc:385] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.437352 19353 raft_consensus.cc:740] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.437613 19352 consensus_queue.cc:260] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.438164 19353 consensus_queue.cc:260] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.440137 19352 ts_tablet_manager.cc:1434] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:59.442335 19353 ts_tablet_manager.cc:1434] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:59.442541 19351 tablet_bootstrap.cc:654] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.443930 19353 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:17:59.452778 19353 tablet_bootstrap.cc:654] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.460237 19358 raft_consensus.cc:493] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.461166 19358 raft_consensus.cc:515] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.465919 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.466671 19161 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.467108 19358 leader_election.cc:290] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.467779 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.470049 19236 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.467923 19274 leader_election.cc:304] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.471869 19358 raft_consensus.cc:2804] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.472301 19358 raft_consensus.cc:493] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.472877 19358 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.486153 19358 raft_consensus.cc:515] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.489053 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.489671 19161 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.489835 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.490463 19236 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.498364 19236 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.499626 19274 leader_election.cc:304] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.500857 19371 raft_consensus.cc:2804] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.501444 19371 raft_consensus.cc:697] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.500339 19390 raft_consensus.cc:493] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.502386 19371 consensus_queue.cc:237] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.502852 19390 raft_consensus.cc:515] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.503283 19353 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:17:59.503829 19353 ts_tablet_manager.cc:1403] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.060s	user 0.031s	sys 0.021s
I20260709 12:17:59.504133 19351 tablet_bootstrap.cc:492] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.504663 19351 ts_tablet_manager.cc:1403] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.070s	user 0.051s	sys 0.013s
I20260709 12:17:59.505038 19390 leader_election.cc:290] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.506263 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.506950 19311 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:17:59.507167 19353 raft_consensus.cc:359] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.508859 19353 raft_consensus.cc:385] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.508481 19126 leader_election.cc:304] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.509141 19353 raft_consensus.cc:740] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.509902 19353 consensus_queue.cc:260] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.508141 19351 raft_consensus.cc:359] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.511132 19351 raft_consensus.cc:385] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.511474 19351 raft_consensus.cc:740] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.511502 19390 raft_consensus.cc:2804] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.512017 19390 raft_consensus.cc:493] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.512235 19353 ts_tablet_manager.cc:1434] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:17:59.512300 19351 consensus_queue.cc:260] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.514254 19351 ts_tablet_manager.cc:1434] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:17:59.515080 19351 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:17:59.508126 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.516878 19236 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:17:59.512395 19390 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.522778 19351 tablet_bootstrap.cc:654] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:59.524290 19161 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.500417 19358 leader_election.cc:290] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.528277 19357 raft_consensus.cc:493] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.528481 19390 raft_consensus.cc:515] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.529085 19357 raft_consensus.cc:515] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } } peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } }
I20260709 12:17:59.531229 19390 leader_election.cc:290] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.532740 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.533432 19311 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.534258 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.534808 19357 leader_election.cc:290] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360e0328de754069889e206341ffa397 (127.7.137.3:41763), 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021)
I20260709 12:17:59.534920 19236 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.534260 19351 tablet_bootstrap.cc:492] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:17:59.536082 19351 ts_tablet_manager.cc:1403] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:17:59.535269 19059 catalog_manager.cc:5697] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.537972 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.538864 19310 raft_consensus.cc:2393] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in current term 1: Already voted for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in this term.
I20260709 12:17:59.539028 19351 raft_consensus.cc:359] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.539762 19351 raft_consensus.cc:385] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:59.540006 19351 raft_consensus.cc:740] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:17:59.540658 19351 consensus_queue.cc:260] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.542994 19351 ts_tablet_manager.cc:1434] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:17:59.543351 19236 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:17:59.544039 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc1ac03dfc0443949fa7d4383e93c230" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.544904 19125 leader_election.cc:304] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.545648 19200 leader_election.cc:304] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.545879 19390 raft_consensus.cc:2804] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.546880 19357 raft_consensus.cc:3060] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.547009 19390 raft_consensus.cc:697] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:17:59.548205 19390 consensus_queue.cc:237] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.549198 19311 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:17:59.555181 19357 raft_consensus.cc:2749] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:59.556322 19358 raft_consensus.cc:493] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.556880 19358 raft_consensus.cc:515] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.557313 19059 catalog_manager.cc:5697] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.559062 19358 leader_election.cc:290] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.559957 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.560524 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:17:59.560895 19161 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.561167 19236 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:17:59.562141 19274 leader_election.cc:304] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:17:59.563009 19358 raft_consensus.cc:2804] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.563403 19358 raft_consensus.cc:493] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.563736 19358 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.569908 19358 raft_consensus.cc:515] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.571558 19358 leader_election.cc:290] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:17:59.572301 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.572463 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.573038 19161 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.573050 19236 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.578308 19236 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.578583 19161 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:17:59.579383 19274 leader_election.cc:304] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.580113 19358 raft_consensus.cc:2804] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.580526 19358 raft_consensus.cc:697] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.581360 19358 consensus_queue.cc:237] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.588343 19059 catalog_manager.cc:5697] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:59.603482 19357 raft_consensus.cc:493] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.604069 19357 raft_consensus.cc:515] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.605716 19357 leader_election.cc:290] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.606639 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:17:59.606812 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:17:59.607331 19161 raft_consensus.cc:2468] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:17:59.607496 19311 raft_consensus.cc:2468] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:17:59.608422 19200 leader_election.cc:304] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.609221 19357 raft_consensus.cc:2804] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:59.609579 19357 raft_consensus.cc:493] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.609877 19357 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.614974 19357 raft_consensus.cc:515] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.616864 19357 leader_election.cc:290] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.617658 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.617913 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.618264 19161 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.618542 19311 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.623668 19311 raft_consensus.cc:2468] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:17:59.623708 19161 raft_consensus.cc:2468] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:17:59.624835 19201 leader_election.cc:304] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.625663 19357 raft_consensus.cc:2804] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:59.626595 19357 raft_consensus.cc:697] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:17:59.627450 19357 consensus_queue.cc:237] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.635481 19059 catalog_manager.cc:5697] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.656423 19358 consensus_queue.cc:1048] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.668290 19376 consensus_queue.cc:1048] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.675623 19371 consensus_queue.cc:1048] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.686434 19161 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:59.696570 19358 consensus_queue.cc:1048] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.715436 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:17:59.716102 19311 raft_consensus.cc:606] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:17:59.727732 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:17:59.728322 19311 raft_consensus.cc:606] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.733422 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:17:59.734079 19311 raft_consensus.cc:606] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.739796 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:17:59.740379 19311 raft_consensus.cc:606] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.746155 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:17:59.746826 19311 raft_consensus.cc:606] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:17:59.751925 19390 consensus_queue.cc:1048] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.752885 19358 consensus_queue.cc:1048] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.753983 19390 consensus_queue.cc:1048] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.782760 19236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
mode: GRACEFUL
new_leader_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:39314
I20260709 12:17:59.783393 19236 raft_consensus.cc:606] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Received request to transfer leadership to TS 360e0328de754069889e206341ffa397
I20260709 12:17:59.790066 19376 consensus_queue.cc:1048] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.801115 19371 raft_consensus.cc:993] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: : Instructing follower 7a3afa7d9eb44f06801d5c5d3299d423 to start an election
I20260709 12:17:59.801630 19358 raft_consensus.cc:1081] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer 7a3afa7d9eb44f06801d5c5d3299d423 to start an election
I20260709 12:17:59.803442 19161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907"
dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
 from {username='slave'} at 127.0.0.1:42468
I20260709 12:17:59.804046 19161 raft_consensus.cc:493] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.804383 19161 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.811184 19390 consensus_queue.cc:1048] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:59.816864 19161 raft_consensus.cc:515] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.821516 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:17:59.822142 19235 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.822995 19161 leader_election.cc:290] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 2 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.829648 19387 consensus_queue.cc:1048] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.830008 19235 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 2.
I20260709 12:17:59.831780 19125 leader_election.cc:304] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.833132 19359 raft_consensus.cc:2804] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:59.833638 19359 raft_consensus.cc:697] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:17:59.836613 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bca627ec32d4b55a144bc412a9e7907" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.837423 19311 raft_consensus.cc:3055] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.837777 19311 raft_consensus.cc:740] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.834599 19359 consensus_queue.cc:237] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.838632 19311 consensus_queue.cc:260] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.843807 19311 raft_consensus.cc:3060] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.846733 19060 catalog_manager.cc:5697] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:59.851670 19311 raft_consensus.cc:2468] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 2.
I20260709 12:17:59.896341 19376 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.903050 19358 raft_consensus.cc:993] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: : Instructing follower a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:17:59.903613 19371 raft_consensus.cc:1081] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:17:59.906379 19236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:39298
I20260709 12:17:59.908242 19236 raft_consensus.cc:493] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.908545 19371 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:59.910108 19236 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.918125 19236 raft_consensus.cc:515] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.923058 19236 leader_election.cc:290] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:17:59.923880 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:17:59.924239 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:17:59.924537 19161 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.924953 19311 raft_consensus.cc:3055] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.925321 19311 raft_consensus.cc:740] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:17:59.926126 19311 consensus_queue.cc:260] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.927546 19311 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.931218 19161 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:17:59.932806 19200 leader_election.cc:304] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:17:59.933578 19357 raft_consensus.cc:2804] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:59.933995 19357 raft_consensus.cc:697] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:17:59.934217 19311 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:17:59.934968 19357 consensus_queue.cc:237] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:17:59.942055 19060 catalog_manager.cc:5697] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.019846 19359 consensus_queue.cc:1048] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:00.030934 19390 consensus_queue.cc:1048] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:00.092151 19357 consensus_queue.cc:1048] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:00.094923 19358 consensus_queue.cc:1048] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:00.100972 19407 raft_consensus.cc:993] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: : Instructing follower 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:00.107810 19357 raft_consensus.cc:1081] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Signalling peer 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:00.110256 19310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2"
dest_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:18:00.115762 19310 raft_consensus.cc:493] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.116230 19310 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.119977 19357 consensus_queue.cc:1048] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:00.120287 19358 consensus_queue.cc:1048] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:00.124902 19310 raft_consensus.cc:515] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.131611 19310 leader_election.cc:290] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:00.133710 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:00.136471 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d2ad12378ed4f7d9d3c9307df89eea2" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:00.137362 19235 raft_consensus.cc:3055] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.137742 19235 raft_consensus.cc:740] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:00.138805 19371 raft_consensus.cc:993] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: : Instructing follower a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.139451 19371 raft_consensus.cc:993] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: : Instructing follower a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.139973 19371 raft_consensus.cc:1081] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.140910 19371 raft_consensus.cc:1081] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.140700 19235 consensus_queue.cc:260] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.142452 19235 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.144626 19371 raft_consensus.cc:993] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: : Instructing follower a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.145237 19376 raft_consensus.cc:1081] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:00.145237 19237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:39298
I20260709 12:18:00.146370 19237 raft_consensus.cc:493] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.146808 19237 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.147224 19236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:39298
I20260709 12:18:00.147482 19234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:39298
I20260709 12:18:00.148087 19236 raft_consensus.cc:493] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.148272 19234 raft_consensus.cc:493] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.148558 19236 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.148841 19234 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.161213 19236 raft_consensus.cc:515] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.161403 19235 raft_consensus.cc:2468] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 2.
I20260709 12:18:00.162957 19274 leader_election.cc:304] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:18:00.164417 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:00.165191 19161 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.164583 19434 raft_consensus.cc:2804] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.165274 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c074c33dc94b60a72e086ea646de84" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:00.166009 19434 raft_consensus.cc:697] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 2 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:00.166047 19310 raft_consensus.cc:3055] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.166599 19310 raft_consensus.cc:740] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:00.167090 19434 consensus_queue.cc:237] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.167560 19310 consensus_queue.cc:260] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.168779 19310 raft_consensus.cc:3060] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.164885 19234 raft_consensus.cc:515] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.166436 19236 leader_election.cc:290] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:00.171904 19237 raft_consensus.cc:515] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.174440 19234 leader_election.cc:290] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:00.175540 19237 leader_election.cc:290] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:00.175771 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:00.176370 19311 raft_consensus.cc:3055] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.176708 19311 raft_consensus.cc:740] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:00.177520 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4a0478ac904d41b05c5efaff72d4ea" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:00.178237 19162 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.178547 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:00.179255 19309 raft_consensus.cc:3055] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.179564 19309 raft_consensus.cc:740] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:00.179796 19160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f938bdfaa04ccd8d32b17673028053" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:00.180382 19309 consensus_queue.cc:260] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.180739 19310 raft_consensus.cc:2468] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.180624 19161 raft_consensus.cc:2468] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.181823 19309 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.180508 19160 raft_consensus.cc:3060] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.182276 19201 leader_election.cc:304] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:00.183336 19357 raft_consensus.cc:2804] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.183864 19357 raft_consensus.cc:697] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:00.177541 19311 consensus_queue.cc:260] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.184749 19357 consensus_queue.cc:237] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.185137 19311 raft_consensus.cc:3060] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.191123 19160 raft_consensus.cc:2468] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.192986 19311 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.194201 19200 leader_election.cc:304] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:00.194943 19201 leader_election.cc:304] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:00.195204 19357 raft_consensus.cc:2804] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.194258 19059 catalog_manager.cc:5697] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 1 to 2, leader changed from a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2) to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.195940 19407 raft_consensus.cc:2804] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.196115 19357 raft_consensus.cc:697] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:00.195080 19057 catalog_manager.cc:5697] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.196547 19407 raft_consensus.cc:697] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:00.197300 19357 consensus_queue.cc:237] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.197439 19407 consensus_queue.cc:237] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:00.203589 19309 raft_consensus.cc:2468] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.199360 19162 raft_consensus.cc:2468] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:00.215701 19057 catalog_manager.cc:5697] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.217337 19057 catalog_manager.cc:5697] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.288556 19237 raft_consensus.cc:1275] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Refusing update from remote peer 7a3afa7d9eb44f06801d5c5d3299d423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.289965 19359 consensus_queue.cc:1048] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.297791 19309 raft_consensus.cc:1275] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer 7a3afa7d9eb44f06801d5c5d3299d423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.299664 19359 consensus_queue.cc:1048] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.329469 19309 raft_consensus.cc:1275] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.330919 19357 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.339097 19162 raft_consensus.cc:1275] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.341681 19431 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:00.621461 19162 raft_consensus.cc:1275] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.622954 19431 consensus_queue.cc:1048] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.630882 19309 raft_consensus.cc:1275] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.632527 19357 consensus_queue.cc:1048] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.640852 19162 raft_consensus.cc:1275] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.642306 19357 consensus_queue.cc:1048] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.651849 19309 raft_consensus.cc:1275] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.653419 19357 consensus_queue.cc:1048] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.679730 19162 raft_consensus.cc:1275] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.681435 19357 consensus_queue.cc:1048] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.692028 19309 raft_consensus.cc:1275] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.693677 19237 raft_consensus.cc:1275] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.693940 19431 consensus_queue.cc:1048] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.695776 19434 consensus_queue.cc:1048] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.714445 19162 raft_consensus.cc:3060] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.721477 19162 raft_consensus.cc:1275] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:00.722920 19436 consensus_queue.cc:1048] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.818222 19057 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38138:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:02.821463 19057 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:18:02.875774 19258 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 12:18:02.937700 19145 tablet_service.cc:1511] Processing CreateTablet for tablet 3aee744c19e4440f89009e6e9af9a35e (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:02.940363 19145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aee744c19e4440f89009e6e9af9a35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.939888 19221 tablet_service.cc:1511] Processing CreateTablet for tablet 3aee744c19e4440f89009e6e9af9a35e (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:02.942269 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aee744c19e4440f89009e6e9af9a35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.941866 19295 tablet_service.cc:1511] Processing CreateTablet for tablet 3aee744c19e4440f89009e6e9af9a35e (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:02.943032 19147 tablet_service.cc:1511] Processing CreateTablet for tablet 543dc117e59043b2a3e718e66c3ce01b (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:02.944289 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aee744c19e4440f89009e6e9af9a35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.944752 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543dc117e59043b2a3e718e66c3ce01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.958657 19148 tablet_service.cc:1511] Processing CreateTablet for tablet 32c5952f25a94ec68d3e36b8ac9c5f28 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:02.960887 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c5952f25a94ec68d3e36b8ac9c5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.960683 19220 tablet_service.cc:1511] Processing CreateTablet for tablet 543dc117e59043b2a3e718e66c3ce01b (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:02.962371 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543dc117e59043b2a3e718e66c3ce01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.966532 19294 tablet_service.cc:1511] Processing CreateTablet for tablet 543dc117e59043b2a3e718e66c3ce01b (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:02.968175 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543dc117e59043b2a3e718e66c3ce01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:02.987190 19227 tablet_service.cc:1511] Processing CreateTablet for tablet 32c5952f25a94ec68d3e36b8ac9c5f28 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:02.988987 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c5952f25a94ec68d3e36b8ac9c5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.001842 19454 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.004201 19298 tablet_service.cc:1511] Processing CreateTablet for tablet 32c5952f25a94ec68d3e36b8ac9c5f28 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:03.006486 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c5952f25a94ec68d3e36b8ac9c5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.012071 19454 tablet_bootstrap.cc:654] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.012118 19149 tablet_service.cc:1511] Processing CreateTablet for tablet d88b024c87074ab69a2a40fb01cd4325 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:03.013888 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88b024c87074ab69a2a40fb01cd4325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.024416 19453 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.029458 19223 tablet_service.cc:1511] Processing CreateTablet for tablet d88b024c87074ab69a2a40fb01cd4325 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:03.031940 19223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88b024c87074ab69a2a40fb01cd4325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.055482 19453 tablet_bootstrap.cc:654] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.060418 19454 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.060972 19454 ts_tablet_manager.cc:1403] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.018s
I20260709 12:18:03.062295 19295 tablet_service.cc:1511] Processing CreateTablet for tablet d88b024c87074ab69a2a40fb01cd4325 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:03.063772 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88b024c87074ab69a2a40fb01cd4325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.064404 19454 raft_consensus.cc:359] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.065559 19454 raft_consensus.cc:385] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.065882 19454 raft_consensus.cc:740] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.066711 19454 consensus_queue.cc:260] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.089247 19149 tablet_service.cc:1511] Processing CreateTablet for tablet ea1d21a425484f44851d87ca892c3ee9 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:03.090659 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1d21a425484f44851d87ca892c3ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.091172 19226 tablet_service.cc:1511] Processing CreateTablet for tablet ea1d21a425484f44851d87ca892c3ee9 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:03.092613 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1d21a425484f44851d87ca892c3ee9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:03.094832 19108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:03.100898 19294 tablet_service.cc:1511] Processing CreateTablet for tablet ea1d21a425484f44851d87ca892c3ee9 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:03.102519 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1d21a425484f44851d87ca892c3ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.108654 19147 tablet_service.cc:1511] Processing CreateTablet for tablet 61bb753f843f42fd92890f4780b85a15 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:03.110138 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bb753f843f42fd92890f4780b85a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.125152 19298 tablet_service.cc:1511] Processing CreateTablet for tablet 61bb753f843f42fd92890f4780b85a15 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:03.137676 19148 tablet_service.cc:1511] Processing CreateTablet for tablet c6e9bcf72ee94003bc14bfd0a0934fc4 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:03.139149 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e9bcf72ee94003bc14bfd0a0934fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.139739 19453 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.140308 19453 ts_tablet_manager.cc:1403] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.009s
I20260709 12:18:03.143906 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bb753f843f42fd92890f4780b85a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.144600 19457 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.148121 19453 raft_consensus.cc:359] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.152958 19453 raft_consensus.cc:385] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.153805 19221 tablet_service.cc:1511] Processing CreateTablet for tablet c6e9bcf72ee94003bc14bfd0a0934fc4 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:03.155915 19453 raft_consensus.cc:740] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.157037 19297 tablet_service.cc:1511] Processing CreateTablet for tablet c6e9bcf72ee94003bc14bfd0a0934fc4 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:03.163744 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e9bcf72ee94003bc14bfd0a0934fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.164645 19453 consensus_queue.cc:260] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.167584 19453 ts_tablet_manager.cc:1434] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.007s
I20260709 12:18:03.168637 19453 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.157766 19454 ts_tablet_manager.cc:1434] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.096s	user 0.031s	sys 0.046s
I20260709 12:18:03.160111 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e9bcf72ee94003bc14bfd0a0934fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.177003 19145 tablet_service.cc:1511] Processing CreateTablet for tablet 144a0634f5fa45318f48881c440679d3 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:03.178435 19145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144a0634f5fa45318f48881c440679d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.181685 19220 tablet_service.cc:1511] Processing CreateTablet for tablet 144a0634f5fa45318f48881c440679d3 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:03.183037 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144a0634f5fa45318f48881c440679d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.184703 19300 tablet_service.cc:1511] Processing CreateTablet for tablet 144a0634f5fa45318f48881c440679d3 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:03.186621 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144a0634f5fa45318f48881c440679d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.173398 19148 tablet_service.cc:1511] Processing CreateTablet for tablet c1339195b4a442af83f059e6a19e1458 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:03.189754 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1339195b4a442af83f059e6a19e1458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.174870 19301 tablet_service.cc:1511] Processing CreateTablet for tablet c1339195b4a442af83f059e6a19e1458 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:03.192574 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1339195b4a442af83f059e6a19e1458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.145391 19227 tablet_service.cc:1511] Processing CreateTablet for tablet 61bb753f843f42fd92890f4780b85a15 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:03.196115 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bb753f843f42fd92890f4780b85a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.190492 19223 tablet_service.cc:1511] Processing CreateTablet for tablet c1339195b4a442af83f059e6a19e1458 (DEFAULT_TABLE table=soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:03.212219 19223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1339195b4a442af83f059e6a19e1458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:03.214154 19457 tablet_bootstrap.cc:654] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.215014 19454 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.216070 19453 tablet_bootstrap.cc:654] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.238862 19454 tablet_bootstrap.cc:654] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.248647 19453 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.249172 19453 ts_tablet_manager.cc:1403] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.024s
I20260709 12:18:03.256992 19453 raft_consensus.cc:359] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.257658 19457 tablet_bootstrap.cc:492] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.257902 19453 raft_consensus.cc:385] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.258323 19457 ts_tablet_manager.cc:1403] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.000s
I20260709 12:18:03.258315 19453 raft_consensus.cc:740] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.259392 19453 consensus_queue.cc:260] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.262765 19453 ts_tablet_manager.cc:1434] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:18:03.263994 19453 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.265576 19457 raft_consensus.cc:359] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.266463 19457 raft_consensus.cc:385] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.266790 19457 raft_consensus.cc:740] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.267630 19457 consensus_queue.cc:260] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.270510 19457 ts_tablet_manager.cc:1434] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:03.272313 19453 tablet_bootstrap.cc:654] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.276204 19457 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.262463 19454 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.281104 19454 ts_tablet_manager.cc:1403] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.009s
I20260709 12:18:03.284432 19457 tablet_bootstrap.cc:654] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.287336 19453 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.287990 19453 ts_tablet_manager.cc:1403] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 12:18:03.287672 19454 raft_consensus.cc:359] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.288959 19454 raft_consensus.cc:385] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.289408 19454 raft_consensus.cc:740] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.290902 19453 raft_consensus.cc:359] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.290570 19454 consensus_queue.cc:260] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.291651 19453 raft_consensus.cc:385] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.291983 19453 raft_consensus.cc:740] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.292771 19453 consensus_queue.cc:260] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.293781 19454 ts_tablet_manager.cc:1434] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:03.296154 19453 ts_tablet_manager.cc:1434] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:18:03.296583 19454 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.299293 19453 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.314345 19457 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.315085 19457 ts_tablet_manager.cc:1403] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.011s
I20260709 12:18:03.316826 19454 tablet_bootstrap.cc:654] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.318377 19453 tablet_bootstrap.cc:654] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.318560 19457 raft_consensus.cc:359] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.319532 19457 raft_consensus.cc:385] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.319875 19457 raft_consensus.cc:740] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.320830 19457 consensus_queue.cc:260] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.324141 19457 ts_tablet_manager.cc:1434] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:18:03.326570 19457 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.328367 19453 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.329034 19453 ts_tablet_manager.cc:1403] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 12:18:03.329103 19454 tablet_bootstrap.cc:492] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.329700 19454 ts_tablet_manager.cc:1403] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.012s
I20260709 12:18:03.332276 19453 raft_consensus.cc:359] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.333135 19453 raft_consensus.cc:385] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.333086 19454 raft_consensus.cc:359] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.333870 19453 raft_consensus.cc:740] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.334123 19454 raft_consensus.cc:385] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.334671 19454 raft_consensus.cc:740] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.334939 19453 consensus_queue.cc:260] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.335531 19454 consensus_queue.cc:260] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.338374 19454 ts_tablet_manager.cc:1434] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:03.339440 19454 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.339509 19457 tablet_bootstrap.cc:654] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.344195 19453 ts_tablet_manager.cc:1434] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:18:03.345467 19453 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.347208 19454 tablet_bootstrap.cc:654] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.353709 19453 tablet_bootstrap.cc:654] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.355744 19457 tablet_bootstrap.cc:492] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.356550 19457 ts_tablet_manager.cc:1403] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.004s
I20260709 12:18:03.359015 19453 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.359565 19453 ts_tablet_manager.cc:1403] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:18:03.361054 19457 raft_consensus.cc:359] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.362002 19457 raft_consensus.cc:385] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.362388 19457 raft_consensus.cc:740] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.362139 19453 raft_consensus.cc:359] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.363049 19453 raft_consensus.cc:385] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.363417 19453 raft_consensus.cc:740] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.363358 19457 consensus_queue.cc:260] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.364363 19454 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.365130 19454 ts_tablet_manager.cc:1403] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:18:03.366122 19457 ts_tablet_manager.cc:1434] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:03.367336 19457 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.368475 19454 raft_consensus.cc:359] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.369468 19454 raft_consensus.cc:385] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.369803 19454 raft_consensus.cc:740] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.370582 19454 consensus_queue.cc:260] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.364394 19453 consensus_queue.cc:260] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.373199 19454 ts_tablet_manager.cc:1434] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:03.374487 19454 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.376731 19453 ts_tablet_manager.cc:1434] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:18:03.377955 19453 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.385396 19453 tablet_bootstrap.cc:654] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.385402 19457 tablet_bootstrap.cc:654] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.386528 19454 tablet_bootstrap.cc:654] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.398949 19453 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.399032 19457 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.399647 19453 ts_tablet_manager.cc:1403] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:18:03.399775 19457 ts_tablet_manager.cc:1403] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.008s
I20260709 12:18:03.403168 19453 raft_consensus.cc:359] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.404109 19453 raft_consensus.cc:385] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.404479 19453 raft_consensus.cc:740] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.405488 19457 raft_consensus.cc:359] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.405421 19453 consensus_queue.cc:260] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.406381 19457 raft_consensus.cc:385] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.406764 19457 raft_consensus.cc:740] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.407649 19457 consensus_queue.cc:260] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.408955 19453 ts_tablet_manager.cc:1434] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:18:03.410224 19453 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.410425 19457 ts_tablet_manager.cc:1434] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:03.411574 19457 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.418138 19453 tablet_bootstrap.cc:654] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.418614 19457 tablet_bootstrap.cc:654] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.421922 19456 raft_consensus.cc:493] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.422711 19456 raft_consensus.cc:515] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.426826 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:18:03.427768 19162 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:18:03.429399 19274 leader_election.cc:304] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.431537 19436 raft_consensus.cc:2804] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.431958 19436 raft_consensus.cc:493] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.432332 19436 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.434832 19457 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.435467 19457 ts_tablet_manager.cc:1403] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:18:03.436671 19456 leader_election.cc:290] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:03.438999 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.447698 19237 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:18:03.438823 19457 raft_consensus.cc:359] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.445734 19454 tablet_bootstrap.cc:492] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.448751 19454 ts_tablet_manager.cc:1403] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.075s	user 0.032s	sys 0.032s
I20260709 12:18:03.451391 19457 raft_consensus.cc:385] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.451344 19453 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.451993 19457 raft_consensus.cc:740] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.452417 19453 ts_tablet_manager.cc:1403] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 12:18:03.452466 19454 raft_consensus.cc:359] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.453020 19436 raft_consensus.cc:515] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.452881 19457 consensus_queue.cc:260] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.453732 19454 raft_consensus.cc:385] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.454186 19454 raft_consensus.cc:740] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.455119 19454 consensus_queue.cc:260] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.456425 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:03.457082 19162 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.456808 19453 raft_consensus.cc:359] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.457770 19453 raft_consensus.cc:385] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.458130 19453 raft_consensus.cc:740] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.458361 19454 ts_tablet_manager.cc:1434] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:18:03.459152 19453 consensus_queue.cc:260] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.459718 19454 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.461990 19457 ts_tablet_manager.cc:1434] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:18:03.463323 19457 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.462051 19453 ts_tablet_manager.cc:1434] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:03.470156 19453 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.470847 19454 tablet_bootstrap.cc:654] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.474511 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.475210 19237 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.479703 19460 raft_consensus.cc:493] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.480279 19460 raft_consensus.cc:515] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.482013 19453 tablet_bootstrap.cc:654] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.484056 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c5952f25a94ec68d3e36b8ac9c5f28" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.484846 19234 raft_consensus.cc:2468] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.484062 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c5952f25a94ec68d3e36b8ac9c5f28" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.486452 19311 raft_consensus.cc:2468] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.488065 19126 leader_election.cc:304] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.489161 19459 raft_consensus.cc:2804] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.489472 19457 tablet_bootstrap.cc:654] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.489506 19459 raft_consensus.cc:493] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.490903 19459 raft_consensus.cc:3060] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.494596 19237 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:18:03.496438 19162 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:18:03.498402 19274 leader_election.cc:304] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.499586 19456 raft_consensus.cc:2804] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.496994 19436 leader_election.cc:290] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:03.507336 19460 leader_election.cc:290] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.510401 19456 raft_consensus.cc:697] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:03.511745 19456 consensus_queue.cc:237] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.517405 19459 raft_consensus.cc:515] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.521064 19457 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.521234 19460 raft_consensus.cc:493] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.521894 19457 ts_tablet_manager.cc:1403] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.009s
I20260709 12:18:03.521962 19460 raft_consensus.cc:515] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.524093 19454 tablet_bootstrap.cc:492] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.524710 19454 ts_tablet_manager.cc:1403] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.031s
I20260709 12:18:03.525484 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.526153 19460 leader_election.cc:290] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.526242 19234 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.527006 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c5952f25a94ec68d3e36b8ac9c5f28" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.527604 19237 raft_consensus.cc:3060] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.525825 19457 raft_consensus.cc:359] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.528270 19457 raft_consensus.cc:385] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.528596 19457 raft_consensus.cc:740] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.528859 19454 raft_consensus.cc:359] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.529403 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.529917 19454 raft_consensus.cc:385] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.530321 19459 leader_election.cc:290] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.530593 19454 raft_consensus.cc:740] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.531390 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c5952f25a94ec68d3e36b8ac9c5f28" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.531785 19125 leader_election.cc:304] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.532364 19309 raft_consensus.cc:3060] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.532658 19454 consensus_queue.cc:260] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.534812 19454 ts_tablet_manager.cc:1434] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:18:03.535452 19311 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.536072 19454 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.530599 19457 consensus_queue.cc:260] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.540310 19457 ts_tablet_manager.cc:1434] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:18:03.542847 19237 raft_consensus.cc:2468] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.545104 19460 raft_consensus.cc:2804] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.544706 19457 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.545634 19460 raft_consensus.cc:493] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.547029 19460 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.553000 19125 leader_election.cc:304] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.553486 19309 raft_consensus.cc:2468] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.554416 19359 raft_consensus.cc:2804] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.567035 19454 tablet_bootstrap.cc:654] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.571698 19457 tablet_bootstrap.cc:654] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.571758 19459 raft_consensus.cc:493] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.576951 19058 catalog_manager.cc:5697] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.579443 19359 raft_consensus.cc:697] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:03.575707 19459 raft_consensus.cc:515] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.583146 19453 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.583781 19453 ts_tablet_manager.cc:1403] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.019s
I20260709 12:18:03.584034 19460 raft_consensus.cc:515] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.585958 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.587147 19460 leader_election.cc:290] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
W20260709 12:18:03.588580 19125 leader_election.cc:343] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:03.588587 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.590029 19311 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.590282 19457 tablet_bootstrap.cc:492] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.590049 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.591084 19457 ts_tablet_manager.cc:1403] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.025s
I20260709 12:18:03.591039 19234 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.594985 19457 raft_consensus.cc:359] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.587174 19453 raft_consensus.cc:359] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.598918 19453 raft_consensus.cc:385] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.582942 19359 consensus_queue.cc:237] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.599342 19453 raft_consensus.cc:740] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.601212 19453 consensus_queue.cc:260] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.601475 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.601531 19454 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.602561 19454 ts_tablet_manager.cc:1403] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.008s
W20260709 12:18:03.603084 19126 leader_election.cc:343] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 360e0328de754069889e206341ffa397 (127.7.137.3:41763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:03.596913 19457 raft_consensus.cc:385] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.600234 19459 leader_election.cc:290] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.603648 19126 leader_election.cc:304] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:18:03.604363 19453 ts_tablet_manager.cc:1434] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:18:03.603789 19457 raft_consensus.cc:740] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.604660 19481 raft_consensus.cc:2749] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:03.604075 19459 raft_consensus.cc:493] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.605494 19457 consensus_queue.cc:260] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.605803 19459 raft_consensus.cc:515] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.605384 19453 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Bootstrap starting.
I20260709 12:18:03.608112 19457 ts_tablet_manager.cc:1434] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:18:03.609186 19457 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.609160 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88b024c87074ab69a2a40fb01cd4325" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.609906 19237 raft_consensus.cc:2468] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.606141 19454 raft_consensus.cc:359] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.615815 19125 leader_election.cc:304] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.616120 19454 raft_consensus.cc:385] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.616632 19453 tablet_bootstrap.cc:654] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.619582 19454 raft_consensus.cc:740] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.615820 19311 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.620518 19234 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.621559 19126 leader_election.cc:304] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.617138 19457 tablet_bootstrap.cc:654] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.622521 19481 raft_consensus.cc:2804] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.622920 19454 consensus_queue.cc:260] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.625414 19454 ts_tablet_manager.cc:1434] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:18:03.626263 19454 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.617612 19459 leader_election.cc:290] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.618731 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88b024c87074ab69a2a40fb01cd4325" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.627076 19309 raft_consensus.cc:2468] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.616739 19460 raft_consensus.cc:2804] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.629093 19460 raft_consensus.cc:493] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.629550 19460 raft_consensus.cc:3060] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.630959 19481 raft_consensus.cc:697] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:03.632385 19481 consensus_queue.cc:237] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.638533 19454 tablet_bootstrap.cc:654] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.641322 19457 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.642078 19457 ts_tablet_manager.cc:1403] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.007s
I20260709 12:18:03.641322 19453 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: No bootstrap required, opened a new log
I20260709 12:18:03.645195 19457 raft_consensus.cc:359] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.645961 19457 raft_consensus.cc:385] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.646059 19453 ts_tablet_manager.cc:1403] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 12:18:03.646314 19457 raft_consensus.cc:740] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.647097 19457 consensus_queue.cc:260] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.652165 19457 ts_tablet_manager.cc:1434] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:03.652957 19454 tablet_bootstrap.cc:492] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.653203 19457 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Bootstrap starting.
I20260709 12:18:03.653503 19454 ts_tablet_manager.cc:1403] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.007s
I20260709 12:18:03.654008 19460 raft_consensus.cc:515] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.656639 19460 leader_election.cc:290] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.656514 19454 raft_consensus.cc:359] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.657454 19454 raft_consensus.cc:385] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.657756 19454 raft_consensus.cc:740] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.658488 19454 consensus_queue.cc:260] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.660382 19457 tablet_bootstrap.cc:654] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.660741 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88b024c87074ab69a2a40fb01cd4325" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.660620 19453 raft_consensus.cc:359] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.661402 19311 raft_consensus.cc:3060] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.661500 19453 raft_consensus.cc:385] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.661988 19454 ts_tablet_manager.cc:1434] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:03.661998 19453 raft_consensus.cc:740] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.663067 19453 consensus_queue.cc:260] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.664196 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88b024c87074ab69a2a40fb01cd4325" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.665098 19234 raft_consensus.cc:3060] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.666464 19453 ts_tablet_manager.cc:1434] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:18:03.658170 19057 catalog_manager.cc:5697] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.668346 19454 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: Bootstrap starting.
I20260709 12:18:03.669689 19311 raft_consensus.cc:2468] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.670804 19126 leader_election.cc:304] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.671705 19460 raft_consensus.cc:2804] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.672087 19452 raft_consensus.cc:493] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.672725 19452 raft_consensus.cc:515] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.673869 19359 raft_consensus.cc:493] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.673979 19234 raft_consensus.cc:2468] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.674435 19359 raft_consensus.cc:515] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.675660 19452 leader_election.cc:290] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.676172 19454 tablet_bootstrap.cc:654] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:03.672196 19460 raft_consensus.cc:697] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:03.676488 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bb753f843f42fd92890f4780b85a15" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.677155 19311 raft_consensus.cc:2468] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:18:03.678483 19201 leader_election.cc:304] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.677472 19460 consensus_queue.cc:237] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.677449 19359 leader_election.cc:290] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.681682 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bb753f843f42fd92890f4780b85a15" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:18:03.682906 19452 raft_consensus.cc:2804] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.683997 19452 raft_consensus.cc:493] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.683517 19162 raft_consensus.cc:2468] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:18:03.685828 19452 raft_consensus.cc:3060] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.686975 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543dc117e59043b2a3e718e66c3ce01b" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.689673 19234 raft_consensus.cc:2468] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.692453 19125 leader_election.cc:304] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.694396 19481 raft_consensus.cc:2804] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.694767 19481 raft_consensus.cc:493] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.695080 19481 raft_consensus.cc:3060] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.701139 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543dc117e59043b2a3e718e66c3ce01b" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.701836 19311 raft_consensus.cc:2468] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 0.
I20260709 12:18:03.702078 19457 tablet_bootstrap.cc:492] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: No bootstrap required, opened a new log
I20260709 12:18:03.702636 19457 ts_tablet_manager.cc:1403] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.004s
I20260709 12:18:03.705628 19457 raft_consensus.cc:359] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.708580 19457 raft_consensus.cc:385] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.708860 19457 raft_consensus.cc:740] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.709656 19457 consensus_queue.cc:260] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.707818 19452 raft_consensus.cc:515] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.714345 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bb753f843f42fd92890f4780b85a15" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:03.715018 19162 raft_consensus.cc:3060] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.715315 19457 ts_tablet_manager.cc:1434] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:18:03.718070 19452 leader_election.cc:290] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.723279 19162 raft_consensus.cc:2468] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:03.723390 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bb753f843f42fd92890f4780b85a15" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.724131 19311 raft_consensus.cc:3060] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.730311 19456 raft_consensus.cc:493] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.729998 19481 raft_consensus.cc:515] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.730851 19456 raft_consensus.cc:515] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.731379 19452 raft_consensus.cc:493] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.732136 19454 tablet_bootstrap.cc:492] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: No bootstrap required, opened a new log
I20260709 12:18:03.731897 19452 raft_consensus.cc:515] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.732769 19454 ts_tablet_manager.cc:1403] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.024s
I20260709 12:18:03.733132 19456 leader_election.cc:290] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:03.735783 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:03.736021 19160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144a0634f5fa45318f48881c440679d3" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:18:03.741309 19160 raft_consensus.cc:2468] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:18:03.736590 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144a0634f5fa45318f48881c440679d3" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" is_pre_election: true
I20260709 12:18:03.742841 19234 raft_consensus.cc:2468] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 0.
I20260709 12:18:03.734174 19452 leader_election.cc:290] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
W20260709 12:18:03.744320 19201 leader_election.cc:343] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 360e0328de754069889e206341ffa397 (127.7.137.3:41763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:03.744823 19454 raft_consensus.cc:359] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.738373 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:18:03.745637 19454 raft_consensus.cc:385] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:03.745462 19274 leader_election.cc:304] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.745986 19454 raft_consensus.cc:740] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.746097 19161 raft_consensus.cc:2468] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:18:03.746481 19456 raft_consensus.cc:2804] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.747144 19456 raft_consensus.cc:493] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.748095 19456 raft_consensus.cc:3060] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.748220 19200 leader_election.cc:304] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.748775 19481 leader_election.cc:290] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.749037 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543dc117e59043b2a3e718e66c3ce01b" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.749693 19234 raft_consensus.cc:3060] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.749761 19357 raft_consensus.cc:2804] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.751039 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543dc117e59043b2a3e718e66c3ce01b" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.751888 19310 raft_consensus.cc:3060] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.753598 19200 leader_election.cc:304] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 360e0328de754069889e206341ffa397
I20260709 12:18:03.755641 19452 raft_consensus.cc:2804] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:03.746749 19454 consensus_queue.cc:260] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.747628 19311 raft_consensus.cc:2468] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:03.756431 19456 raft_consensus.cc:515] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.756492 19452 raft_consensus.cc:493] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.759724 19456 leader_election.cc:290] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:03.734874 19058 catalog_manager.cc:5697] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.759400 19452 raft_consensus.cc:3060] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.761492 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144a0634f5fa45318f48881c440679d3" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:03.762209 19161 raft_consensus.cc:3060] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.762188 19234 raft_consensus.cc:2468] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.763648 19454 ts_tablet_manager.cc:1434] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:18:03.763841 19125 leader_election.cc:304] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.764932 19481 raft_consensus.cc:2804] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.762377 19058 catalog_manager.cc:5697] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.765709 19481 raft_consensus.cc:697] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:03.766407 19310 raft_consensus.cc:2468] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 1.
I20260709 12:18:03.766700 19481 consensus_queue.cc:237] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.772331 19452 raft_consensus.cc:515] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.772455 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "144a0634f5fa45318f48881c440679d3" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:03.773478 19234 raft_consensus.cc:3060] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.774639 19452 leader_election.cc:290] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:03.775563 19159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:03.776298 19159 raft_consensus.cc:3060] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.777665 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6e9bcf72ee94003bc14bfd0a0934fc4" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:03.778352 19310 raft_consensus.cc:3060] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:03.784428 19357 raft_consensus.cc:697] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:03.785597 19357 consensus_queue.cc:237] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.788384 19310 raft_consensus.cc:2468] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:03.789803 19201 leader_election.cc:304] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:03.790776 19452 raft_consensus.cc:2804] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.791307 19452 raft_consensus.cc:697] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:03.792264 19452 consensus_queue.cc:237] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.792586 19159 raft_consensus.cc:2468] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:03.798151 19161 raft_consensus.cc:2468] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:18:03.797629 19058 catalog_manager.cc:5697] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 1 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.803990 19274 leader_election.cc:304] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:03.805104 19456 raft_consensus.cc:2804] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:03.805675 19456 raft_consensus.cc:697] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:03.806622 19456 consensus_queue.cc:237] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:03.810014 19234 raft_consensus.cc:2468] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 1.
I20260709 12:18:03.819553 19058 catalog_manager.cc:5697] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.823832 19060 catalog_manager.cc:5697] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 1 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.834529 19058 catalog_manager.cc:5697] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.005465 19357 raft_consensus.cc:493] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.006057 19357 raft_consensus.cc:515] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.007965 19481 consensus_queue.cc:1048] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.008654 19357 leader_election.cc:290] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:04.009231 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1339195b4a442af83f059e6a19e1458" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" is_pre_election: true
I20260709 12:18:04.009871 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1339195b4a442af83f059e6a19e1458" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397" is_pre_election: true
I20260709 12:18:04.009929 19161 raft_consensus.cc:2468] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:18:04.010751 19310 raft_consensus.cc:2468] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 0.
I20260709 12:18:04.011399 19200 leader_election.cc:304] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:04.012290 19357 raft_consensus.cc:2804] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:04.012751 19357 raft_consensus.cc:493] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.013141 19357 raft_consensus.cc:3060] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:04.022219 19357 raft_consensus.cc:515] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.025873 19357 leader_election.cc:290] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:04.026113 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1339195b4a442af83f059e6a19e1458" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:04.026846 19310 raft_consensus.cc:3060] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:04.027055 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1339195b4a442af83f059e6a19e1458" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:04.028075 19161 raft_consensus.cc:3060] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:04.031616 19460 consensus_queue.cc:1048] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.037684 19161 raft_consensus.cc:2468] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:04.040170 19200 leader_election.cc:304] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:04.041100 19357 raft_consensus.cc:2804] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:04.041561 19357 raft_consensus.cc:697] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:04.042309 19357 consensus_queue.cc:237] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.043526 19310 raft_consensus.cc:2468] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 1.
I20260709 12:18:04.051569 19058 catalog_manager.cc:5697] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 1 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.067351 19460 consensus_queue.cc:1048] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.081424 19489 consensus_queue.cc:1048] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.082013 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e"
dest_uuid: "360e0328de754069889e206341ffa397"
mode: GRACEFUL
new_leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
 from {username='slave'} at 127.0.0.1:46808
I20260709 12:18:04.082959 19311 raft_consensus.cc:606] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Received request to transfer leadership to TS 7a3afa7d9eb44f06801d5c5d3299d423
I20260709 12:18:04.083074 19489 consensus_queue.cc:1048] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:04.117022 19456 consensus_queue.cc:1048] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.135571 19481 consensus_queue.cc:1048] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.140054 19456 consensus_queue.cc:1048] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.181735 19479 raft_consensus.cc:993] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: : Instructing follower 7a3afa7d9eb44f06801d5c5d3299d423 to start an election
I20260709 12:18:04.182353 19479 raft_consensus.cc:1081] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Signalling peer 7a3afa7d9eb44f06801d5c5d3299d423 to start an election
I20260709 12:18:04.184314 19161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e"
dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
 from {username='slave'} at 127.0.0.1:42468
I20260709 12:18:04.184974 19161 raft_consensus.cc:493] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.185357 19161 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.194366 19159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9"
dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
mode: GRACEFUL
new_leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:50108
I20260709 12:18:04.195102 19159 raft_consensus.cc:606] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Received request to transfer leadership to TS a8df8fb5ceb0496ea8dd0f3239a4c8f4
I20260709 12:18:04.195106 19161 raft_consensus.cc:515] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.198139 19161 leader_election.cc:290] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 2 election: Requested vote from peers a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:04.199525 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:04.200147 19311 raft_consensus.cc:3055] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.200259 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aee744c19e4440f89009e6e9af9a35e" candidate_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:04.200477 19311 raft_consensus.cc:740] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:04.200910 19234 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.201370 19311 consensus_queue.cc:260] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.203012 19311 raft_consensus.cc:3060] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.208735 19234 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 2.
I20260709 12:18:04.209959 19125 leader_election.cc:304] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3afa7d9eb44f06801d5c5d3299d423, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:04.211400 19489 raft_consensus.cc:2804] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:04.212015 19489 raft_consensus.cc:697] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 LEADER]: Becoming Leader. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:04.212841 19489 consensus_queue.cc:237] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.219511 19311 raft_consensus.cc:2468] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3afa7d9eb44f06801d5c5d3299d423 in term 2.
I20260709 12:18:04.221342 19060 catalog_manager.cc:5697] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 reported cstate change: term changed from 1 to 2, leader changed from 360e0328de754069889e206341ffa397 (127.7.137.3) to 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1). New cstate: current_term: 2 leader_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.265827 19357 consensus_queue.cc:1048] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.276690 19479 consensus_queue.cc:1048] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.277091 19496 consensus_queue.cc:1048] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.279321 19489 consensus_queue.cc:1048] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.300385 19460 consensus_queue.cc:1048] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:04.302569 19479 consensus_queue.cc:1048] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.326421 19496 consensus_queue.cc:1048] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.336731 19357 consensus_queue.cc:1048] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.532292 19357 consensus_queue.cc:1048] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.550148 19526 consensus_queue.cc:1048] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:04.595690 19359 raft_consensus.cc:993] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: : Instructing follower a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:04.596179 19460 raft_consensus.cc:1081] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Signalling peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 to start an election
I20260709 12:18:04.597793 19237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
 from {username='slave'} at 127.0.0.1:39308
I20260709 12:18:04.598295 19237 raft_consensus.cc:493] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.598610 19237 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.603935 19237 raft_consensus.cc:515] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.605636 19237 leader_election.cc:290] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), 360e0328de754069889e206341ffa397 (127.7.137.3:41763)
I20260709 12:18:04.606647 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:04.606758 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1d21a425484f44851d87ca892c3ee9" candidate_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "360e0328de754069889e206341ffa397"
I20260709 12:18:04.607453 19161 raft_consensus.cc:3055] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.607523 19310 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.607764 19161 raft_consensus.cc:740] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:04.608558 19161 consensus_queue.cc:260] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.609562 19161 raft_consensus.cc:3060] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.611779 19311 raft_consensus.cc:1275] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer 7a3afa7d9eb44f06801d5c5d3299d423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.613240 19460 consensus_queue.cc:1048] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.614075 19310 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:04.615301 19201 leader_election.cc:304] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:04.615794 19161 raft_consensus.cc:2468] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8df8fb5ceb0496ea8dd0f3239a4c8f4 in term 2.
I20260709 12:18:04.616163 19526 raft_consensus.cc:2804] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:04.616914 19526 raft_consensus.cc:697] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Leader. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:04.617727 19526 consensus_queue.cc:237] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:04.624274 19237 raft_consensus.cc:1275] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Refusing update from remote peer 7a3afa7d9eb44f06801d5c5d3299d423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:04.627446 19460 consensus_queue.cc:1048] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:04.630613 19058 catalog_manager.cc:5697] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 reported cstate change: term changed from 1 to 2, leader changed from 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1) to a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2). New cstate: current_term: 2 leader_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.026160 19161 raft_consensus.cc:1275] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:05.027529 19526 consensus_queue.cc:1048] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:05.036128 19310 raft_consensus.cc:1275] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Refusing update from remote peer a8df8fb5ceb0496ea8dd0f3239a4c8f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:05.038264 19357 consensus_queue.cc:1048] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:07.213238 19057 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38138:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:18:07.236506 19057 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38138:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:18:07.275388  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:07.612008 19575 log.cc:927] Time spent T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:18:07.655658 19567 log.cc:927] Time spent T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 12:18:07.645533 19585 tablet.cc:1724] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:07.663729 19570 log.cc:927] Time spent T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:18:07.666365 19577 log.cc:927] Time spent T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:07.653064 19586 tablet.cc:1724] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.672554 19594 tablet.cc:1724] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:07.663794 19573 log.cc:927] Time spent T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Append to log took a long time: real 0.110s	user 0.000s	sys 0.007s
W20260709 12:18:07.685802 19579 log.cc:927] Time spent T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:18:07.661782 19234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7"
dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
mode: GRACEFUL
new_leader_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:50408
I20260709 12:18:07.687096 19234 raft_consensus.cc:606] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Received request to transfer leadership to TS 360e0328de754069889e206341ffa397
I20260709 12:18:07.717850 19595 tablet.cc:1724] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.721856 19599 tablet.cc:1724] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.741937 19597 tablet.cc:1724] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.746838 19590 tablet.cc:1724] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.746840 19600 tablet.cc:1724] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:07.760612 19581 log.cc:927] Time spent T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:18:07.769778 19602 tablet.cc:1724] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.688166 19587 tablet.cc:1724] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.799441 19590 tablet.cc:1724] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.826411 19604 tablet.cc:1724] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.839931 19595 tablet.cc:1724] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.857376 19605 tablet.cc:1724] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.859869 19595 tablet.cc:1724] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.864086 19600 tablet.cc:1724] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.842900 19597 tablet.cc:1724] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.870924 19161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896"
dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
mode: GRACEFUL
new_leader_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:50116
I20260709 12:18:07.871635 19161 raft_consensus.cc:606] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Received request to transfer leadership to TS 360e0328de754069889e206341ffa397
I20260709 12:18:07.871345 19586 tablet.cc:1724] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.873040  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:07.873675  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:07.873544 19585 tablet.cc:1724] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.885392 19595 tablet.cc:1724] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.894261 19599 tablet.cc:1724] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.896238 19602 tablet.cc:1724] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.905251 19587 tablet.cc:1724] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.909674 19590 tablet.cc:1724] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.912287 19531 raft_consensus.cc:993] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: : Instructing follower 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:07.915634 19531 raft_consensus.cc:1081] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Signalling peer 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:07.913765 19596 raft_consensus.cc:993] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: : Instructing follower 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:07.917312 19596 raft_consensus.cc:1081] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Signalling peer 360e0328de754069889e206341ffa397 to start an election
I20260709 12:18:07.917737 19305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896"
dest_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:46792
I20260709 12:18:07.918535 19305 raft_consensus.cc:493] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.919960 19309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7"
dest_uuid: "360e0328de754069889e206341ffa397"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:18:07.920724 19309 raft_consensus.cc:493] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.921118 19309 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.905418 19605 tablet.cc:1724] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.923591 19305 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.925143 19597 tablet.cc:1724] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.934170 19587 tablet.cc:1724] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:07.941175 19309 raft_consensus.cc:515] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.944198 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:07.944834 19161 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.952414 19161 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 3.
I20260709 12:18:07.953825 19274 leader_election.cc:304] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, 7a3afa7d9eb44f06801d5c5d3299d423; no voters: 
I20260709 12:18:07.955004 19530 raft_consensus.cc:2804] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.955592 19530 raft_consensus.cc:697] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 3 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:07.956568 19530 consensus_queue.cc:237] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.959537 19309 leader_election.cc:290] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 3 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:07.960737 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d915011aba44e3823c5eca6135c4c7" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:07.961509 19234 raft_consensus.cc:3055] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.961843 19234 raft_consensus.cc:740] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8df8fb5ceb0496ea8dd0f3239a4c8f4, State: Running, Role: LEADER
I20260709 12:18:07.962661 19305 raft_consensus.cc:515] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.964944 19305 leader_election.cc:290] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 2 election: Requested vote from peers 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021), a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075)
I20260709 12:18:07.967195 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4"
I20260709 12:18:07.967820 19237 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.962730 19234 consensus_queue.cc:260] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.969285 19234 raft_consensus.cc:3060] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.971694 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697005f35bbe4c4497e4a64a8009c896" candidate_uuid: "360e0328de754069889e206341ffa397" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3afa7d9eb44f06801d5c5d3299d423"
I20260709 12:18:07.972393 19162 raft_consensus.cc:3055] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:07.972769 19162 raft_consensus.cc:740] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3afa7d9eb44f06801d5c5d3299d423, State: Running, Role: LEADER
I20260709 12:18:07.973624 19162 consensus_queue.cc:260] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.974947 19237 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 2.
I20260709 12:18:07.974989 19162 raft_consensus.cc:3060] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.976778 19274 leader_election.cc:304] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360e0328de754069889e206341ffa397, a8df8fb5ceb0496ea8dd0f3239a4c8f4; no voters: 
I20260709 12:18:07.977780 19530 raft_consensus.cc:2804] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:07.977859 19234 raft_consensus.cc:2468] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 3.
I20260709 12:18:07.979470 19530 raft_consensus.cc:697] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 2 LEADER]: Becoming Leader. State: Replica: 360e0328de754069889e206341ffa397, State: Running, Role: LEADER
I20260709 12:18:07.980464 19530 consensus_queue.cc:237] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } }
I20260709 12:18:07.984143 19162 raft_consensus.cc:2468] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360e0328de754069889e206341ffa397 in term 2.
I20260709 12:18:07.998247 19060 catalog_manager.cc:5697] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 1 to 2, leader changed from 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1) to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 2 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:07.999814 19060 catalog_manager.cc:5697] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 reported cstate change: term changed from 2 to 3, leader changed from a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2) to 360e0328de754069889e206341ffa397 (127.7.137.3). New cstate: current_term: 3 leader_uuid: "360e0328de754069889e206341ffa397" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "360e0328de754069889e206341ffa397" member_type: VOTER last_known_addr { host: "127.7.137.3" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:08.001251 19057 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: soft_deleted_table [id=d900a5a5c3c64624b75fe01f7d491427] alter complete (version 1)
I20260709 12:18:08.445796 19234 raft_consensus.cc:1275] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 3 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.447068 19530 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.460713 19162 raft_consensus.cc:1275] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 3 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:08.462121 19613 consensus_queue.cc:1048] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:08.519170 19162 raft_consensus.cc:1275] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.520440 19613 consensus_queue.cc:1048] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3afa7d9eb44f06801d5c5d3299d423" member_type: VOTER last_known_addr { host: "127.7.137.1" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:08.530244 19234 raft_consensus.cc:1275] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Refusing update from remote peer 360e0328de754069889e206341ffa397: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.531687 19530 consensus_queue.cc:1048] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8df8fb5ceb0496ea8dd0f3239a4c8f4" member_type: VOTER last_known_addr { host: "127.7.137.2" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:08.874961  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:08.881773  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:08.882157  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:09.883121  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:09.888929  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:09.889412  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:10.890461  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:10.896034  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:10.896651  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:11.897621  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.904332  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:11.904907  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:12.905972  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:12.914924  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:12.915619  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:13.917251  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.024919  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:14.025816  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:15.027431  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.032907  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:15.033442  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:15.042613 19183 debug-util.cc:398] Leaking SignalData structure 0x7b0800230a40 after lost signal to thread 7719
W20260709 12:18:15.044039 19183 debug-util.cc:398] Leaking SignalData structure 0x7b08002079e0 after lost signal to thread 19094
W20260709 12:18:15.045451 19183 debug-util.cc:398] Leaking SignalData structure 0x7b08001262e0 after lost signal to thread 19186
W20260709 12:18:15.046692 19183 debug-util.cc:398] Leaking SignalData structure 0x7b080023e340 after lost signal to thread 19261
W20260709 12:18:15.047878 19183 debug-util.cc:398] Leaking SignalData structure 0x7b08001249e0 after lost signal to thread 19335
I20260709 12:18:16.034511  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.040576  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:16.041078  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:17.042209  7716 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.050755  7716 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:17.051384  7716 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.108562  7716 tablet_server.cc:179] TabletServer@127.7.137.1:0 shutting down...
I20260709 12:18:18.139537  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:18.140553  7716 tablet_replica.cc:333] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.141460  7716 raft_consensus.cc:2243] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.142163  7716 raft_consensus.cc:2272] T 144a0634f5fa45318f48881c440679d3 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.144898  7716 tablet_replica.cc:333] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.145591  7716 raft_consensus.cc:2243] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.146147  7716 raft_consensus.cc:2272] T ea1d21a425484f44851d87ca892c3ee9 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.149034  7716 tablet_replica.cc:333] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.149786  7716 raft_consensus.cc:2243] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.150636  7716 raft_consensus.cc:2272] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.153533  7716 tablet_replica.cc:333] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.154219  7716 raft_consensus.cc:2243] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.155396  7716 raft_consensus.cc:2272] T d88b024c87074ab69a2a40fb01cd4325 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.159106  7716 tablet_replica.cc:333] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.159863  7716 raft_consensus.cc:2243] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.161244  7716 raft_consensus.cc:2272] T 6bca627ec32d4b55a144bc412a9e7907 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:18.163383 19200 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 12:18:18.164557  7716 tablet_replica.cc:333] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.165707  7716 raft_consensus.cc:2243] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.166314  7716 raft_consensus.cc:2272] T 697005f35bbe4c4497e4a64a8009c896 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:18.166910 19200 consensus_peers.cc:597] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.169250  7716 tablet_replica.cc:333] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.170017  7716 raft_consensus.cc:2243] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.171025  7716 raft_consensus.cc:2272] T ca82c2d8aabd4758baa81e106b56ea44 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.174825  7716 tablet_replica.cc:333] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.175498  7716 raft_consensus.cc:2243] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.176038  7716 raft_consensus.cc:2272] T 1c4a0478ac904d41b05c5efaff72d4ea P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.178622  7716 tablet_replica.cc:333] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.179204  7716 raft_consensus.cc:2243] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.180197  7716 raft_consensus.cc:2272] T fc1ac03dfc0443949fa7d4383e93c230 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.182711  7716 tablet_replica.cc:333] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.183322  7716 raft_consensus.cc:2243] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.183815  7716 raft_consensus.cc:2272] T e8f938bdfaa04ccd8d32b17673028053 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.186228  7716 tablet_replica.cc:333] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.186782  7716 raft_consensus.cc:2243] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.187206  7716 raft_consensus.cc:2272] T d0c074c33dc94b60a72e086ea646de84 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.189888  7716 tablet_replica.cc:333] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.190457  7716 raft_consensus.cc:2243] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.191541  7716 raft_consensus.cc:2272] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.194693  7716 tablet_replica.cc:333] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.195463  7716 raft_consensus.cc:2243] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.196197  7716 raft_consensus.cc:2272] T 08d915011aba44e3823c5eca6135c4c7 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.200433  7716 tablet_replica.cc:333] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.201336  7716 raft_consensus.cc:2243] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:18.201357 19274 consensus_peers.cc:597] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.202384  7716 raft_consensus.cc:2272] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.206245  7716 tablet_replica.cc:333] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.206794  7716 raft_consensus.cc:2243] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.207376  7716 raft_consensus.cc:2272] T c1339195b4a442af83f059e6a19e1458 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.209944  7716 tablet_replica.cc:333] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.210466  7716 raft_consensus.cc:2243] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.211025  7716 raft_consensus.cc:2272] T 61bb753f843f42fd92890f4780b85a15 P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.213617  7716 tablet_replica.cc:333] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.214112  7716 raft_consensus.cc:2243] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.215085  7716 raft_consensus.cc:2272] T 543dc117e59043b2a3e718e66c3ce01b P 7a3afa7d9eb44f06801d5c5d3299d423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.217486  7716 tablet_replica.cc:333] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423: stopping tablet replica
I20260709 12:18:18.217975  7716 raft_consensus.cc:2243] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.218940  7716 raft_consensus.cc:2272] T 3aee744c19e4440f89009e6e9af9a35e P 7a3afa7d9eb44f06801d5c5d3299d423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.289847  7716 tablet_server.cc:196] TabletServer@127.7.137.1:0 shutdown complete.
W20260709 12:18:18.291728 19200 consensus_peers.cc:597] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.336668  7716 tablet_server.cc:179] TabletServer@127.7.137.2:0 shutting down...
W20260709 12:18:18.340086 19274 consensus_peers.cc:597] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:18.358578 19200 consensus_peers.cc:597] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:18.372674 19274 consensus_peers.cc:597] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.374027  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:18.374822  7716 tablet_replica.cc:333] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.375912  7716 raft_consensus.cc:2243] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.376470  7716 raft_consensus.cc:2272] T 144a0634f5fa45318f48881c440679d3 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.378921  7716 tablet_replica.cc:333] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.379602  7716 raft_consensus.cc:2243] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.380440  7716 raft_consensus.cc:2272] T c6e9bcf72ee94003bc14bfd0a0934fc4 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.382589  7716 tablet_replica.cc:333] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.383214  7716 raft_consensus.cc:2243] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.384202  7716 raft_consensus.cc:2272] T ea1d21a425484f44851d87ca892c3ee9 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.386427  7716 tablet_replica.cc:333] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.387079  7716 raft_consensus.cc:2243] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.387646  7716 raft_consensus.cc:2272] T d88b024c87074ab69a2a40fb01cd4325 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.390206  7716 tablet_replica.cc:333] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.390796  7716 raft_consensus.cc:2243] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.391713  7716 raft_consensus.cc:2272] T 61bb753f843f42fd92890f4780b85a15 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.393887  7716 tablet_replica.cc:333] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.394392  7716 raft_consensus.cc:2243] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.395190  7716 raft_consensus.cc:2272] T c1339195b4a442af83f059e6a19e1458 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.397475  7716 tablet_replica.cc:333] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.398072  7716 raft_consensus.cc:2243] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.398541  7716 raft_consensus.cc:2272] T 543dc117e59043b2a3e718e66c3ce01b P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.400763  7716 tablet_replica.cc:333] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.401321  7716 raft_consensus.cc:2243] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.401832  7716 raft_consensus.cc:2272] T 3aee744c19e4440f89009e6e9af9a35e P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.404131  7716 tablet_replica.cc:333] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.404621  7716 raft_consensus.cc:2243] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.405547  7716 raft_consensus.cc:2272] T e8f938bdfaa04ccd8d32b17673028053 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.407971  7716 tablet_replica.cc:333] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.408463  7716 raft_consensus.cc:2243] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.408880  7716 raft_consensus.cc:2272] T fc1ac03dfc0443949fa7d4383e93c230 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.411059  7716 tablet_replica.cc:333] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.411644  7716 raft_consensus.cc:2243] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.412113  7716 raft_consensus.cc:2272] T 6bca627ec32d4b55a144bc412a9e7907 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.414388  7716 tablet_replica.cc:333] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.414953  7716 raft_consensus.cc:2243] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.415521  7716 raft_consensus.cc:2272] T 697005f35bbe4c4497e4a64a8009c896 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.418871  7716 tablet_replica.cc:333] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.419636  7716 raft_consensus.cc:2243] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:18:18.420009 19274 consensus_peers.cc:597] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 -> Peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Couldn't send request to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.420703  7716 raft_consensus.cc:2272] T 1c4a0478ac904d41b05c5efaff72d4ea P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.423220  7716 tablet_replica.cc:333] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.423844  7716 raft_consensus.cc:2243] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.424304  7716 raft_consensus.cc:2272] T ca82c2d8aabd4758baa81e106b56ea44 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.426857  7716 tablet_replica.cc:333] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.427479  7716 raft_consensus.cc:2243] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.428092  7716 raft_consensus.cc:2272] T 5d2ad12378ed4f7d9d3c9307df89eea2 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.430423  7716 tablet_replica.cc:333] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.430946  7716 raft_consensus.cc:2243] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.431891  7716 raft_consensus.cc:2272] T d0c074c33dc94b60a72e086ea646de84 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.434098  7716 tablet_replica.cc:333] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.434644  7716 raft_consensus.cc:2243] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.435303  7716 raft_consensus.cc:2272] T 32c5952f25a94ec68d3e36b8ac9c5f28 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.437543  7716 tablet_replica.cc:333] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4: stopping tablet replica
I20260709 12:18:18.438045  7716 raft_consensus.cc:2243] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.438483  7716 raft_consensus.cc:2272] T 08d915011aba44e3823c5eca6135c4c7 P a8df8fb5ceb0496ea8dd0f3239a4c8f4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:18.444073 19274 consensus_peers.cc:597] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 -> Peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Couldn't send request to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.483080  7716 tablet_server.cc:196] TabletServer@127.7.137.2:0 shutdown complete.
W20260709 12:18:18.496176 19274 consensus_peers.cc:597] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 -> Peer 7a3afa7d9eb44f06801d5c5d3299d423 (127.7.137.1:44021): Couldn't send request to peer 7a3afa7d9eb44f06801d5c5d3299d423. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.529337  7716 tablet_server.cc:179] TabletServer@127.7.137.3:0 shutting down...
W20260709 12:18:18.542212 19274 consensus_peers.cc:597] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 -> Peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Couldn't send request to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:18.553462 19274 consensus_peers.cc:597] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 -> Peer a8df8fb5ceb0496ea8dd0f3239a4c8f4 (127.7.137.2:35075): Couldn't send request to peer a8df8fb5ceb0496ea8dd0f3239a4c8f4. Status: Network error: Client connection negotiation failed: client connection to 127.7.137.2:35075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:18.561645  7716 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:18.562379  7716 tablet_replica.cc:333] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.563149  7716 raft_consensus.cc:2243] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.563802  7716 raft_consensus.cc:2272] T c6e9bcf72ee94003bc14bfd0a0934fc4 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.566272  7716 tablet_replica.cc:333] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.566877  7716 raft_consensus.cc:2243] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.567763  7716 raft_consensus.cc:2272] T 144a0634f5fa45318f48881c440679d3 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.569990  7716 tablet_replica.cc:333] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.570523  7716 raft_consensus.cc:2243] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.570982  7716 raft_consensus.cc:2272] T ea1d21a425484f44851d87ca892c3ee9 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.573477  7716 tablet_replica.cc:333] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.574014  7716 raft_consensus.cc:2243] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.574417  7716 raft_consensus.cc:2272] T d88b024c87074ab69a2a40fb01cd4325 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.576704  7716 tablet_replica.cc:333] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.577237  7716 raft_consensus.cc:2243] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.577620  7716 raft_consensus.cc:2272] T 6bca627ec32d4b55a144bc412a9e7907 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.579768  7716 tablet_replica.cc:333] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.580282  7716 raft_consensus.cc:2243] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.581064  7716 raft_consensus.cc:2272] T 697005f35bbe4c4497e4a64a8009c896 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.583201  7716 tablet_replica.cc:333] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.583770  7716 raft_consensus.cc:2243] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.584225  7716 raft_consensus.cc:2272] T c1339195b4a442af83f059e6a19e1458 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.586210  7716 tablet_replica.cc:333] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.586692  7716 raft_consensus.cc:2243] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.587141  7716 raft_consensus.cc:2272] T 61bb753f843f42fd92890f4780b85a15 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.589291  7716 tablet_replica.cc:333] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.589819  7716 raft_consensus.cc:2243] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.590274  7716 raft_consensus.cc:2272] T 543dc117e59043b2a3e718e66c3ce01b P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.592257  7716 tablet_replica.cc:333] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.592753  7716 raft_consensus.cc:2243] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.593163  7716 raft_consensus.cc:2272] T 3aee744c19e4440f89009e6e9af9a35e P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.595324  7716 tablet_replica.cc:333] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.595806  7716 raft_consensus.cc:2243] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.596249  7716 raft_consensus.cc:2272] T e8f938bdfaa04ccd8d32b17673028053 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.598279  7716 tablet_replica.cc:333] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.598711  7716 raft_consensus.cc:2243] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.599077  7716 raft_consensus.cc:2272] T fc1ac03dfc0443949fa7d4383e93c230 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.601146  7716 tablet_replica.cc:333] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.601627  7716 raft_consensus.cc:2243] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.602043  7716 raft_consensus.cc:2272] T 1c4a0478ac904d41b05c5efaff72d4ea P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.603996  7716 tablet_replica.cc:333] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.604481  7716 raft_consensus.cc:2243] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.604862  7716 raft_consensus.cc:2272] T ca82c2d8aabd4758baa81e106b56ea44 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.606839  7716 tablet_replica.cc:333] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.607303  7716 raft_consensus.cc:2243] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.608076  7716 raft_consensus.cc:2272] T 08d915011aba44e3823c5eca6135c4c7 P 360e0328de754069889e206341ffa397 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.610033  7716 tablet_replica.cc:333] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.610466  7716 raft_consensus.cc:2243] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.611229  7716 raft_consensus.cc:2272] T 5d2ad12378ed4f7d9d3c9307df89eea2 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.613257  7716 tablet_replica.cc:333] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.613685  7716 raft_consensus.cc:2243] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.614071  7716 raft_consensus.cc:2272] T 32c5952f25a94ec68d3e36b8ac9c5f28 P 360e0328de754069889e206341ffa397 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.616034  7716 tablet_replica.cc:333] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397: stopping tablet replica
I20260709 12:18:18.616464  7716 raft_consensus.cc:2243] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.616858  7716 raft_consensus.cc:2272] T d0c074c33dc94b60a72e086ea646de84 P 360e0328de754069889e206341ffa397 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.658025  7716 tablet_server.cc:196] TabletServer@127.7.137.3:0 shutdown complete.
I20260709 12:18:18.694128  7716 master.cc:562] Master@127.7.137.62:39607 shutting down...
I20260709 12:18:18.717865  7716 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:18.718467  7716 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:18.718770  7716 tablet_replica.cc:333] T 00000000000000000000000000000000 P f7b03419a6d74b3da9ff85d26dfcab57: stopping tablet replica
I20260709 12:18:18.739961  7716 master.cc:584] Master@127.7.137.62:39607 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20890 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41495 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (395728 ms total)
[  PASSED  ] 8 tests.
I20260709 12:18:18.802021  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2195 messages since previous log ~31 seconds ago
I20260709 12:18:18.802248  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2195 messages since previous log ~31 seconds ago
I20260709 12:18:18.802402  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2195 messages since previous log ~31 seconds ago
I20260709 12:18:18.802587  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:18:18.802759  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:18:18.802942  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~184 seconds ago
I20260709 12:18:18.803171  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:18:18.803361  7716 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
